Jul 30 20:16:49 devstack cinder-volume[77666]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Jul 30 20:16:49 devstack cinder-volume[77666]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jul 30 20:16:49 devstack cinder-volume[77666]: we strongly recommend against using it for new projects.
Jul 30 20:16:49 devstack cinder-volume[77666]: If you are already using Eventlet, we recommend migrating to a different
Jul 30 20:16:49 devstack cinder-volume[77666]: framework.  For more detail see
Jul 30 20:16:49 devstack cinder-volume[77666]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jul 30 20:16:49 devstack cinder-volume[77666]:   import eventlet  # noqa
Jul 30 20:16:52 devstack cinder-volume[77666]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=77666) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Jul 30 20:16:52 devstack cinder-volume[77666]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=77666) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Jul 30 20:16:52 devstack cinder-volume[77666]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=77666) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Jul 30 20:16:53 devstack cinder-volume[77666]: INFO dbcounter [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] Registered counter for database cinder
Jul 30 20:16:53 devstack cinder-volume[77666]: DEBUG oslo_db.sqlalchemy.engines [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77666) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 30 20:16:53 devstack cinder-volume[77666]: DEBUG dbcounter [-] [77666] Writer thread running {{(pid=77666) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 30 20:16:53 devstack cinder-volume[77666]: INFO cinder.rpc [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Jul 30 20:16:53 devstack cinder-volume[77666]: INFO cinder.rpc [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Jul 30 20:16:53 devstack cinder-volume[77666]: DEBUG oslo_db.sqlalchemy.engines [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77666) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 30 20:16:53 devstack cinder-volume[77666]: INFO cinder.volume.manager [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] Determined volume DB was empty at startup.
Jul 30 20:16:53 devstack cinder-volume[77666]: DEBUG cinder.volume.manager [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] Cinder Volume DB check: vol_db_empty=True {{(pid=77666) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Jul 30 20:16:53 devstack cinder-volume[77666]: INFO cinder.volume.manager [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] Service not found for updating active_backend_id, assuming default for driver init.
Jul 30 20:16:53 devstack cinder-volume[77666]: WARNING stevedore.named [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jul 30 20:16:53 devstack cinder-volume[77666]: WARNING castellan.key_manager [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 30 20:16:53 devstack cinder-volume[77666]: WARNING cinder.keymgr.conf_key_mgr [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG cinder.volume.drivers.lvm [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=77666) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_concurrency.processutils [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=77666) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_concurrency.processutils [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] CMD "cinder-rtstool verify" returned: 0 in 0.440s {{(pid=77666) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_db.sqlalchemy.engines [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77666) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 30 20:16:54 devstack cinder-volume[77666]: INFO cinder.rpc [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Jul 30 20:16:54 devstack cinder-volume[77666]: INFO cinder.rpc [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Jul 30 20:16:54 devstack cinder-volume[77666]: WARNING stevedore.named [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jul 30 20:16:54 devstack cinder-volume[77666]: WARNING castellan.key_manager [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 30 20:16:54 devstack cinder-volume[77666]: INFO cinder.volume.manager [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_db.sqlalchemy.engines [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77666) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 30 20:16:54 devstack cinder-volume[77666]: INFO oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] Starting 1 workers
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] Started child 77821 {{(pid=77666) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] Full set of CONF: {{(pid=77666) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] ******************************************************************************** {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] Configuration options gathered from: {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] ================================================================================ {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] allow_availability_zone_fallback = False {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] allow_compression_on_image_upload = False {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77821]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] allowed_direct_url_schemes     = [] {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] api_rate_limit                 = True {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] auth_strategy                  = keystone {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] az_cache_duration              = 3600 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] backend_availability_zone      = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] backend_host                   = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] backend_name                   = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] backend_stats_polling_interval = 60 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] backup_api_class               = cinder.backup.api.API {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] backup_name_template           = backup-%s {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] backup_use_same_host           = False {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] backup_use_temp_snapshot       = False {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] chap_password                  = **** {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] chap_username                  =  {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] cinder_internal_tenant_project_id = a3814ccecea84ea481f96c4f5d62821c {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] cinder_internal_tenant_user_id = d7b5bc1d1ac44a72849c7903bac92f36 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] cloned_volume_same_az          = True {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] cluster                        = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] compression_format             = gzip {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] compute_api_class              = cinder.compute.nova.API {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] config_dir                     = [] {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] config_source                  = [] {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] control_exchange               = openstack {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] debug                          = True {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] default_availability_zone      = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] default_group_type             = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] default_volume_type            = lvmdriver-1 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] disk_geometry                  = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] driver_client_cert             = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] driver_client_cert_key         = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] driver_data_namespace          = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] driver_ssl_cert_path           = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] driver_ssl_cert_verify         = False {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] driver_use_ssl                 = False {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] enable_force_upload            = False {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] enable_new_services            = True {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] enable_unsupported_driver      = False {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] enabled_backends               = ['lvmdriver-1'] {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] enforce_multipath_for_image_xfer = False {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] filter_function                = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] glance_api_insecure            = False {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] glance_api_servers             = ['http://192.168.122.98/image'] {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] glance_api_ssl_compression     = False {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] glance_ca_certificates_file    = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] glance_catalog_info            = image:glance:publicURL {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] glance_certfile                = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] glance_keyfile                 = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] glance_num_retries             = 3 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] glance_request_timeout         = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] goodness_function              = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] graceful_shutdown_timeout      = 5 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] group_api_class                = cinder.group.api.API {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] host                           = devstack {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] image_compress_on_upload       = True {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] image_conversion_address_space_limit = 1 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] image_conversion_cpu_limit     = 60 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] image_conversion_disable       = False {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] image_upload_use_cinder_backend = False {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] image_upload_use_internal_tenant = False {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] image_volume_cache_enabled     = False {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] image_volume_cache_max_count   = 0 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] image_volume_cache_max_size_gb = 0 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] init_host_max_objects_retrieval = 0 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] instance_format                = [instance: %(uuid)s]  {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] iscsi_target_flags             =  {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] iscsi_write_cache              = on {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] iser_helper                    = tgtadm {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] iser_ip_address                = 192.168.122.98 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] iser_port                      = 3260 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] log_color                      = False {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] log_config_append              = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] log_dir                        = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] log_file                       = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] log_options                    = True {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] log_rotate_interval            = 1 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] log_rotate_interval_type       = days {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77821]: INFO cinder.volume.manager [None req-d255163a-5e95-4f69-9669-ae12a472dca7 None None] Starting volume driver LVMVolumeDriver (3.0.0)
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] log_rotation_type              = none {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77821]: DEBUG oslo_concurrency.processutils [None req-d255163a-5e95-4f69-9669-ae12a472dca7 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] max_age                        = 0 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] max_logfile_count              = 30 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] max_logfile_size_mb            = 200 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] max_over_subscription_ratio    = 20.0 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] message_reap_interval          = 86400 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] message_ttl                    = 2592000 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] migration_create_volume_timeout_secs = 300 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] monkey_patch                   = False {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] monkey_patch_modules           = [] {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] my_ip                          = 192.168.122.98 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] no_snapshot_gb_quota           = False {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] num_iser_scan_tries            = 3 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] num_shell_tries                = 3 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] num_volume_device_scan_tries   = 3 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] nvmeof_conn_info_version       = 1 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] nvmet_ns_id                    = 10 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] nvmet_port_id                  = 1 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] osapi_max_limit                = 1000 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] osapi_volume_ext_list          = [] {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] osapi_volume_listen            = 0.0.0.0 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] osapi_volume_listen_port       = 8776 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] osapi_volume_use_ssl           = False {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] osapi_volume_workers           = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] per_volume_size_limit          = -1 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] periodic_fuzzy_delay           = 60 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] periodic_interval              = 60 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] project_id_regex               = [0-9a-f\-]+ {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] public_endpoint                = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] publish_errors                 = False {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] quota_backup_gigabytes         = 1000 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] quota_backups                  = 10 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] quota_gigabytes                = 1000 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] quota_groups                   = 10 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] quota_snapshots                = 10 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] quota_volumes                  = 10 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] rate_limit_burst               = 0 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] rate_limit_except_level        = CRITICAL {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] rate_limit_interval            = 0 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] reinit_driver_count            = 3 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] replication_device             = **** {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] report_discard_supported       = False {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] report_interval                = 120 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] reservation_clean_interval     = 86400 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] reservation_expire             = 86400 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] reserved_image_namespaces      = [] {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] reserved_percentage            = 0 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] rpc_response_timeout           = 120 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] run_external_periodic_tasks    = True {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] scst_target_driver             = iscsi {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] scst_target_iqn_name           = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] service_down_time              = 720 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] shell_completion               = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] snapshot_name_template         = snapshot-%s {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] snapshot_same_host             = True {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] split_loggers                  = False {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] state_path                     = /opt/stack/data/cinder {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] storage_availability_zone      = nova {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] storage_protocol               = iSCSI {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] syslog_log_facility            = LOG_USER {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] target_helper                  = lioadm {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] target_ip_address              = 192.168.122.98 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] target_port                    = 3260 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] target_protocol                = iscsi {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] target_secondary_ip_addresses  = [] {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] trace_flags                    = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] transfer_api_class             = cinder.transfer.api.API {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] transport_url                  = **** {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] until_refresh                  = 0 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] use_chap_auth                  = False {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] use_default_quota_class        = True {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] use_journal                    = False {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] use_json                       = False {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] use_multipath_for_image_xfer   = False {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] use_stderr                     = False {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] use_syslog                     = False {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] verify_glance_signatures       = enabled {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] volume_api_class               = cinder.volume.api.API {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] volume_backend_name            = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] volume_clear                   = zero {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] volume_clear_ionice            = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] volume_clear_size              = 0 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] volume_copy_bps_limit          = 0 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] volume_dd_blocksize            = 1M {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] volume_name_template           = volume-%s {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] volume_service_inithost_offload = False {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] volume_usage_audit_period      = month {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] zoning_mode                    = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] oslo_concurrency.disable_process_locking = False {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] os_brick.lightos_discovery_client_address = localhost {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] os_brick.wait_mpath_device_interval = 1 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] keystone_authtoken.auth_section = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] keystone_authtoken.auth_type   = password {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] keystone_authtoken.auth_version = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] keystone_authtoken.cache       = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] keystone_authtoken.certfile    = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] keystone_authtoken.delay_auth_decision = False {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77821]: DEBUG oslo_concurrency.processutils [None req-d255163a-5e95-4f69-9669-ae12a472dca7 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.042s {{(pid=77821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] keystone_authtoken.http_connect_timeout = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] keystone_authtoken.include_service_catalog = True {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] keystone_authtoken.insecure    = False {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] keystone_authtoken.interface   = public {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77821]: DEBUG oslo_concurrency.processutils [None req-d255163a-5e95-4f69-9669-ae12a472dca7 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] keystone_authtoken.keyfile     = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] keystone_authtoken.memcache_password =  {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] keystone_authtoken.memcache_secret_key = **** {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] keystone_authtoken.memcache_security_strategy = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] keystone_authtoken.memcache_username =  {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] keystone_authtoken.region_name = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] keystone_authtoken.service_token_roles_required = True {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] keystone_authtoken.service_type = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] keystone_authtoken.token_cache_time = 300 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.98/identity {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] cache.backend                  = dogpile.cache.null {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] cache.backend_argument         = **** {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] cache.backend_expiration_time  = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] cache.config_prefix            = cache.oslo {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] cache.debug_cache_backend      = False {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] cache.enable_retry_client      = False {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] cache.enable_socket_keepalive  = False {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] cache.enabled                  = False {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] cache.expiration_time          = 600 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] cache.hashclient_retry_attempts = 2 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] cache.hashclient_retry_timeout = 1.0 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] cache.memcache_dead_retry      = 300 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack sudo[77828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] cache.memcache_pool_maxsize    = 10 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] cache.memcache_pool_unused_timeout = 60 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] cache.memcache_sasl_enabled    = False {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] cache.password                 = **** {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] cache.proxies                  = [] {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack sudo[77828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] cache.redis_db                 = 0 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] cache.redis_sentinel_service_name = mymaster {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] cache.redis_server             = localhost:6379 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] cache.retry_attempts           = 2 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] cache.retry_delay              = 0.0 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] cache.socket_keepalive_count   = 1 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] cache.socket_keepalive_idle    = 1 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] cache.socket_keepalive_interval = 1 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] cache.socket_timeout           = 1.0 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] cache.tls_allowed_ciphers      = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] cache.tls_cafile               = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] cache.tls_certfile             = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77821]: DEBUG oslo_concurrency.processutils [None req-d255163a-5e95-4f69-9669-ae12a472dca7 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=77821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] cache.tls_enabled              = False {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] cache.tls_keyfile              = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77821]: DEBUG oslo_concurrency.processutils [None req-d255163a-5e95-4f69-9669-ae12a472dca7 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] cache.username                 = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] coordination.backend_url       = **** {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] database.asyncio_connection    = **** {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] database.asyncio_slave_connection = **** {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] database.backend               = sqlalchemy {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] database.connection            = **** {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] database.connection_debug      = 0 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] database.connection_parameters =  {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] database.connection_recycle_time = 3600 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] database.connection_trace      = False {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] database.db_inc_retry_interval = True {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] database.db_max_retries        = 20 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] database.db_max_retry_interval = 10 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] database.db_retry_interval     = 1 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] database.max_overflow          = 50 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] database.max_pool_size         = 5 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] database.max_retries           = 10 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] database.mysql_wsrep_sync_wait = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] database.pool_timeout          = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] database.retry_interval        = 10 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] database.slave_connection      = **** {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] database.sqlite_synchronous    = True {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] database.synchronous_reader    = True {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] database.use_db_reconnect      = False {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] profiler.connection_string     = messaging:// {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] profiler.enabled               = False {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] profiler.es_doc_type           = notification {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] profiler.es_scroll_size        = 10000 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] profiler.es_scroll_time        = 2m {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] profiler.filter_error_trace    = False {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] profiler.hmac_keys             = **** {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] profiler.sentinel_service_name = mymaster {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] profiler.socket_timeout        = 0.1 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] profiler.trace_requests        = False {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] profiler.trace_sqlalchemy      = False {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] profiler_jaeger.process_tags   = {} {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] profiler_jaeger.service_name_prefix = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] profiler_otlp.service_name_prefix = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] oslo_policy.enforce_new_defaults = True {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] oslo_policy.policy_default_rule = default {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] oslo_policy.policy_file        = policy.yaml {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] oslo_policy.remote_timeout     = 60.0 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] privsep_osbrick.group          = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] privsep_osbrick.helper_command = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] privsep_osbrick.log_daemon_traceback = False {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] privsep_osbrick.thread_pool_size = 4 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] privsep_osbrick.user           = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] cinder_sys_admin.group         = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] cinder_sys_admin.helper_command = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77821]: DEBUG oslo_concurrency.processutils [None req-d255163a-5e95-4f69-9669-ae12a472dca7 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=77821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77821]: DEBUG oslo_concurrency.processutils [None req-d255163a-5e95-4f69-9669-ae12a472dca7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=77821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] cinder_sys_admin.user          = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] service_user.auth_section      = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] service_user.auth_type         = password {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] service_user.cafile            = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] service_user.certfile          = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] service_user.collect_timing    = False {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] service_user.insecure          = False {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] service_user.keyfile           = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] service_user.send_service_user_token = True {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] service_user.split_loggers     = False {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] service_user.timeout           = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] glance.auth_section            = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] glance.auth_type               = password {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] glance.certfile                = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] glance.collect_timing          = False {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] glance.insecure                = False {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] glance.keyfile                 = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] glance.region_name             = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] glance.split_loggers           = False {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] glance.timeout                 = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] backend_defaults.backend_availability_zone = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] backend_defaults.chap_password = **** {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] backend_defaults.chap_username =  {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] backend_defaults.disk_geometry = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] backend_defaults.driver_client_cert = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] backend_defaults.driver_client_cert_key = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] backend_defaults.driver_data_namespace = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] backend_defaults.driver_ssl_cert_path = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] backend_defaults.driver_use_ssl = False {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] backend_defaults.enable_unsupported_driver = False {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] backend_defaults.extra_capabilities = {} {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] backend_defaults.filter_function = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] backend_defaults.goodness_function = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] backend_defaults.image_volume_cache_enabled = False {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] backend_defaults.iscsi_target_flags =  {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] backend_defaults.iscsi_write_cache = on {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] backend_defaults.iser_helper   = tgtadm {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] backend_defaults.iser_ip_address = 192.168.122.98 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] backend_defaults.iser_port     = 3260 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] backend_defaults.lvm_mirrors   = 0 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] backend_defaults.lvm_share_target = False {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] backend_defaults.lvm_type      = auto {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] backend_defaults.num_shell_tries = 3 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] backend_defaults.nvmet_port_id = 1 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] backend_defaults.replication_device = **** {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] backend_defaults.report_discard_supported = False {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] backend_defaults.reserved_percentage = 0 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] backend_defaults.scst_target_driver = iscsi {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] backend_defaults.scst_target_iqn_name = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] backend_defaults.storage_protocol = iSCSI {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] backend_defaults.target_helper = tgtadm {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] backend_defaults.target_ip_address = 192.168.122.98 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] backend_defaults.target_port   = 3260 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] backend_defaults.target_protocol = iscsi {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] backend_defaults.trace_flags   = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] backend_defaults.unique_fqdn_network = True {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] backend_defaults.use_chap_auth = False {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] backend_defaults.volume_backend_name = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] backend_defaults.volume_clear  = zero {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] backend_defaults.volume_clear_ionice = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] backend_defaults.volume_clear_size = 0 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] backend_defaults.volume_group  = cinder-volumes {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] oslo_reports.file_event_handler = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] oslo_reports.file_event_handler_interval = 1 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] oslo_reports.log_dir           = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] lvmdriver-1.backend_availability_zone = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] lvmdriver-1.backend_host       = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] lvmdriver-1.chap_password      = **** {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] lvmdriver-1.chap_username      = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] lvmdriver-1.chiscsi_conf       = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] lvmdriver-1.disk_geometry      = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] lvmdriver-1.driver_client_cert = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] lvmdriver-1.driver_client_cert_key = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] lvmdriver-1.driver_data_namespace = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] lvmdriver-1.driver_use_ssl     = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] lvmdriver-1.extra_capabilities = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] lvmdriver-1.filter_function    = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] lvmdriver-1.goodness_function  = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] lvmdriver-1.iscsi_target_flags = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] lvmdriver-1.iser_helper        = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] lvmdriver-1.iser_ip_address    = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] lvmdriver-1.iser_port          = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] lvmdriver-1.iser_target_prefix = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] lvmdriver-1.lvm_conf_file      = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] lvmdriver-1.lvm_mirrors        = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] lvmdriver-1.lvm_share_target   = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] lvmdriver-1.lvm_type           = auto {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] lvmdriver-1.num_shell_tries    = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] lvmdriver-1.nvmet_port_id      = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] lvmdriver-1.replication_device = **** {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] lvmdriver-1.report_discard_supported = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] lvmdriver-1.reserved_percentage = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] lvmdriver-1.scst_target_driver = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] lvmdriver-1.storage_protocol   = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] lvmdriver-1.target_helper      = lioadm {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] lvmdriver-1.target_ip_address  = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:54 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] lvmdriver-1.target_port        = 3260 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:55 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:55 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] lvmdriver-1.target_protocol    = iscsi {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:55 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:55 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] lvmdriver-1.trace_flags        = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:55 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] lvmdriver-1.unique_fqdn_network = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:55 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] lvmdriver-1.use_chap_auth      = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:55 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:55 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:55 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] lvmdriver-1.volume_clear       = zero {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:55 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] lvmdriver-1.volume_clear_ionice = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:55 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] lvmdriver-1.volume_clear_size  = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:55 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:55 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:55 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:55 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:55 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:55 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] lvmdriver-1.volumes_dir        = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:55 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:55 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:55 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:55 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:55 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:55 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:55 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:55 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:55 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] oslo_messaging_rabbit.hostname = devstack {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:55 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:55 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:55 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:55 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:55 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:55 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:55 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:55 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:55 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:55 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:55 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:55 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:55 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:55 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:55 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:55 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:55 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:55 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:55 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:55 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:55 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] oslo_messaging_rabbit.ssl      = False {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:55 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:55 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:55 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:55 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:55 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:55 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] oslo_messaging_rabbit.ssl_version =  {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:55 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:55 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] oslo_messaging_notifications.driver = [] {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:55 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] oslo_messaging_notifications.retry = -1 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:55 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:55 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] oslo_messaging_notifications.transport_url = **** {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:55 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:55 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] key_manager.fixed_key          = **** {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:55 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:55 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] barbican.barbican_api_version  = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:55 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] barbican.barbican_endpoint     = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:55 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] barbican.barbican_endpoint_type = public {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:55 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] barbican.barbican_region_name  = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:55 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] barbican.cafile                = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:55 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] barbican.certfile              = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:55 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] barbican.collect_timing        = False {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:55 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] barbican.insecure              = False {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:55 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] barbican.keyfile               = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:55 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] barbican.number_of_retries     = 60 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:55 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] barbican.retry_delay           = 1 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:55 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] barbican.send_service_user_token = False {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:55 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] barbican.split_loggers         = False {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:55 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] barbican.timeout               = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:55 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] barbican.verify_ssl            = True {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:55 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] barbican.verify_ssl_path       = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:55 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] barbican_service_user.auth_section = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:55 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] barbican_service_user.auth_type = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:55 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] barbican_service_user.cafile   = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:55 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] barbican_service_user.certfile = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:55 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] barbican_service_user.collect_timing = False {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:55 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] barbican_service_user.insecure = False {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:55 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] barbican_service_user.keyfile  = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:55 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] barbican_service_user.split_loggers = False {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:55 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] barbican_service_user.timeout  = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:55 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] vault.approle_role_id          = **** {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:55 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] vault.approle_secret_id        = **** {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:55 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] vault.auth_method              = approle {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:55 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] vault.auth_path                = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:55 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] vault.kv_mountpoint            = secret {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:55 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] vault.kv_path                  = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:55 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] vault.kv_version               = 2 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:55 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] vault.namespace                = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:55 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] vault.root_token_id            = **** {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:55 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] vault.ssl_ca_crt_file          = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:55 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] vault.timeout                  = 60.0 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:55 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] vault.token_file               = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:55 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] vault.token_role               = None {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:55 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] vault.use_ssl                  = False {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:55 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:16:55 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] ******************************************************************************** {{(pid=77666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}}
Jul 30 20:16:55 devstack sudo[77828]: pam_unix(sudo:session): session closed for user root
Jul 30 20:16:55 devstack cinder-volume[77821]: DEBUG oslo_concurrency.processutils [None req-d255163a-5e95-4f69-9669-ae12a472dca7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.364s {{(pid=77821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:16:55 devstack cinder-volume[77821]: DEBUG oslo_concurrency.processutils [None req-d255163a-5e95-4f69-9669-ae12a472dca7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:16:55 devstack sudo[77835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 30 20:16:55 devstack sudo[77835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:16:55 devstack sudo[77835]: pam_unix(sudo:session): session closed for user root
Jul 30 20:16:55 devstack cinder-volume[77821]: DEBUG oslo_concurrency.processutils [None req-d255163a-5e95-4f69-9669-ae12a472dca7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.243s {{(pid=77821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:16:55 devstack cinder-volume[77821]: DEBUG oslo_concurrency.processutils [None req-d255163a-5e95-4f69-9669-ae12a472dca7 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=77821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 30 20:16:55 devstack cinder-volume[77821]: INFO cinder.brick.local_dev.lvm [None req-d255163a-5e95-4f69-9669-ae12a472dca7 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Jul 30 20:16:55 devstack cinder-volume[77821]: DEBUG oslo_concurrency.processutils [None req-d255163a-5e95-4f69-9669-ae12a472dca7 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:16:55 devstack cinder-volume[77821]: DEBUG oslo_concurrency.processutils [None req-d255163a-5e95-4f69-9669-ae12a472dca7 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=77821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:16:55 devstack cinder-volume[77821]: DEBUG oslo_concurrency.processutils [None req-d255163a-5e95-4f69-9669-ae12a472dca7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:16:55 devstack sudo[77895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 30 20:16:55 devstack sudo[77895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:16:55 devstack sudo[77895]: pam_unix(sudo:session): session closed for user root
Jul 30 20:16:55 devstack cinder-volume[77821]: DEBUG oslo_concurrency.processutils [None req-d255163a-5e95-4f69-9669-ae12a472dca7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=77821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:16:55 devstack cinder-volume[77821]: DEBUG cinder.brick.local_dev.lvm [None req-d255163a-5e95-4f69-9669-ae12a472dca7 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=77821) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}}
Jul 30 20:16:55 devstack cinder-volume[77821]: DEBUG oslo_concurrency.processutils [None req-d255163a-5e95-4f69-9669-ae12a472dca7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:16:55 devstack sudo[78010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 30 20:16:55 devstack sudo[78010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:16:56 devstack sudo[78010]: pam_unix(sudo:session): session closed for user root
Jul 30 20:16:56 devstack cinder-volume[77821]: DEBUG oslo_concurrency.processutils [None req-d255163a-5e95-4f69-9669-ae12a472dca7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.525s {{(pid=77821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:16:56 devstack cinder-volume[77821]: DEBUG oslo_concurrency.processutils [None req-d255163a-5e95-4f69-9669-ae12a472dca7 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:16:56 devstack cinder-volume[77821]: DEBUG oslo_concurrency.processutils [None req-d255163a-5e95-4f69-9669-ae12a472dca7 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=77821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:16:56 devstack cinder-volume[77821]: DEBUG oslo_concurrency.processutils [None req-d255163a-5e95-4f69-9669-ae12a472dca7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:16:56 devstack sudo[78208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 30 20:16:56 devstack sudo[78208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:16:56 devstack sudo[78208]: pam_unix(sudo:session): session closed for user root
Jul 30 20:16:56 devstack cinder-volume[77821]: DEBUG oslo_concurrency.processutils [None req-d255163a-5e95-4f69-9669-ae12a472dca7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.262s {{(pid=77821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:16:56 devstack cinder-volume[77821]: DEBUG oslo_concurrency.processutils [None req-d255163a-5e95-4f69-9669-ae12a472dca7 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:16:56 devstack cinder-volume[77821]: DEBUG oslo_concurrency.processutils [None req-d255163a-5e95-4f69-9669-ae12a472dca7 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=77821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:16:56 devstack cinder-volume[77821]: DEBUG oslo_concurrency.processutils [None req-d255163a-5e95-4f69-9669-ae12a472dca7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=77821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:16:56 devstack sudo[78294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Jul 30 20:16:56 devstack sudo[78294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:16:56 devstack sudo[78294]: pam_unix(sudo:session): session closed for user root
Jul 30 20:16:56 devstack cinder-volume[77821]: DEBUG oslo_concurrency.processutils [None req-d255163a-5e95-4f69-9669-ae12a472dca7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.290s {{(pid=77821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:16:56 devstack cinder-volume[77821]: DEBUG oslo_concurrency.processutils [None req-d255163a-5e95-4f69-9669-ae12a472dca7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:16:56 devstack sudo[78411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 30 20:16:56 devstack sudo[78411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:16:57 devstack sudo[78411]: pam_unix(sudo:session): session closed for user root
Jul 30 20:16:57 devstack cinder-volume[77821]: DEBUG oslo_concurrency.processutils [None req-d255163a-5e95-4f69-9669-ae12a472dca7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.303s {{(pid=77821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:16:57 devstack cinder-volume[77821]: DEBUG oslo_concurrency.processutils [None req-d255163a-5e95-4f69-9669-ae12a472dca7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:16:57 devstack sudo[78441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 30 20:16:57 devstack sudo[78441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:16:57 devstack sudo[78441]: pam_unix(sudo:session): session closed for user root
Jul 30 20:16:57 devstack cinder-volume[77821]: DEBUG oslo_concurrency.processutils [None req-d255163a-5e95-4f69-9669-ae12a472dca7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.284s {{(pid=77821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:16:57 devstack cinder-volume[77821]: DEBUG oslo_concurrency.processutils [None req-d255163a-5e95-4f69-9669-ae12a472dca7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:16:57 devstack sudo[78490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 30 20:16:57 devstack sudo[78490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:16:57 devstack sudo[78490]: pam_unix(sudo:session): session closed for user root
Jul 30 20:16:57 devstack cinder-volume[77821]: DEBUG oslo_concurrency.processutils [None req-d255163a-5e95-4f69-9669-ae12a472dca7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.305s {{(pid=77821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:16:57 devstack cinder-volume[77821]: DEBUG oslo_concurrency.processutils [None req-d255163a-5e95-4f69-9669-ae12a472dca7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:16:57 devstack sudo[78529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 30 20:16:57 devstack sudo[78529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:16:58 devstack sudo[78529]: pam_unix(sudo:session): session closed for user root
Jul 30 20:16:58 devstack cinder-volume[77821]: DEBUG oslo_concurrency.processutils [None req-d255163a-5e95-4f69-9669-ae12a472dca7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.276s {{(pid=77821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:16:58 devstack cinder-volume[77821]: DEBUG oslo_concurrency.processutils [None req-d255163a-5e95-4f69-9669-ae12a472dca7 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:16:58 devstack cinder-volume[77821]: DEBUG oslo_concurrency.processutils [None req-d255163a-5e95-4f69-9669-ae12a472dca7 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=77821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:16:58 devstack cinder-volume[77821]: DEBUG oslo_concurrency.processutils [None req-d255163a-5e95-4f69-9669-ae12a472dca7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:16:58 devstack sudo[78539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 30 20:16:58 devstack sudo[78539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:16:58 devstack sudo[78539]: pam_unix(sudo:session): session closed for user root
Jul 30 20:16:58 devstack cinder-volume[77821]: DEBUG oslo_concurrency.processutils [None req-d255163a-5e95-4f69-9669-ae12a472dca7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.324s {{(pid=77821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:16:58 devstack cinder-volume[77821]: INFO cinder.volume.drivers.lvm [None req-d255163a-5e95-4f69-9669-ae12a472dca7 None None] Enabling LVM thin provisioning by default because a thin pool exists.
Jul 30 20:16:58 devstack cinder-volume[77821]: DEBUG oslo_concurrency.processutils [None req-d255163a-5e95-4f69-9669-ae12a472dca7 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:16:58 devstack cinder-volume[77821]: DEBUG oslo_concurrency.processutils [None req-d255163a-5e95-4f69-9669-ae12a472dca7 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=77821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:16:58 devstack cinder-volume[77821]: DEBUG oslo_concurrency.processutils [None req-d255163a-5e95-4f69-9669-ae12a472dca7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:16:58 devstack sudo[78629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 30 20:16:58 devstack sudo[78629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:16:58 devstack sudo[78629]: pam_unix(sudo:session): session closed for user root
Jul 30 20:16:58 devstack cinder-volume[77821]: DEBUG oslo_concurrency.processutils [None req-d255163a-5e95-4f69-9669-ae12a472dca7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.259s {{(pid=77821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:16:58 devstack cinder-volume[77821]: DEBUG cinder.volume.drivers.lvm [None req-d255163a-5e95-4f69-9669-ae12a472dca7 None None] Updating volume stats {{(pid=77821) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Jul 30 20:16:58 devstack cinder-volume[77821]: DEBUG oslo_concurrency.processutils [None req-d255163a-5e95-4f69-9669-ae12a472dca7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:16:58 devstack sudo[78632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 30 20:16:58 devstack sudo[78632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:16:58 devstack sudo[78632]: pam_unix(sudo:session): session closed for user root
Jul 30 20:16:58 devstack cinder-volume[77821]: DEBUG oslo_concurrency.processutils [None req-d255163a-5e95-4f69-9669-ae12a472dca7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.243s {{(pid=77821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:16:58 devstack cinder-volume[77821]: DEBUG oslo_concurrency.processutils [None req-d255163a-5e95-4f69-9669-ae12a472dca7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:16:58 devstack sudo[78635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 30 20:16:58 devstack sudo[78635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:16:59 devstack sudo[78635]: pam_unix(sudo:session): session closed for user root
Jul 30 20:16:59 devstack cinder-volume[77821]: DEBUG oslo_concurrency.processutils [None req-d255163a-5e95-4f69-9669-ae12a472dca7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.244s {{(pid=77821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:16:59 devstack cinder-volume[77821]: DEBUG oslo_concurrency.processutils [None req-d255163a-5e95-4f69-9669-ae12a472dca7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:16:59 devstack sudo[78638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 30 20:16:59 devstack sudo[78638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:16:59 devstack sudo[78638]: pam_unix(sudo:session): session closed for user root
Jul 30 20:16:59 devstack cinder-volume[77821]: DEBUG oslo_concurrency.processutils [None req-d255163a-5e95-4f69-9669-ae12a472dca7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.245s {{(pid=77821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:16:59 devstack cinder-volume[77821]: DEBUG oslo_concurrency.processutils [None req-d255163a-5e95-4f69-9669-ae12a472dca7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:16:59 devstack sudo[78641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 30 20:16:59 devstack sudo[78641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:16:59 devstack sudo[78641]: pam_unix(sudo:session): session closed for user root
Jul 30 20:16:59 devstack cinder-volume[77821]: DEBUG oslo_concurrency.processutils [None req-d255163a-5e95-4f69-9669-ae12a472dca7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=77821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:16:59 devstack cinder-volume[77821]: INFO cinder.volume.driver [None req-d255163a-5e95-4f69-9669-ae12a472dca7 None None] Driver hasn't implemented _init_vendor_properties()
Jul 30 20:16:59 devstack cinder-volume[77821]: DEBUG cinder.volume.driver [None req-d255163a-5e95-4f69-9669-ae12a472dca7 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=77821) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Jul 30 20:16:59 devstack cinder-volume[77821]: DEBUG oslo_db.sqlalchemy.engines [None req-d255163a-5e95-4f69-9669-ae12a472dca7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77821) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 30 20:16:59 devstack cinder-volume[77821]: DEBUG dbcounter [-] [77821] Writer thread running {{(pid=77821) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 30 20:16:59 devstack cinder-volume[77821]: DEBUG cinder.db.api [None req-d255163a-5e95-4f69-9669-ae12a472dca7 None None] Building query based on filter {{(pid=77821) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Jul 30 20:16:59 devstack cinder-volume[77821]: DEBUG cinder.image.image_utils [None req-d255163a-5e95-4f69-9669-ae12a472dca7 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=77821) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Jul 30 20:16:59 devstack cinder-volume[77821]: INFO cinder.keymgr.migration [None req-8b663c5f-a673-4041-a098-400eb3cdaa00 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Jul 30 20:16:59 devstack cinder-volume[77821]: DEBUG cinder.volume.drivers.lvm [None req-d255163a-5e95-4f69-9669-ae12a472dca7 None None] Updating volume stats {{(pid=77821) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Jul 30 20:16:59 devstack cinder-volume[77821]: DEBUG oslo_concurrency.processutils [None req-d255163a-5e95-4f69-9669-ae12a472dca7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:16:59 devstack sudo[78644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 30 20:16:59 devstack sudo[78644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:17:00 devstack sudo[78644]: pam_unix(sudo:session): session closed for user root
Jul 30 20:17:00 devstack cinder-volume[77821]: DEBUG oslo_concurrency.processutils [None req-d255163a-5e95-4f69-9669-ae12a472dca7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=77821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:17:00 devstack cinder-volume[77821]: DEBUG oslo_concurrency.processutils [None req-d255163a-5e95-4f69-9669-ae12a472dca7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:17:00 devstack sudo[78648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 30 20:17:00 devstack sudo[78648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:17:00 devstack sudo[78648]: pam_unix(sudo:session): session closed for user root
Jul 30 20:17:00 devstack cinder-volume[77821]: DEBUG oslo_concurrency.processutils [None req-d255163a-5e95-4f69-9669-ae12a472dca7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=77821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:17:00 devstack cinder-volume[77821]: DEBUG oslo_concurrency.processutils [None req-d255163a-5e95-4f69-9669-ae12a472dca7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:17:00 devstack sudo[78651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 30 20:17:00 devstack sudo[78651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:17:00 devstack sudo[78651]: pam_unix(sudo:session): session closed for user root
Jul 30 20:17:00 devstack cinder-volume[77821]: DEBUG oslo_concurrency.processutils [None req-d255163a-5e95-4f69-9669-ae12a472dca7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.262s {{(pid=77821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:17:00 devstack cinder-volume[77821]: DEBUG oslo_concurrency.processutils [None req-d255163a-5e95-4f69-9669-ae12a472dca7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:17:00 devstack sudo[78656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 30 20:17:00 devstack sudo[78656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:17:00 devstack sudo[78656]: pam_unix(sudo:session): session closed for user root
Jul 30 20:17:00 devstack cinder-volume[77821]: DEBUG oslo_concurrency.processutils [None req-d255163a-5e95-4f69-9669-ae12a472dca7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=77821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:17:00 devstack cinder-volume[77821]: DEBUG cinder.manager [None req-d255163a-5e95-4f69-9669-ae12a472dca7 None None] Notifying Schedulers of capabilities ... {{(pid=77821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:17:00 devstack cinder-volume[77821]: INFO cinder.volume.manager [None req-d255163a-5e95-4f69-9669-ae12a472dca7 None None] Driver initialization completed successfully.
Jul 30 20:17:00 devstack cinder-volume[77821]: INFO cinder.manager [None req-d255163a-5e95-4f69-9669-ae12a472dca7 None None] Initiating service 2 cleanup
Jul 30 20:17:00 devstack cinder-volume[77821]: INFO cinder.manager [None req-d255163a-5e95-4f69-9669-ae12a472dca7 None None] Service 2 cleanup completed.
Jul 30 20:17:00 devstack cinder-volume[77821]: DEBUG cinder.service [None req-d255163a-5e95-4f69-9669-ae12a472dca7 None None] Creating RPC server for service cinder-volume {{(pid=77821) start /opt/stack/cinder/cinder/service.py:231}}
Jul 30 20:17:00 devstack cinder-volume[77821]: DEBUG cinder.service [None req-d255163a-5e95-4f69-9669-ae12a472dca7 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=77821) start /opt/stack/cinder/cinder/service.py:237}}
Jul 30 20:17:01 devstack cinder-volume[77821]: INFO cinder.volume.manager [None req-d255163a-5e95-4f69-9669-ae12a472dca7 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Jul 30 20:17:01 devstack cinder-volume[77821]: DEBUG cinder.volume.drivers.lvm [None req-d255163a-5e95-4f69-9669-ae12a472dca7 None None] Updating volume stats {{(pid=77821) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Jul 30 20:17:01 devstack cinder-volume[77821]: DEBUG oslo_concurrency.processutils [None req-d255163a-5e95-4f69-9669-ae12a472dca7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:17:01 devstack sudo[78659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 30 20:17:01 devstack sudo[78659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:17:01 devstack sudo[78659]: pam_unix(sudo:session): session closed for user root
Jul 30 20:17:01 devstack cinder-volume[77821]: DEBUG oslo_concurrency.processutils [None req-d255163a-5e95-4f69-9669-ae12a472dca7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.293s {{(pid=77821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:17:01 devstack cinder-volume[77821]: DEBUG oslo_concurrency.processutils [None req-d255163a-5e95-4f69-9669-ae12a472dca7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:17:01 devstack sudo[78664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 30 20:17:01 devstack sudo[78664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:17:01 devstack sudo[78664]: pam_unix(sudo:session): session closed for user root
Jul 30 20:17:01 devstack cinder-volume[77821]: DEBUG oslo_concurrency.processutils [None req-d255163a-5e95-4f69-9669-ae12a472dca7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=77821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:17:01 devstack cinder-volume[77821]: DEBUG oslo_concurrency.processutils [None req-d255163a-5e95-4f69-9669-ae12a472dca7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:17:01 devstack sudo[78670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 30 20:17:01 devstack sudo[78670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:17:01 devstack sudo[78670]: pam_unix(sudo:session): session closed for user root
Jul 30 20:17:01 devstack cinder-volume[77821]: DEBUG oslo_concurrency.processutils [None req-d255163a-5e95-4f69-9669-ae12a472dca7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.244s {{(pid=77821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:17:01 devstack cinder-volume[77821]: DEBUG oslo_concurrency.processutils [None req-d255163a-5e95-4f69-9669-ae12a472dca7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:17:01 devstack sudo[78676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 30 20:17:01 devstack sudo[78676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:17:02 devstack sudo[78676]: pam_unix(sudo:session): session closed for user root
Jul 30 20:17:02 devstack cinder-volume[77821]: DEBUG oslo_concurrency.processutils [None req-d255163a-5e95-4f69-9669-ae12a472dca7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.243s {{(pid=77821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:17:02 devstack cinder-volume[77821]: INFO cinder.volume.manager [None req-d255163a-5e95-4f69-9669-ae12a472dca7 None None] Driver post RPC initialization completed successfully.
Jul 30 20:17:04 devstack cinder-volume[77666]: DEBUG dbcounter [-] [77666] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=77666) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 30 20:17:12 devstack cinder-volume[77821]: DEBUG dbcounter [-] [77821] Writing DB stats cinder:SELECT=3 {{(pid=77821) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 30 20:17:12 devstack cinder-volume[77821]: DEBUG dbcounter [-] [77821] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=77821) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 30 20:17:48 devstack cinder-volume[77821]: DEBUG oslo_service.periodic_task [None req-e6c5fceb-f1c2-448d-a014-a35ddcf5f6a0 None None] Running periodic task VolumeManager._thread_info {{(pid=77821) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 30 20:17:48 devstack cinder-volume[77821]: DEBUG cinder.volume.manager [None req-e6c5fceb-f1c2-448d-a014-a35ddcf5f6a0 None None] thread count: 6 {{(pid=77821) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 30 20:17:48 devstack cinder-volume[77821]: DEBUG cinder.volume.manager [None req-e6c5fceb-f1c2-448d-a014-a35ddcf5f6a0 None None] thread info: [<_MainThread(MainThread, started 130579814473856)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130579704687360)>, <Thread(Thread-3 (stat_writer), started daemon 130579701757504)>, <Thread(Rabbit-heartbeat, started daemon 130579700532032)>, <Thread(Thread-5 (_runner), started daemon 130579700623488)>, <Thread(Thread-7 (_runner), started daemon 130579700706816)>] {{(pid=77821) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 30 20:18:48 devstack cinder-volume[77821]: DEBUG oslo_service.periodic_task [None req-e6c5fceb-f1c2-448d-a014-a35ddcf5f6a0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77821) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 30 20:18:48 devstack cinder-volume[77821]: DEBUG cinder.volume.drivers.lvm [None req-e6c5fceb-f1c2-448d-a014-a35ddcf5f6a0 None None] Updating volume stats {{(pid=77821) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Jul 30 20:18:48 devstack cinder-volume[77821]: DEBUG oslo_concurrency.processutils [None req-e6c5fceb-f1c2-448d-a014-a35ddcf5f6a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:18:48 devstack sudo[83903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 30 20:18:48 devstack sudo[83903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:18:48 devstack sudo[83903]: pam_unix(sudo:session): session closed for user root
Jul 30 20:18:48 devstack cinder-volume[77821]: DEBUG oslo_concurrency.processutils [None req-e6c5fceb-f1c2-448d-a014-a35ddcf5f6a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=77821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:18:48 devstack cinder-volume[77821]: DEBUG oslo_concurrency.processutils [None req-e6c5fceb-f1c2-448d-a014-a35ddcf5f6a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:18:48 devstack sudo[83906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 30 20:18:48 devstack sudo[83906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:18:48 devstack sudo[83906]: pam_unix(sudo:session): session closed for user root
Jul 30 20:18:48 devstack cinder-volume[77821]: DEBUG oslo_concurrency.processutils [None req-e6c5fceb-f1c2-448d-a014-a35ddcf5f6a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=77821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:18:48 devstack cinder-volume[77821]: DEBUG oslo_concurrency.processutils [None req-e6c5fceb-f1c2-448d-a014-a35ddcf5f6a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:18:48 devstack sudo[83909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 30 20:18:48 devstack sudo[83909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:18:48 devstack sudo[83909]: pam_unix(sudo:session): session closed for user root
Jul 30 20:18:48 devstack cinder-volume[77821]: DEBUG oslo_concurrency.processutils [None req-e6c5fceb-f1c2-448d-a014-a35ddcf5f6a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.260s {{(pid=77821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:18:48 devstack cinder-volume[77821]: DEBUG oslo_concurrency.processutils [None req-e6c5fceb-f1c2-448d-a014-a35ddcf5f6a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:18:48 devstack sudo[83912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 30 20:18:48 devstack sudo[83912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:18:49 devstack sudo[83912]: pam_unix(sudo:session): session closed for user root
Jul 30 20:18:49 devstack cinder-volume[77821]: DEBUG oslo_concurrency.processutils [None req-e6c5fceb-f1c2-448d-a014-a35ddcf5f6a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=77821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:18:49 devstack cinder-volume[77821]: DEBUG cinder.manager [None req-e6c5fceb-f1c2-448d-a014-a35ddcf5f6a0 None None] Notifying Schedulers of capabilities ... {{(pid=77821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:18:49 devstack cinder-volume[77821]: DEBUG oslo_service.periodic_task [None req-e6c5fceb-f1c2-448d-a014-a35ddcf5f6a0 None None] Running periodic task VolumeManager._thread_info {{(pid=77821) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 30 20:18:49 devstack cinder-volume[77821]: DEBUG cinder.volume.manager [None req-e6c5fceb-f1c2-448d-a014-a35ddcf5f6a0 None None] thread count: 6 {{(pid=77821) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 30 20:18:49 devstack cinder-volume[77821]: DEBUG cinder.volume.manager [None req-e6c5fceb-f1c2-448d-a014-a35ddcf5f6a0 None None] thread info: [<_MainThread(MainThread, started 130579814473856)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130579704687360)>, <Thread(Thread-3 (stat_writer), started daemon 130579701757504)>, <Thread(Rabbit-heartbeat, started daemon 130579700532032)>, <Thread(Thread-5 (_runner), started daemon 130579700623488)>, <Thread(Thread-7 (_runner), started daemon 130579700706816)>] {{(pid=77821) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 30 20:19:12 devstack cinder-volume[77821]: DEBUG dbcounter [-] [77821] Writing DB stats cinder:SELECT=1 {{(pid=77821) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 30 20:19:12 devstack cinder-volume[77821]: DEBUG dbcounter [-] [77821] Writing DB stats cinder:UPDATE=1 {{(pid=77821) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 30 20:19:48 devstack cinder-volume[77821]: DEBUG oslo_service.periodic_task [None req-e6c5fceb-f1c2-448d-a014-a35ddcf5f6a0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77821) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 30 20:19:48 devstack cinder-volume[77821]: DEBUG cinder.volume.drivers.lvm [None req-e6c5fceb-f1c2-448d-a014-a35ddcf5f6a0 None None] Updating volume stats {{(pid=77821) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Jul 30 20:19:48 devstack cinder-volume[77821]: DEBUG oslo_concurrency.processutils [None req-e6c5fceb-f1c2-448d-a014-a35ddcf5f6a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:19:48 devstack sudo[85724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 30 20:19:48 devstack sudo[85724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:19:48 devstack sudo[85724]: pam_unix(sudo:session): session closed for user root
Jul 30 20:19:48 devstack cinder-volume[77821]: DEBUG oslo_concurrency.processutils [None req-e6c5fceb-f1c2-448d-a014-a35ddcf5f6a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.287s {{(pid=77821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:19:48 devstack cinder-volume[77821]: DEBUG oslo_concurrency.processutils [None req-e6c5fceb-f1c2-448d-a014-a35ddcf5f6a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:19:48 devstack sudo[85727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 30 20:19:48 devstack sudo[85727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:19:48 devstack sudo[85727]: pam_unix(sudo:session): session closed for user root
Jul 30 20:19:48 devstack cinder-volume[77821]: DEBUG oslo_concurrency.processutils [None req-e6c5fceb-f1c2-448d-a014-a35ddcf5f6a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.274s {{(pid=77821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:19:48 devstack cinder-volume[77821]: DEBUG oslo_concurrency.processutils [None req-e6c5fceb-f1c2-448d-a014-a35ddcf5f6a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:19:48 devstack sudo[85730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 30 20:19:48 devstack sudo[85730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:19:48 devstack sudo[85730]: pam_unix(sudo:session): session closed for user root
Jul 30 20:19:48 devstack cinder-volume[77821]: DEBUG oslo_concurrency.processutils [None req-e6c5fceb-f1c2-448d-a014-a35ddcf5f6a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.269s {{(pid=77821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:19:48 devstack cinder-volume[77821]: DEBUG oslo_concurrency.processutils [None req-e6c5fceb-f1c2-448d-a014-a35ddcf5f6a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:19:48 devstack sudo[85742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 30 20:19:48 devstack sudo[85742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:19:49 devstack sudo[85742]: pam_unix(sudo:session): session closed for user root
Jul 30 20:19:49 devstack cinder-volume[77821]: DEBUG oslo_concurrency.processutils [None req-e6c5fceb-f1c2-448d-a014-a35ddcf5f6a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=77821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:19:49 devstack cinder-volume[77821]: DEBUG cinder.manager [None req-e6c5fceb-f1c2-448d-a014-a35ddcf5f6a0 None None] Notifying Schedulers of capabilities ... {{(pid=77821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:20:48 devstack cinder-volume[77821]: DEBUG oslo_service.periodic_task [None req-e6c5fceb-f1c2-448d-a014-a35ddcf5f6a0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77821) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 30 20:20:48 devstack cinder-volume[77821]: DEBUG cinder.volume.drivers.lvm [None req-e6c5fceb-f1c2-448d-a014-a35ddcf5f6a0 None None] Updating volume stats {{(pid=77821) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Jul 30 20:20:48 devstack cinder-volume[77821]: DEBUG oslo_concurrency.processutils [None req-e6c5fceb-f1c2-448d-a014-a35ddcf5f6a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:20:48 devstack sudo[87013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 30 20:20:48 devstack sudo[87013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:20:48 devstack sudo[87013]: pam_unix(sudo:session): session closed for user root
Jul 30 20:20:48 devstack cinder-volume[77821]: DEBUG oslo_concurrency.processutils [None req-e6c5fceb-f1c2-448d-a014-a35ddcf5f6a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=77821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:20:48 devstack cinder-volume[77821]: DEBUG oslo_concurrency.processutils [None req-e6c5fceb-f1c2-448d-a014-a35ddcf5f6a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:20:48 devstack sudo[87016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 30 20:20:48 devstack sudo[87016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:20:48 devstack sudo[87016]: pam_unix(sudo:session): session closed for user root
Jul 30 20:20:48 devstack cinder-volume[77821]: DEBUG oslo_concurrency.processutils [None req-e6c5fceb-f1c2-448d-a014-a35ddcf5f6a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=77821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:20:48 devstack cinder-volume[77821]: DEBUG oslo_concurrency.processutils [None req-e6c5fceb-f1c2-448d-a014-a35ddcf5f6a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:20:48 devstack sudo[87022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 30 20:20:48 devstack sudo[87022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:20:48 devstack sudo[87022]: pam_unix(sudo:session): session closed for user root
Jul 30 20:20:48 devstack cinder-volume[77821]: DEBUG oslo_concurrency.processutils [None req-e6c5fceb-f1c2-448d-a014-a35ddcf5f6a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.268s {{(pid=77821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:20:48 devstack cinder-volume[77821]: DEBUG oslo_concurrency.processutils [None req-e6c5fceb-f1c2-448d-a014-a35ddcf5f6a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:20:48 devstack sudo[87045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 30 20:20:48 devstack sudo[87045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:20:49 devstack sudo[87045]: pam_unix(sudo:session): session closed for user root
Jul 30 20:20:49 devstack cinder-volume[77821]: DEBUG oslo_concurrency.processutils [None req-e6c5fceb-f1c2-448d-a014-a35ddcf5f6a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=77821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:20:49 devstack cinder-volume[77821]: DEBUG cinder.manager [None req-e6c5fceb-f1c2-448d-a014-a35ddcf5f6a0 None None] Notifying Schedulers of capabilities ... {{(pid=77821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:20:49 devstack cinder-volume[77821]: DEBUG oslo_service.periodic_task [None req-e6c5fceb-f1c2-448d-a014-a35ddcf5f6a0 None None] Running periodic task VolumeManager._thread_info {{(pid=77821) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 30 20:20:49 devstack cinder-volume[77821]: DEBUG cinder.volume.manager [None req-e6c5fceb-f1c2-448d-a014-a35ddcf5f6a0 None None] thread count: 6 {{(pid=77821) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 30 20:20:49 devstack cinder-volume[77821]: DEBUG cinder.volume.manager [None req-e6c5fceb-f1c2-448d-a014-a35ddcf5f6a0 None None] thread info: [<_MainThread(MainThread, started 130579814473856)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130579704687360)>, <Thread(Thread-3 (stat_writer), started daemon 130579701757504)>, <Thread(Rabbit-heartbeat, started daemon 130579700532032)>, <Thread(Thread-5 (_runner), started daemon 130579700623488)>, <Thread(Thread-7 (_runner), started daemon 130579700706816)>] {{(pid=77821) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 30 20:21:12 devstack cinder-volume[77821]: DEBUG dbcounter [-] [77821] Writing DB stats cinder:SELECT=1 {{(pid=77821) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 30 20:21:12 devstack cinder-volume[77821]: DEBUG dbcounter [-] [77821] Writing DB stats cinder:UPDATE=1 {{(pid=77821) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 30 20:21:27 devstack cinder-volume[77666]: INFO oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] Caught SIGTERM, stopping children
Jul 30 20:21:27 devstack cinder-volume[77666]: DEBUG oslo_concurrency.lockutils [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] Acquiring lock "singleton_lock" {{(pid=77666) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Jul 30 20:21:27 devstack cinder-volume[77666]: DEBUG oslo_concurrency.lockutils [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] Acquired lock "singleton_lock" {{(pid=77666) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Jul 30 20:21:27 devstack cinder-volume[77666]: DEBUG oslo_concurrency.lockutils [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] Releasing lock "singleton_lock" {{(pid=77666) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Jul 30 20:21:27 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] Stop services. {{(pid=77666) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Jul 30 20:21:27 devstack cinder-volume[77666]: DEBUG oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] Killing children. {{(pid=77666) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Jul 30 20:21:27 devstack cinder-volume[77666]: INFO oslo_service.backend._eventlet.service [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] Waiting on 1 children to exit
Jul 30 20:21:32 devstack cinder-volume[77821]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting
Jul 30 20:21:32 devstack cinder-volume[87918]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Jul 30 20:21:32 devstack cinder-volume[87918]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jul 30 20:21:32 devstack cinder-volume[87918]: we strongly recommend against using it for new projects.
Jul 30 20:21:32 devstack cinder-volume[87918]: If you are already using Eventlet, we recommend migrating to a different
Jul 30 20:21:32 devstack cinder-volume[87918]: framework.  For more detail see
Jul 30 20:21:32 devstack cinder-volume[87918]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jul 30 20:21:32 devstack cinder-volume[87918]:   import eventlet  # noqa
Jul 30 20:21:34 devstack cinder-volume[87918]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87918) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Jul 30 20:21:34 devstack cinder-volume[87918]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87918) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Jul 30 20:21:34 devstack cinder-volume[87918]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87918) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Jul 30 20:21:35 devstack cinder-volume[87918]: INFO dbcounter [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] Registered counter for database cinder
Jul 30 20:21:35 devstack cinder-volume[87918]: DEBUG oslo_db.sqlalchemy.engines [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87918) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 30 20:21:35 devstack cinder-volume[87918]: DEBUG dbcounter [-] [87918] Writer thread running {{(pid=87918) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 30 20:21:35 devstack cinder-volume[87918]: INFO cinder.rpc [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Jul 30 20:21:35 devstack cinder-volume[87918]: INFO cinder.rpc [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Jul 30 20:21:35 devstack cinder-volume[87918]: DEBUG oslo_db.sqlalchemy.engines [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87918) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 30 20:21:35 devstack cinder-volume[87918]: INFO cinder.volume.manager [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] Determined volume DB was empty at startup.
Jul 30 20:21:35 devstack cinder-volume[87918]: DEBUG cinder.volume.manager [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87918) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Jul 30 20:21:35 devstack cinder-volume[87918]: INFO cinder.volume.manager [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] Service not found for updating active_backend_id, assuming default for driver init.
Jul 30 20:21:35 devstack cinder-volume[87918]: WARNING stevedore.named [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jul 30 20:21:35 devstack cinder-volume[87918]: WARNING castellan.key_manager [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 30 20:21:35 devstack cinder-volume[87918]: WARNING cinder.keymgr.conf_key_mgr [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 30 20:21:36 devstack cinder-volume[87918]: INFO cinder.volume.manager [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Jul 30 20:21:36 devstack cinder-volume[77821]: DEBUG oslo_concurrency.lockutils [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] Acquiring lock "singleton_lock" {{(pid=77821) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Jul 30 20:21:36 devstack cinder-volume[77821]: DEBUG oslo_concurrency.lockutils [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] Acquired lock "singleton_lock" {{(pid=77821) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Jul 30 20:21:36 devstack cinder-volume[77821]: DEBUG oslo_concurrency.lockutils [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] Releasing lock "singleton_lock" {{(pid=77821) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Jul 30 20:21:36 devstack cinder-volume[77821]: WARNING amqp [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jul 30 20:21:36 devstack cinder-volume[77821]: WARNING amqp [None req-f1435587-bd1b-4b41-9d18-7dd5790de21b None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_db.sqlalchemy.engines [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87918) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 30 20:21:36 devstack cinder-volume[87918]: INFO oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] Starting 1 workers
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] Started child 88137 {{(pid=87918) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] Full set of CONF: {{(pid=87918) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] ******************************************************************************** {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] Configuration options gathered from: {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] ================================================================================ {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] allow_availability_zone_fallback = False {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] allow_compression_on_image_upload = False {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[88137]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] allowed_direct_url_schemes     = [] {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] api_rate_limit                 = True {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] auth_strategy                  = keystone {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] backend_availability_zone      = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] backend_host                   = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] backend_name                   = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] backend_stats_polling_interval = 60 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] backup_api_class               = cinder.backup.api.API {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] backup_name_template           = backup-%s {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] backup_use_same_host           = False {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] backup_use_temp_snapshot       = False {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] chap_password                  = **** {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] chap_username                  =  {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] cinder_internal_tenant_project_id = a3814ccecea84ea481f96c4f5d62821c {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] cinder_internal_tenant_user_id = d7b5bc1d1ac44a72849c7903bac92f36 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] cluster                        = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] compression_format             = gzip {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] compute_api_class              = cinder.compute.nova.API {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] config_dir                     = [] {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] config_source                  = [] {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] control_exchange               = openstack {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] debug                          = True {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] default_availability_zone      = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] default_group_type             = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] default_volume_type            = QuobyteHD {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] disk_geometry                  = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] driver_client_cert             = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] driver_client_cert_key         = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] driver_data_namespace          = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] driver_ssl_cert_path           = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] driver_ssl_cert_verify         = False {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] driver_use_ssl                 = False {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] enable_new_services            = True {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] enable_unsupported_driver      = False {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] enabled_backends               = ['QuobyteHD'] {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] enforce_multipath_for_image_xfer = False {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] filter_function                = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] glance_api_insecure            = False {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] glance_api_servers             = ['http://192.168.122.98/image'] {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] glance_api_ssl_compression     = False {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] glance_ca_certificates_file    = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] glance_catalog_info            = image:glance:publicURL {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] glance_certfile                = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] glance_keyfile                 = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] glance_num_retries             = 3 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] glance_request_timeout         = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] goodness_function              = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] graceful_shutdown_timeout      = 5 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] group_api_class                = cinder.group.api.API {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] host                           = devstack {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] image_compress_on_upload       = True {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] image_conversion_address_space_limit = 1 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] image_conversion_cpu_limit     = 60 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] image_conversion_disable       = False {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] image_upload_use_cinder_backend = False {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] image_upload_use_internal_tenant = False {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] image_volume_cache_enabled     = False {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] image_volume_cache_max_count   = 0 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] image_volume_cache_max_size_gb = 0 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] init_host_max_objects_retrieval = 0 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] instance_format                = [instance: %(uuid)s]  {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] iscsi_target_flags             =  {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] iscsi_write_cache              = on {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] iser_helper                    = tgtadm {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] iser_ip_address                = 192.168.122.98 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] iser_port                      = 3260 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-5a43a46d-dd32-4e7f-8f33-9f4845293d4f None None] Starting volume driver QuobyteDriver (1.2)
Jul 30 20:21:36 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-5a43a46d-dd32-4e7f-8f33-9f4845293d4f None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=88137) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] log_color                      = False {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] log_config_append              = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] log_dir                        = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] log_file                       = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] log_options                    = True {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] log_rotate_interval            = 1 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] log_rotate_interval_type       = days {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] log_rotation_type              = none {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] max_age                        = 0 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] max_logfile_count              = 30 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] max_logfile_size_mb            = 200 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] max_over_subscription_ratio    = 20.0 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] message_reap_interval          = 86400 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] message_ttl                    = 2592000 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] migration_create_volume_timeout_secs = 300 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] monkey_patch                   = False {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] monkey_patch_modules           = [] {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] my_ip                          = 192.168.122.98 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] no_snapshot_gb_quota           = False {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] num_iser_scan_tries            = 3 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] num_shell_tries                = 3 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] num_volume_device_scan_tries   = 3 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] nvmeof_conn_info_version       = 1 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] nvmet_ns_id                    = 10 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] nvmet_port_id                  = 1 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] osapi_max_limit                = 1000 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] osapi_volume_ext_list          = [] {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] osapi_volume_listen_port       = 8776 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] osapi_volume_use_ssl           = False {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] osapi_volume_workers           = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] per_volume_size_limit          = -1 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] periodic_fuzzy_delay           = 60 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] periodic_interval              = 60 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] public_endpoint                = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] publish_errors                 = False {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] quota_backup_gigabytes         = 1000 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] quota_backups                  = 10 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] quota_gigabytes                = 1000 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] quota_groups                   = 10 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] quota_snapshots                = 10 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] quota_volumes                  = 10 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] rate_limit_burst               = 0 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] rate_limit_except_level        = CRITICAL {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] rate_limit_interval            = 0 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] reinit_driver_count            = 3 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] replication_device             = **** {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] report_discard_supported       = False {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] report_interval                = 120 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] reservation_clean_interval     = 86400 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] reservation_expire             = 86400 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] reserved_image_namespaces      = [] {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] reserved_percentage            = 0 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] rpc_response_timeout           = 120 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] run_external_periodic_tasks    = True {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] scst_target_driver             = iscsi {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] scst_target_iqn_name           = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] service_down_time              = 720 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] shell_completion               = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] snapshot_name_template         = snapshot-%s {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] split_loggers                  = False {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] state_path                     = /opt/stack/data/cinder {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] storage_availability_zone      = nova {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] storage_protocol               = iSCSI {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] syslog_log_facility            = LOG_USER {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] target_helper                  = lioadm {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] target_ip_address              = 192.168.122.98 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] target_port                    = 3260 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] target_protocol                = iscsi {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] target_secondary_ip_addresses  = [] {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] trace_flags                    = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] transport_url                  = **** {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] until_refresh                  = 0 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] use_chap_auth                  = False {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] use_default_quota_class        = True {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] use_journal                    = False {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] use_json                       = False {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] use_multipath_for_image_xfer   = False {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] use_stderr                     = False {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] use_syslog                     = False {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] verify_glance_signatures       = enabled {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] volume_api_class               = cinder.volume.api.API {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] volume_backend_name            = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] volume_clear                   = zero {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] volume_clear_ionice            = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] volume_clear_size              = 0 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] volume_copy_bps_limit          = 0 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] volume_dd_blocksize            = 1M {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] volume_name_template           = volume-%s {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] volume_service_inithost_offload = False {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] volume_usage_audit_period      = month {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] zoning_mode                    = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] oslo_concurrency.disable_process_locking = False {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] keystone_authtoken.auth_section = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] keystone_authtoken.auth_type   = password {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] keystone_authtoken.auth_version = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] keystone_authtoken.cache       = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] keystone_authtoken.certfile    = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] keystone_authtoken.delay_auth_decision = False {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] keystone_authtoken.http_connect_timeout = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] keystone_authtoken.include_service_catalog = True {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] keystone_authtoken.insecure    = False {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] keystone_authtoken.interface   = public {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] keystone_authtoken.keyfile     = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] keystone_authtoken.memcache_password =  {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] keystone_authtoken.memcache_username =  {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] keystone_authtoken.region_name = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] keystone_authtoken.service_token_roles_required = True {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] keystone_authtoken.service_type = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] keystone_authtoken.token_cache_time = 300 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.98/identity {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] cache.backend                  = dogpile.cache.null {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] cache.backend_argument         = **** {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] cache.backend_expiration_time  = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] cache.config_prefix            = cache.oslo {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] cache.debug_cache_backend      = False {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] cache.enable_retry_client      = False {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] cache.enable_socket_keepalive  = False {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] cache.enabled                  = False {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] cache.expiration_time          = 600 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] cache.hashclient_retry_attempts = 2 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] cache.memcache_dead_retry      = 300 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] cache.memcache_pool_maxsize    = 10 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] cache.memcache_sasl_enabled    = False {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] cache.password                 = **** {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] cache.proxies                  = [] {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] cache.redis_db                 = 0 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] cache.redis_sentinel_service_name = mymaster {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] cache.redis_server             = localhost:6379 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] cache.retry_attempts           = 2 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] cache.retry_delay              = 0.0 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] cache.socket_keepalive_count   = 1 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] cache.socket_keepalive_idle    = 1 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] cache.socket_keepalive_interval = 1 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] cache.socket_timeout           = 1.0 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] cache.tls_allowed_ciphers      = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] cache.tls_cafile               = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] cache.tls_certfile             = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] cache.tls_enabled              = False {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] cache.tls_keyfile              = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] cache.username                 = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] coordination.backend_url       = **** {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] database.asyncio_connection    = **** {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] database.asyncio_slave_connection = **** {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] database.backend               = sqlalchemy {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] database.connection            = **** {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] database.connection_debug      = 0 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] database.connection_parameters =  {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] database.connection_recycle_time = 3600 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] database.connection_trace      = False {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] database.db_inc_retry_interval = True {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] database.db_max_retries        = 20 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] database.db_max_retry_interval = 10 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] database.db_retry_interval     = 1 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] database.max_overflow          = 50 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] database.max_pool_size         = 5 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] database.max_retries           = 10 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] database.mysql_wsrep_sync_wait = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] database.pool_timeout          = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] database.retry_interval        = 10 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] database.slave_connection      = **** {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] database.sqlite_synchronous    = True {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] database.synchronous_reader    = True {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] database.use_db_reconnect      = False {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] profiler.connection_string     = messaging:// {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] profiler.enabled               = False {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] profiler.es_doc_type           = notification {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] profiler.es_scroll_size        = 10000 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] profiler.es_scroll_time        = 2m {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] profiler.filter_error_trace    = False {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] profiler.hmac_keys             = **** {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] profiler.sentinel_service_name = mymaster {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] profiler.socket_timeout        = 0.1 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] profiler.trace_requests        = False {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] profiler.trace_sqlalchemy      = False {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] profiler_jaeger.process_tags   = {} {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] profiler_jaeger.service_name_prefix = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] profiler_otlp.service_name_prefix = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] oslo_policy.enforce_new_defaults = True {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] oslo_policy.policy_default_rule = default {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] oslo_policy.policy_file        = policy.yaml {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] privsep_osbrick.group          = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] privsep_osbrick.helper_command = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] privsep_osbrick.user           = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] cinder_sys_admin.group         = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] cinder_sys_admin.helper_command = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] cinder_sys_admin.user          = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] service_user.auth_section      = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] service_user.auth_type         = password {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] service_user.cafile            = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] service_user.certfile          = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] service_user.collect_timing    = False {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] service_user.insecure          = False {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] service_user.keyfile           = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] service_user.send_service_user_token = True {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] service_user.split_loggers     = False {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] service_user.timeout           = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] glance.auth_section            = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] glance.auth_type               = password {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] glance.certfile                = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] glance.collect_timing          = False {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] glance.insecure                = False {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] glance.keyfile                 = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] glance.region_name             = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] glance.split_loggers           = False {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] glance.timeout                 = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] backend_defaults.backend_availability_zone = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] backend_defaults.chap_password = **** {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] backend_defaults.chap_username =  {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] backend_defaults.disk_geometry = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] backend_defaults.driver_client_cert = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] backend_defaults.driver_client_cert_key = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] backend_defaults.driver_data_namespace = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] backend_defaults.driver_use_ssl = False {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] backend_defaults.enable_unsupported_driver = False {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] backend_defaults.extra_capabilities = {} {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] backend_defaults.filter_function = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] backend_defaults.goodness_function = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] backend_defaults.iscsi_target_flags =  {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] backend_defaults.iscsi_write_cache = on {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] backend_defaults.iser_helper   = tgtadm {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] backend_defaults.iser_ip_address = 192.168.122.98 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] backend_defaults.iser_port     = 3260 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] backend_defaults.nas_host      =  {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] backend_defaults.nas_login     = admin {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] backend_defaults.nas_mount_options = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] backend_defaults.nas_password  = **** {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] backend_defaults.nas_private_key =  {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] backend_defaults.nas_share_path =  {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-5a43a46d-dd32-4e7f-8f33-9f4845293d4f None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=88137) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}}
Jul 30 20:21:36 devstack cinder-volume[88137]: WARNING cinder.volume.drivers.quobyte [None req-5a43a46d-dd32-4e7f-8f33-9f4845293d4f None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Jul 30 20:21:36 devstack cinder-volume[88137]: WARNING cinder.volume.drivers.quobyte [None req-5a43a46d-dd32-4e7f-8f33-9f4845293d4f None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-5a43a46d-dd32-4e7f-8f33-9f4845293d4f None None] Running cmd (subprocess): mount.quobyte {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] backend_defaults.num_shell_tries = 3 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] backend_defaults.nvmet_port_id = 1 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] backend_defaults.quobyte_client_cfg = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] backend_defaults.quobyte_volume_url = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] backend_defaults.replication_device = **** {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] backend_defaults.report_discard_supported = False {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] backend_defaults.reserved_percentage = 0 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] backend_defaults.scst_target_driver = iscsi {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] backend_defaults.scst_target_iqn_name = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] backend_defaults.storage_protocol = iSCSI {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] backend_defaults.target_helper = tgtadm {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] backend_defaults.target_ip_address = 192.168.122.98 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] backend_defaults.target_port   = 3260 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] backend_defaults.target_protocol = iscsi {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] backend_defaults.trace_flags   = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] backend_defaults.unique_fqdn_network = True {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] backend_defaults.use_chap_auth = False {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] backend_defaults.volume_backend_name = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] backend_defaults.volume_clear  = zero {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] backend_defaults.volume_clear_ionice = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] backend_defaults.volume_clear_size = 0 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] oslo_reports.file_event_handler = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] oslo_reports.log_dir           = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] QuobyteHD.backend_availability_zone = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] QuobyteHD.backend_host         = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] QuobyteHD.chap_password        = **** {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] QuobyteHD.chap_username        = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] QuobyteHD.chiscsi_conf         = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] QuobyteHD.disk_geometry        = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] QuobyteHD.driver_client_cert   = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] QuobyteHD.driver_client_cert_key = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] QuobyteHD.driver_data_namespace = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] QuobyteHD.driver_use_ssl       = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] QuobyteHD.extra_capabilities   = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] QuobyteHD.filter_function      = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] QuobyteHD.goodness_function    = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] QuobyteHD.iser_helper          = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] QuobyteHD.iser_ip_address      = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] QuobyteHD.iser_port            = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] QuobyteHD.iser_target_prefix   = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] QuobyteHD.nas_host             = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] QuobyteHD.nas_login            = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] QuobyteHD.nas_mount_options    = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] QuobyteHD.nas_password         = **** {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] QuobyteHD.nas_private_key      = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] QuobyteHD.nas_share_path       = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] QuobyteHD.nas_ssh_port         = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] QuobyteHD.num_shell_tries      = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] QuobyteHD.nvmet_port_id        = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] QuobyteHD.replication_device   = **** {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] QuobyteHD.report_discard_supported = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] QuobyteHD.reserved_percentage  = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] QuobyteHD.scst_target_driver   = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] QuobyteHD.storage_protocol     = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] QuobyteHD.target_helper        = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] QuobyteHD.target_ip_address    = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] QuobyteHD.target_port          = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] QuobyteHD.target_prefix        = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] QuobyteHD.target_protocol      = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] QuobyteHD.trace_flags          = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] QuobyteHD.use_chap_auth        = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] QuobyteHD.volume_clear         = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] QuobyteHD.volume_clear_size    = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] QuobyteHD.volumes_dir          = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] oslo_messaging_rabbit.ssl      = False {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] oslo_messaging_notifications.driver = [] {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] oslo_messaging_notifications.retry = -1 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] oslo_messaging_notifications.transport_url = **** {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] key_manager.fixed_key          = **** {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] barbican.barbican_api_version  = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] barbican.barbican_endpoint     = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] barbican.barbican_endpoint_type = public {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] barbican.barbican_region_name  = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] barbican.cafile                = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] barbican.certfile              = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] barbican.collect_timing        = False {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] barbican.insecure              = False {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] barbican.keyfile               = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] barbican.number_of_retries     = 60 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] barbican.retry_delay           = 1 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] barbican.send_service_user_token = False {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] barbican.split_loggers         = False {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] barbican.timeout               = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] barbican.verify_ssl            = True {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] barbican.verify_ssl_path       = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] barbican_service_user.auth_section = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] barbican_service_user.auth_type = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] barbican_service_user.cafile   = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] barbican_service_user.certfile = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] barbican_service_user.collect_timing = False {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] barbican_service_user.insecure = False {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] barbican_service_user.keyfile  = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] barbican_service_user.split_loggers = False {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] barbican_service_user.timeout  = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] vault.approle_role_id          = **** {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] vault.approle_secret_id        = **** {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] vault.auth_method              = approle {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] vault.auth_path                = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] vault.kv_mountpoint            = secret {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] vault.kv_path                  = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] vault.kv_version               = 2 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] vault.namespace                = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] vault.root_token_id            = **** {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] vault.ssl_ca_crt_file          = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] vault.timeout                  = 60.0 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] vault.token_file               = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] vault.token_role               = None {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] vault.use_ssl                  = False {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:36 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] ******************************************************************************** {{(pid=87918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}}
Jul 30 20:21:36 devstack quobyte-client[88144]: Reading configuration file: /etc/quobyte/client.cfg
Jul 30 20:21:36 devstack quobyte-client[88144]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Jul 30 20:21:36 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-5a43a46d-dd32-4e7f-8f33-9f4845293d4f None None] CMD "mount.quobyte" returned: 1 in 0.114s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:21:36 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-5a43a46d-dd32-4e7f-8f33-9f4845293d4f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:21:36 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-5a43a46d-dd32-4e7f-8f33-9f4845293d4f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:21:36 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-5a43a46d-dd32-4e7f-8f33-9f4845293d4f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:21:36 devstack cinder-volume[88137]: INFO cinder.volume.drivers.quobyte [None req-5a43a46d-dd32-4e7f-8f33-9f4845293d4f None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 ...
Jul 30 20:21:36 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-5a43a46d-dd32-4e7f-8f33-9f4845293d4f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df -c /etc/quobyte/client-cinder.cfg {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:21:36 devstack sudo[88147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df -c /etc/quobyte/client-cinder.cfg
Jul 30 20:21:36 devstack sudo[88147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:21:36 devstack sudo[88147]: pam_unix(sudo:session): session closed for user root
Jul 30 20:21:36 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-5a43a46d-dd32-4e7f-8f33-9f4845293d4f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.390s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:21:36 devstack cinder-volume[88137]: INFO cinder.volume.drivers.quobyte [None req-5a43a46d-dd32-4e7f-8f33-9f4845293d4f None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 succeeded
Jul 30 20:21:36 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-5a43a46d-dd32-4e7f-8f33-9f4845293d4f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:21:36 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-5a43a46d-dd32-4e7f-8f33-9f4845293d4f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.407s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:21:36 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-5a43a46d-dd32-4e7f-8f33-9f4845293d4f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:21:36 devstack sudo[88216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:21:36 devstack sudo[88216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:21:37 devstack sudo[88216]: pam_unix(sudo:session): session closed for user root
Jul 30 20:21:37 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-5a43a46d-dd32-4e7f-8f33-9f4845293d4f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.244s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:21:37 devstack cinder-volume[88137]: INFO cinder.volume.driver [None req-5a43a46d-dd32-4e7f-8f33-9f4845293d4f None None] Driver hasn't implemented _init_vendor_properties()
Jul 30 20:21:37 devstack cinder-volume[88137]: DEBUG cinder.volume.driver [None req-5a43a46d-dd32-4e7f-8f33-9f4845293d4f None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.754093170166, 'free_capacity_gb': 1775.754093170166, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88137) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Jul 30 20:21:37 devstack cinder-volume[88137]: DEBUG oslo_db.sqlalchemy.engines [None req-5a43a46d-dd32-4e7f-8f33-9f4845293d4f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88137) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 30 20:21:37 devstack cinder-volume[88137]: DEBUG dbcounter [-] [88137] Writer thread running {{(pid=88137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 30 20:21:37 devstack cinder-volume[88137]: DEBUG cinder.db.api [None req-5a43a46d-dd32-4e7f-8f33-9f4845293d4f None None] Building query based on filter {{(pid=88137) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Jul 30 20:21:37 devstack cinder-volume[88137]: DEBUG cinder.image.image_utils [None req-5a43a46d-dd32-4e7f-8f33-9f4845293d4f None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=88137) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Jul 30 20:21:37 devstack cinder-volume[88137]: INFO cinder.keymgr.migration [None req-585f1a12-1e62-4679-bdf4-98502a1ddb87 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Jul 30 20:21:37 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-5a43a46d-dd32-4e7f-8f33-9f4845293d4f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:21:37 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-5a43a46d-dd32-4e7f-8f33-9f4845293d4f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:21:37 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-5a43a46d-dd32-4e7f-8f33-9f4845293d4f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:21:37 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-5a43a46d-dd32-4e7f-8f33-9f4845293d4f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:21:37 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-5a43a46d-dd32-4e7f-8f33-9f4845293d4f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:21:37 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-5a43a46d-dd32-4e7f-8f33-9f4845293d4f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:21:37 devstack sudo[88227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:21:37 devstack sudo[88227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:21:37 devstack sudo[88227]: pam_unix(sudo:session): session closed for user root
Jul 30 20:21:37 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-5a43a46d-dd32-4e7f-8f33-9f4845293d4f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.330s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:21:37 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-5a43a46d-dd32-4e7f-8f33-9f4845293d4f None None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:21:37 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-5a43a46d-dd32-4e7f-8f33-9f4845293d4f None None] Driver initialization completed successfully.
Jul 30 20:21:37 devstack cinder-volume[88137]: INFO cinder.manager [None req-5a43a46d-dd32-4e7f-8f33-9f4845293d4f None None] Initiating service 3 cleanup
Jul 30 20:21:37 devstack cinder-volume[88137]: INFO cinder.manager [None req-5a43a46d-dd32-4e7f-8f33-9f4845293d4f None None] Service 3 cleanup completed.
Jul 30 20:21:37 devstack cinder-volume[88137]: DEBUG cinder.service [None req-5a43a46d-dd32-4e7f-8f33-9f4845293d4f None None] Creating RPC server for service cinder-volume {{(pid=88137) start /opt/stack/cinder/cinder/service.py:231}}
Jul 30 20:21:37 devstack cinder-volume[88137]: DEBUG cinder.service [None req-5a43a46d-dd32-4e7f-8f33-9f4845293d4f None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=88137) start /opt/stack/cinder/cinder/service.py:237}}
Jul 30 20:21:37 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-5a43a46d-dd32-4e7f-8f33-9f4845293d4f None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2)
Jul 30 20:21:37 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-5a43a46d-dd32-4e7f-8f33-9f4845293d4f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:21:37 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-5a43a46d-dd32-4e7f-8f33-9f4845293d4f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:21:37 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-5a43a46d-dd32-4e7f-8f33-9f4845293d4f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:21:37 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-5a43a46d-dd32-4e7f-8f33-9f4845293d4f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:21:37 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-5a43a46d-dd32-4e7f-8f33-9f4845293d4f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:21:37 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-5a43a46d-dd32-4e7f-8f33-9f4845293d4f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:21:37 devstack sudo[88249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:21:37 devstack sudo[88249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:21:38 devstack sudo[88249]: pam_unix(sudo:session): session closed for user root
Jul 30 20:21:38 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-5a43a46d-dd32-4e7f-8f33-9f4845293d4f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.444s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:21:38 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-5a43a46d-dd32-4e7f-8f33-9f4845293d4f None None] Driver post RPC initialization completed successfully.
Jul 30 20:21:41 devstack cinder-volume[87918]: INFO oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] Caught SIGTERM, stopping children
Jul 30 20:21:41 devstack cinder-volume[87918]: DEBUG oslo_concurrency.lockutils [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] Acquiring lock "singleton_lock" {{(pid=87918) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Jul 30 20:21:41 devstack cinder-volume[87918]: DEBUG oslo_concurrency.lockutils [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] Acquired lock "singleton_lock" {{(pid=87918) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Jul 30 20:21:41 devstack cinder-volume[87918]: DEBUG oslo_concurrency.lockutils [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] Releasing lock "singleton_lock" {{(pid=87918) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Jul 30 20:21:41 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] Stop services. {{(pid=87918) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Jul 30 20:21:41 devstack cinder-volume[87918]: DEBUG oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] Killing children. {{(pid=87918) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Jul 30 20:21:41 devstack cinder-volume[87918]: INFO oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] Waiting on 1 children to exit
Jul 30 20:21:42 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] Acquiring lock "singleton_lock" {{(pid=88137) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Jul 30 20:21:42 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] Acquired lock "singleton_lock" {{(pid=88137) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Jul 30 20:21:42 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] Releasing lock "singleton_lock" {{(pid=88137) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Jul 30 20:21:42 devstack cinder-volume[88137]: WARNING amqp [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jul 30 20:21:42 devstack cinder-volume[88137]: WARNING amqp [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jul 30 20:21:42 devstack cinder-volume[87918]: INFO oslo_service.backend._eventlet.service [None req-30f47764-f741-4d9e-bf99-ab91737285e4 None None] Child 88137 exited with status 0
Jul 30 20:21:42 devstack cinder-volume[88412]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Jul 30 20:21:42 devstack cinder-volume[88412]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jul 30 20:21:42 devstack cinder-volume[88412]: we strongly recommend against using it for new projects.
Jul 30 20:21:42 devstack cinder-volume[88412]: If you are already using Eventlet, we recommend migrating to a different
Jul 30 20:21:42 devstack cinder-volume[88412]: framework.  For more detail see
Jul 30 20:21:42 devstack cinder-volume[88412]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jul 30 20:21:42 devstack cinder-volume[88412]:   import eventlet  # noqa
Jul 30 20:21:45 devstack cinder-volume[88412]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=88412) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Jul 30 20:21:45 devstack cinder-volume[88412]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=88412) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Jul 30 20:21:45 devstack cinder-volume[88412]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=88412) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Jul 30 20:21:46 devstack cinder-volume[88412]: INFO dbcounter [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] Registered counter for database cinder
Jul 30 20:21:46 devstack cinder-volume[88412]: DEBUG oslo_db.sqlalchemy.engines [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88412) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG dbcounter [-] [88412] Writer thread running {{(pid=88412) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 30 20:21:47 devstack cinder-volume[88412]: INFO cinder.rpc [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Jul 30 20:21:47 devstack cinder-volume[88412]: INFO cinder.rpc [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_db.sqlalchemy.engines [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88412) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 30 20:21:47 devstack cinder-volume[88412]: INFO cinder.volume.manager [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] Determined volume DB was empty at startup.
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG cinder.volume.manager [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=88412) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Jul 30 20:21:47 devstack cinder-volume[88412]: WARNING stevedore.named [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jul 30 20:21:47 devstack cinder-volume[88412]: WARNING castellan.key_manager [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 30 20:21:47 devstack cinder-volume[88412]: WARNING cinder.keymgr.conf_key_mgr [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 30 20:21:47 devstack cinder-volume[88412]: INFO cinder.volume.manager [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_db.sqlalchemy.engines [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88412) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 30 20:21:47 devstack cinder-volume[88412]: INFO oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] Starting 1 workers
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] Started child 88719 {{(pid=88412) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] Full set of CONF: {{(pid=88412) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] ******************************************************************************** {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] Configuration options gathered from: {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] ================================================================================ {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] allow_availability_zone_fallback = False {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] allow_compression_on_image_upload = False {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] allowed_direct_url_schemes     = [] {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] api_rate_limit                 = True {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] auth_strategy                  = keystone {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] backend_availability_zone      = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] backend_host                   = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] backend_name                   = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] backend_stats_polling_interval = 60 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] backup_api_class               = cinder.backup.api.API {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] backup_name_template           = backup-%s {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] backup_use_same_host           = False {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] backup_use_temp_snapshot       = False {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] chap_password                  = **** {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] chap_username                  =  {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] cinder_internal_tenant_project_id = a3814ccecea84ea481f96c4f5d62821c {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] cinder_internal_tenant_user_id = d7b5bc1d1ac44a72849c7903bac92f36 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] cluster                        = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] compression_format             = gzip {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] compute_api_class              = cinder.compute.nova.API {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] config_dir                     = [] {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] config_source                  = [] {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] control_exchange               = openstack {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] debug                          = True {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] default_availability_zone      = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] default_group_type             = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] default_volume_type            = QuobyteHD {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] disk_geometry                  = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] driver_client_cert             = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88719]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] driver_client_cert_key         = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] driver_data_namespace          = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] driver_ssl_cert_path           = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] driver_ssl_cert_verify         = False {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] driver_use_ssl                 = False {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] enable_new_services            = True {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] enable_unsupported_driver      = False {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] enabled_backends               = ['QuobyteHD'] {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] enforce_multipath_for_image_xfer = False {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] filter_function                = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] glance_api_insecure            = False {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] glance_api_servers             = ['http://192.168.122.98/image'] {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] glance_api_ssl_compression     = False {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] glance_ca_certificates_file    = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] glance_catalog_info            = image:glance:publicURL {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] glance_certfile                = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] glance_keyfile                 = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] glance_num_retries             = 3 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] glance_request_timeout         = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] goodness_function              = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] graceful_shutdown_timeout      = 5 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] group_api_class                = cinder.group.api.API {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] host                           = devstack {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] image_compress_on_upload       = True {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] image_conversion_address_space_limit = 1 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] image_conversion_cpu_limit     = 60 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] image_conversion_disable       = False {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] image_upload_use_cinder_backend = False {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] image_upload_use_internal_tenant = False {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] image_volume_cache_enabled     = False {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] image_volume_cache_max_count   = 0 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] image_volume_cache_max_size_gb = 0 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] init_host_max_objects_retrieval = 0 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] instance_format                = [instance: %(uuid)s]  {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] iscsi_target_flags             =  {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] iscsi_write_cache              = on {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] iser_helper                    = tgtadm {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] iser_ip_address                = 192.168.122.98 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] iser_port                      = 3260 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] log_color                      = False {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] log_config_append              = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] log_dir                        = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] log_file                       = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] log_options                    = True {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] log_rotate_interval            = 1 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] log_rotate_interval_type       = days {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] log_rotation_type              = none {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] max_age                        = 0 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] max_logfile_count              = 30 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] max_logfile_size_mb            = 200 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] max_over_subscription_ratio    = 20.0 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] message_reap_interval          = 86400 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] message_ttl                    = 2592000 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] migration_create_volume_timeout_secs = 300 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] monkey_patch                   = False {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] monkey_patch_modules           = [] {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] my_ip                          = 192.168.122.98 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] no_snapshot_gb_quota           = False {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] num_iser_scan_tries            = 3 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] num_shell_tries                = 3 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] num_volume_device_scan_tries   = 3 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] nvmeof_conn_info_version       = 1 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] nvmet_ns_id                    = 10 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] nvmet_port_id                  = 1 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] osapi_max_limit                = 1000 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] osapi_volume_ext_list          = [] {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] osapi_volume_listen_port       = 8776 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] osapi_volume_use_ssl           = False {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] osapi_volume_workers           = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] per_volume_size_limit          = -1 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] periodic_fuzzy_delay           = 60 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] periodic_interval              = 60 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] public_endpoint                = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-f561c1ef-119a-404d-841d-9e6e7883b676 None None] Starting volume driver QuobyteDriver (1.2)
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] publish_errors                 = False {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-f561c1ef-119a-404d-841d-9e6e7883b676 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=88719) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] quota_backup_gigabytes         = 1000 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] quota_backups                  = 10 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] quota_gigabytes                = 1000 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] quota_groups                   = 10 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] quota_snapshots                = 10 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] quota_volumes                  = 10 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] rate_limit_burst               = 0 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] rate_limit_except_level        = CRITICAL {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] rate_limit_interval            = 0 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] reinit_driver_count            = 3 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] replication_device             = **** {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] report_discard_supported       = False {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] report_interval                = 120 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] reservation_clean_interval     = 86400 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] reservation_expire             = 86400 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] reserved_image_namespaces      = [] {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] reserved_percentage            = 0 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] rpc_response_timeout           = 120 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] run_external_periodic_tasks    = True {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] scst_target_driver             = iscsi {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] scst_target_iqn_name           = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] service_down_time              = 720 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] shell_completion               = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] snapshot_name_template         = snapshot-%s {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] split_loggers                  = False {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] state_path                     = /opt/stack/data/cinder {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] storage_availability_zone      = nova {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] storage_protocol               = iSCSI {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] syslog_log_facility            = LOG_USER {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] target_helper                  = lioadm {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] target_ip_address              = 192.168.122.98 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] target_port                    = 3260 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] target_protocol                = iscsi {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] target_secondary_ip_addresses  = [] {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] trace_flags                    = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] transport_url                  = **** {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] until_refresh                  = 0 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] use_chap_auth                  = False {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] use_default_quota_class        = True {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] use_journal                    = False {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] use_json                       = False {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] use_multipath_for_image_xfer   = False {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] use_stderr                     = False {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] use_syslog                     = False {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] verify_glance_signatures       = enabled {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] volume_api_class               = cinder.volume.api.API {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] volume_backend_name            = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] volume_clear                   = zero {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] volume_clear_ionice            = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] volume_clear_size              = 0 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] volume_copy_bps_limit          = 0 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] volume_dd_blocksize            = 1M {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] volume_name_template           = volume-%s {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] volume_service_inithost_offload = False {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] volume_usage_audit_period      = month {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] zoning_mode                    = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] oslo_concurrency.disable_process_locking = False {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] keystone_authtoken.auth_section = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] keystone_authtoken.auth_type   = password {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] keystone_authtoken.auth_version = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] keystone_authtoken.cache       = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] keystone_authtoken.certfile    = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] keystone_authtoken.delay_auth_decision = False {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] keystone_authtoken.http_connect_timeout = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] keystone_authtoken.include_service_catalog = True {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] keystone_authtoken.insecure    = False {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] keystone_authtoken.interface   = public {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] keystone_authtoken.keyfile     = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] keystone_authtoken.memcache_password =  {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] keystone_authtoken.memcache_username =  {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] keystone_authtoken.region_name = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] keystone_authtoken.service_token_roles_required = True {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] keystone_authtoken.service_type = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] keystone_authtoken.token_cache_time = 300 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.98/identity {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] cache.backend                  = dogpile.cache.null {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] cache.backend_argument         = **** {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] cache.backend_expiration_time  = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] cache.config_prefix            = cache.oslo {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] cache.debug_cache_backend      = False {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] cache.enable_retry_client      = False {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] cache.enable_socket_keepalive  = False {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] cache.enabled                  = False {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] cache.expiration_time          = 600 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] cache.hashclient_retry_attempts = 2 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] cache.memcache_dead_retry      = 300 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] cache.memcache_pool_maxsize    = 10 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] cache.memcache_sasl_enabled    = False {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] cache.password                 = **** {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] cache.proxies                  = [] {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] cache.redis_db                 = 0 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] cache.redis_sentinel_service_name = mymaster {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] cache.redis_server             = localhost:6379 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] cache.retry_attempts           = 2 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] cache.retry_delay              = 0.0 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] cache.socket_keepalive_count   = 1 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] cache.socket_keepalive_idle    = 1 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] cache.socket_keepalive_interval = 1 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] cache.socket_timeout           = 1.0 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] cache.tls_allowed_ciphers      = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] cache.tls_cafile               = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] cache.tls_certfile             = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] cache.tls_enabled              = False {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] cache.tls_keyfile              = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] cache.username                 = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] coordination.backend_url       = **** {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] database.asyncio_connection    = **** {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] database.asyncio_slave_connection = **** {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] database.backend               = sqlalchemy {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] database.connection            = **** {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] database.connection_debug      = 0 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] database.connection_parameters =  {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] database.connection_recycle_time = 3600 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] database.connection_trace      = False {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] database.db_inc_retry_interval = True {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] database.db_max_retries        = 20 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] database.db_max_retry_interval = 10 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] database.db_retry_interval     = 1 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] database.max_overflow          = 50 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] database.max_pool_size         = 5 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] database.max_retries           = 10 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] database.mysql_wsrep_sync_wait = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] database.pool_timeout          = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] database.retry_interval        = 10 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] database.slave_connection      = **** {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] database.sqlite_synchronous    = True {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] database.synchronous_reader    = True {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] database.use_db_reconnect      = False {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] profiler.connection_string     = messaging:// {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] profiler.enabled               = False {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] profiler.es_doc_type           = notification {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] profiler.es_scroll_size        = 10000 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] profiler.es_scroll_time        = 2m {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] profiler.filter_error_trace    = False {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] profiler.hmac_keys             = **** {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] profiler.sentinel_service_name = mymaster {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] profiler.socket_timeout        = 0.1 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] profiler.trace_requests        = False {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] profiler.trace_sqlalchemy      = False {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] profiler_jaeger.process_tags   = {} {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] profiler_jaeger.service_name_prefix = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] profiler_otlp.service_name_prefix = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] oslo_policy.enforce_new_defaults = True {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] oslo_policy.policy_default_rule = default {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] oslo_policy.policy_file        = policy.yaml {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] privsep_osbrick.group          = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] privsep_osbrick.helper_command = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] privsep_osbrick.user           = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] cinder_sys_admin.group         = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] cinder_sys_admin.helper_command = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] cinder_sys_admin.user          = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] service_user.auth_section      = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] service_user.auth_type         = password {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] service_user.cafile            = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] service_user.certfile          = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] service_user.collect_timing    = False {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] service_user.insecure          = False {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] service_user.keyfile           = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] service_user.send_service_user_token = True {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] service_user.split_loggers     = False {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] service_user.timeout           = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-f561c1ef-119a-404d-841d-9e6e7883b676 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=88719) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] glance.auth_section            = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] glance.auth_type               = password {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] glance.certfile                = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] glance.collect_timing          = False {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] glance.insecure                = False {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] glance.keyfile                 = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] glance.region_name             = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] glance.split_loggers           = False {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] glance.timeout                 = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] backend_defaults.backend_availability_zone = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] backend_defaults.chap_password = **** {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] backend_defaults.chap_username =  {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88719]: WARNING cinder.volume.drivers.quobyte [None req-f561c1ef-119a-404d-841d-9e6e7883b676 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] backend_defaults.disk_geometry = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] backend_defaults.driver_client_cert = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] backend_defaults.driver_client_cert_key = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] backend_defaults.driver_data_namespace = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] backend_defaults.driver_use_ssl = False {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] backend_defaults.enable_unsupported_driver = False {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] backend_defaults.extra_capabilities = {} {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] backend_defaults.filter_function = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88719]: WARNING cinder.volume.drivers.quobyte [None req-f561c1ef-119a-404d-841d-9e6e7883b676 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] backend_defaults.goodness_function = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] backend_defaults.iscsi_target_flags =  {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] backend_defaults.iscsi_write_cache = on {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] backend_defaults.iser_helper   = tgtadm {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] backend_defaults.iser_ip_address = 192.168.122.98 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] backend_defaults.iser_port     = 3260 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f561c1ef-119a-404d-841d-9e6e7883b676 None None] Running cmd (subprocess): mount.quobyte {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] backend_defaults.nas_host      =  {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] backend_defaults.nas_login     = admin {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] backend_defaults.nas_mount_options = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] backend_defaults.nas_password  = **** {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] backend_defaults.nas_private_key =  {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] backend_defaults.nas_share_path =  {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] backend_defaults.num_shell_tries = 3 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] backend_defaults.nvmet_port_id = 1 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] backend_defaults.quobyte_client_cfg = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] backend_defaults.quobyte_volume_url = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] backend_defaults.replication_device = **** {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] backend_defaults.report_discard_supported = False {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] backend_defaults.reserved_percentage = 0 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] backend_defaults.scst_target_driver = iscsi {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] backend_defaults.scst_target_iqn_name = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] backend_defaults.storage_protocol = iSCSI {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] backend_defaults.target_helper = tgtadm {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] backend_defaults.target_ip_address = 192.168.122.98 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] backend_defaults.target_port   = 3260 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] backend_defaults.target_protocol = iscsi {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] backend_defaults.trace_flags   = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] backend_defaults.unique_fqdn_network = True {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] backend_defaults.use_chap_auth = False {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] backend_defaults.volume_backend_name = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] backend_defaults.volume_clear  = zero {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] backend_defaults.volume_clear_ionice = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] backend_defaults.volume_clear_size = 0 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] oslo_reports.file_event_handler = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] oslo_reports.log_dir           = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] QuobyteHD.backend_availability_zone = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] QuobyteHD.backend_host         = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] QuobyteHD.chap_password        = **** {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] QuobyteHD.chap_username        = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] QuobyteHD.chiscsi_conf         = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] QuobyteHD.disk_geometry        = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] QuobyteHD.driver_client_cert   = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] QuobyteHD.driver_client_cert_key = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] QuobyteHD.driver_data_namespace = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] QuobyteHD.driver_use_ssl       = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] QuobyteHD.extra_capabilities   = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] QuobyteHD.filter_function      = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] QuobyteHD.goodness_function    = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack quobyte-client[88726]: Reading configuration file: /etc/quobyte/client.cfg
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack quobyte-client[88726]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f561c1ef-119a-404d-841d-9e6e7883b676 None None] CMD "mount.quobyte" returned: 1 in 0.082s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] QuobyteHD.iser_helper          = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] QuobyteHD.iser_ip_address      = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] QuobyteHD.iser_port            = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] QuobyteHD.iser_target_prefix   = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-f561c1ef-119a-404d-841d-9e6e7883b676 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:21:47 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-f561c1ef-119a-404d-841d-9e6e7883b676 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:21:47 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-f561c1ef-119a-404d-841d-9e6e7883b676 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] QuobyteHD.nas_host             = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] QuobyteHD.nas_login            = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] QuobyteHD.nas_mount_options    = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] QuobyteHD.nas_password         = **** {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] QuobyteHD.nas_private_key      = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] QuobyteHD.nas_share_path       = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] QuobyteHD.nas_ssh_port         = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] QuobyteHD.num_shell_tries      = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:47 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-f561c1ef-119a-404d-841d-9e6e7883b676 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-f561c1ef-119a-404d-841d-9e6e7883b676 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] QuobyteHD.nvmet_port_id        = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f561c1ef-119a-404d-841d-9e6e7883b676 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] QuobyteHD.replication_device   = **** {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] QuobyteHD.report_discard_supported = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] QuobyteHD.reserved_percentage  = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] QuobyteHD.scst_target_driver   = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] QuobyteHD.storage_protocol     = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] QuobyteHD.target_helper        = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] QuobyteHD.target_ip_address    = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] QuobyteHD.target_port          = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] QuobyteHD.target_prefix        = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] QuobyteHD.target_protocol      = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] QuobyteHD.trace_flags          = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] QuobyteHD.use_chap_auth        = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] QuobyteHD.volume_clear         = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] QuobyteHD.volume_clear_size    = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] QuobyteHD.volumes_dir          = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] oslo_messaging_rabbit.ssl      = False {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] oslo_messaging_notifications.driver = [] {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] oslo_messaging_notifications.retry = -1 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] oslo_messaging_notifications.transport_url = **** {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] key_manager.fixed_key          = **** {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] barbican.barbican_api_version  = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] barbican.barbican_endpoint     = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] barbican.barbican_endpoint_type = public {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] barbican.barbican_region_name  = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] barbican.cafile                = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] barbican.certfile              = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] barbican.collect_timing        = False {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] barbican.insecure              = False {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] barbican.keyfile               = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] barbican.number_of_retries     = 60 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] barbican.retry_delay           = 1 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] barbican.send_service_user_token = False {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] barbican.split_loggers         = False {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] barbican.timeout               = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] barbican.verify_ssl            = True {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] barbican.verify_ssl_path       = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] barbican_service_user.auth_section = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] barbican_service_user.auth_type = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] barbican_service_user.cafile   = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] barbican_service_user.certfile = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] barbican_service_user.collect_timing = False {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] barbican_service_user.insecure = False {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] barbican_service_user.keyfile  = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] barbican_service_user.split_loggers = False {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] barbican_service_user.timeout  = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] vault.approle_role_id          = **** {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] vault.approle_secret_id        = **** {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] vault.auth_method              = approle {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] vault.auth_path                = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] vault.kv_mountpoint            = secret {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] vault.kv_path                  = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] vault.kv_version               = 2 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] vault.namespace                = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] vault.root_token_id            = **** {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] vault.ssl_ca_crt_file          = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] vault.timeout                  = 60.0 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] vault.token_file               = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] vault.token_role               = None {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] vault.use_ssl                  = False {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 30 20:21:48 devstack cinder-volume[88412]: DEBUG oslo_service.backend._eventlet.service [None req-ca0fd106-cd07-40cb-b524-be34fa4da5e1 None None] ******************************************************************************** {{(pid=88412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}}
Jul 30 20:21:48 devstack sudo[88727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:21:48 devstack sudo[88727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:21:48 devstack sudo[88727]: pam_unix(sudo:session): session closed for user root
Jul 30 20:21:48 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f561c1ef-119a-404d-841d-9e6e7883b676 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.311s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:21:48 devstack cinder-volume[88719]: INFO cinder.volume.driver [None req-f561c1ef-119a-404d-841d-9e6e7883b676 None None] Driver hasn't implemented _init_vendor_properties()
Jul 30 20:21:48 devstack cinder-volume[88719]: DEBUG cinder.volume.driver [None req-f561c1ef-119a-404d-841d-9e6e7883b676 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.754093170166, 'free_capacity_gb': 1775.754093170166, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88719) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Jul 30 20:21:48 devstack cinder-volume[88719]: DEBUG oslo_db.sqlalchemy.engines [None req-f561c1ef-119a-404d-841d-9e6e7883b676 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88719) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 30 20:21:48 devstack cinder-volume[88719]: DEBUG dbcounter [-] [88719] Writer thread running {{(pid=88719) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 30 20:21:48 devstack cinder-volume[88719]: DEBUG cinder.db.api [None req-f561c1ef-119a-404d-841d-9e6e7883b676 None None] Building query based on filter {{(pid=88719) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Jul 30 20:21:48 devstack cinder-volume[88719]: DEBUG cinder.image.image_utils [None req-f561c1ef-119a-404d-841d-9e6e7883b676 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=88719) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Jul 30 20:21:48 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-f561c1ef-119a-404d-841d-9e6e7883b676 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:21:48 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-f561c1ef-119a-404d-841d-9e6e7883b676 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:21:48 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-f561c1ef-119a-404d-841d-9e6e7883b676 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:21:48 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-f561c1ef-119a-404d-841d-9e6e7883b676 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:21:48 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-f561c1ef-119a-404d-841d-9e6e7883b676 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:21:48 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f561c1ef-119a-404d-841d-9e6e7883b676 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:21:48 devstack sudo[88740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:21:48 devstack sudo[88740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:21:48 devstack cinder-volume[88719]: INFO cinder.keymgr.migration [None req-c7fa1586-a5b3-4773-89d7-757911ed4643 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Jul 30 20:21:48 devstack sudo[88740]: pam_unix(sudo:session): session closed for user root
Jul 30 20:21:48 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f561c1ef-119a-404d-841d-9e6e7883b676 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.281s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:21:48 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-f561c1ef-119a-404d-841d-9e6e7883b676 None None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:21:48 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-f561c1ef-119a-404d-841d-9e6e7883b676 None None] Driver initialization completed successfully.
Jul 30 20:21:48 devstack cinder-volume[88719]: INFO cinder.manager [None req-f561c1ef-119a-404d-841d-9e6e7883b676 None None] Initiating service 3 cleanup
Jul 30 20:21:48 devstack cinder-volume[88719]: INFO cinder.manager [None req-f561c1ef-119a-404d-841d-9e6e7883b676 None None] Service 3 cleanup completed.
Jul 30 20:21:48 devstack cinder-volume[88719]: DEBUG cinder.service [None req-f561c1ef-119a-404d-841d-9e6e7883b676 None None] Creating RPC server for service cinder-volume {{(pid=88719) start /opt/stack/cinder/cinder/service.py:231}}
Jul 30 20:21:48 devstack cinder-volume[88719]: DEBUG cinder.service [None req-f561c1ef-119a-404d-841d-9e6e7883b676 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=88719) start /opt/stack/cinder/cinder/service.py:237}}
Jul 30 20:21:49 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-f561c1ef-119a-404d-841d-9e6e7883b676 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2)
Jul 30 20:21:49 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-f561c1ef-119a-404d-841d-9e6e7883b676 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:21:49 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-f561c1ef-119a-404d-841d-9e6e7883b676 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:21:49 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-f561c1ef-119a-404d-841d-9e6e7883b676 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:21:49 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-f561c1ef-119a-404d-841d-9e6e7883b676 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:21:49 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-f561c1ef-119a-404d-841d-9e6e7883b676 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:21:49 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f561c1ef-119a-404d-841d-9e6e7883b676 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:21:49 devstack sudo[88753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:21:49 devstack sudo[88753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:21:49 devstack sudo[88753]: pam_unix(sudo:session): session closed for user root
Jul 30 20:21:49 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f561c1ef-119a-404d-841d-9e6e7883b676 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.365s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:21:49 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-f561c1ef-119a-404d-841d-9e6e7883b676 None None] Driver post RPC initialization completed successfully.
Jul 30 20:21:57 devstack cinder-volume[88412]: DEBUG dbcounter [-] [88412] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=88412) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 30 20:21:58 devstack cinder-volume[88719]: DEBUG dbcounter [-] [88719] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=88719) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 30 20:21:59 devstack cinder-volume[88719]: DEBUG dbcounter [-] [88719] Writing DB stats cinder:SELECT=2 {{(pid=88719) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 30 20:22:16 devstack cinder-volume[88719]: DEBUG oslo_service.periodic_task [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Running periodic task VolumeManager._thread_info {{(pid=88719) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 30 20:22:16 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] thread count: 6 {{(pid=88719) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 30 20:22:16 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] thread info: [<_MainThread(MainThread, started 132390416908416)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132390306497536)>, <Thread(Thread-3 (stat_writer), started daemon 132390304471680)>, <Thread(Rabbit-heartbeat, started daemon 132390303393408)>, <Thread(Thread-5 (_runner), started daemon 132390303543168)>, <Thread(Thread-7 (_runner), started daemon 132390303563392)>] {{(pid=88719) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 30 20:22:49 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cecc211-98a9-4e0f-997c-f66f2db982f0 tempest-TaggedAttachmentsTest-1313745184 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:22:49 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-7cecc211-98a9-4e0f-997c-f66f2db982f0 tempest-TaggedAttachmentsTest-1313745184 None] Flow 'volume_create_manager' (e0ba5221-e679-46a9-9213-ef90324d10a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:22:49 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-7cecc211-98a9-4e0f-997c-f66f2db982f0 tempest-TaggedAttachmentsTest-1313745184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (146840be-681e-4a97-9e50-5b9bd661f07f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:22:49 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-7cecc211-98a9-4e0f-997c-f66f2db982f0 tempest-TaggedAttachmentsTest-1313745184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (146840be-681e-4a97-9e50-5b9bd661f07f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:22:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-2063450472',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3467229e-66c1-4914-b88a-eef1c4a467b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='799194d2400c4e54b118a0b273e67135',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:22:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:22:49Z,use_quota=True,user_id='ff9efb7a709748c298bf135bcb431125',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:22:49 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-7cecc211-98a9-4e0f-997c-f66f2db982f0 tempest-TaggedAttachmentsTest-1313745184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31ae815a-8ec4-4076-8b99-f8e5dd672bbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:22:49 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-7cecc211-98a9-4e0f-997c-f66f2db982f0 tempest-TaggedAttachmentsTest-1313745184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31ae815a-8ec4-4076-8b99-f8e5dd672bbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:22:49 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-7cecc211-98a9-4e0f-997c-f66f2db982f0 tempest-TaggedAttachmentsTest-1313745184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7b86561-cb2c-46e0-abdf-3c3da1744058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:22:49 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-7cecc211-98a9-4e0f-997c-f66f2db982f0 tempest-TaggedAttachmentsTest-1313745184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7b86561-cb2c-46e0-abdf-3c3da1744058) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3467229e-66c1-4914-b88a-eef1c4a467b2', 'volume_name': 'volume-3467229e-66c1-4914-b88a-eef1c4a467b2', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:22:49 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-7cecc211-98a9-4e0f-997c-f66f2db982f0 tempest-TaggedAttachmentsTest-1313745184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eea42b14-0bd1-493a-bd50-1dbd4daa6b2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:22:49 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-7cecc211-98a9-4e0f-997c-f66f2db982f0 tempest-TaggedAttachmentsTest-1313745184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eea42b14-0bd1-493a-bd50-1dbd4daa6b2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:22:49 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-7cecc211-98a9-4e0f-997c-f66f2db982f0 tempest-TaggedAttachmentsTest-1313745184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92c3cdbf-79b2-4a65-a0ae-1b48ef35d923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:22:49 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-7cecc211-98a9-4e0f-997c-f66f2db982f0 tempest-TaggedAttachmentsTest-1313745184 None] Volume 3467229e-66c1-4914-b88a-eef1c4a467b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3467229e-66c1-4914-b88a-eef1c4a467b2', 'volume_size': 1}
Jul 30 20:22:49 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-7cecc211-98a9-4e0f-997c-f66f2db982f0 tempest-TaggedAttachmentsTest-1313745184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:22:49 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-7cecc211-98a9-4e0f-997c-f66f2db982f0 tempest-TaggedAttachmentsTest-1313745184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:22:49 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-7cecc211-98a9-4e0f-997c-f66f2db982f0 tempest-TaggedAttachmentsTest-1313745184 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:22:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-2063450472',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3467229e-66c1-4914-b88a-eef1c4a467b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='799194d2400c4e54b118a0b273e67135',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:22:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:22:49Z,use_quota=True,user_id='ff9efb7a709748c298bf135bcb431125',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:22:49 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-7cecc211-98a9-4e0f-997c-f66f2db982f0 tempest-TaggedAttachmentsTest-1313745184 None] Creating volume 3467229e-66c1-4914-b88a-eef1c4a467b2 {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:22:49 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-7cecc211-98a9-4e0f-997c-f66f2db982f0 tempest-TaggedAttachmentsTest-1313745184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:22:49 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-7cecc211-98a9-4e0f-997c-f66f2db982f0 tempest-TaggedAttachmentsTest-1313745184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:22:49 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-7cecc211-98a9-4e0f-997c-f66f2db982f0 tempest-TaggedAttachmentsTest-1313745184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:22:49 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-7cecc211-98a9-4e0f-997c-f66f2db982f0 tempest-TaggedAttachmentsTest-1313745184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:22:49 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-7cecc211-98a9-4e0f-997c-f66f2db982f0 tempest-TaggedAttachmentsTest-1313745184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:22:49 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-7cecc211-98a9-4e0f-997c-f66f2db982f0 tempest-TaggedAttachmentsTest-1313745184 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:22:49 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-7cecc211-98a9-4e0f-997c-f66f2db982f0 tempest-TaggedAttachmentsTest-1313745184 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:22:49 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-7cecc211-98a9-4e0f-997c-f66f2db982f0 tempest-TaggedAttachmentsTest-1313745184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3467229e-66c1-4914-b88a-eef1c4a467b2 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:22:49 devstack sudo[89041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3467229e-66c1-4914-b88a-eef1c4a467b2 1073741824
Jul 30 20:22:49 devstack sudo[89041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:22:49 devstack sudo[89041]: pam_unix(sudo:session): session closed for user root
Jul 30 20:22:49 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-7cecc211-98a9-4e0f-997c-f66f2db982f0 tempest-TaggedAttachmentsTest-1313745184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3467229e-66c1-4914-b88a-eef1c4a467b2 1073741824" returned: 0 in 0.588s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:22:50 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-7cecc211-98a9-4e0f-997c-f66f2db982f0 tempest-TaggedAttachmentsTest-1313745184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3467229e-66c1-4914-b88a-eef1c4a467b2 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:22:50 devstack sudo[89360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3467229e-66c1-4914-b88a-eef1c4a467b2
Jul 30 20:22:50 devstack sudo[89360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:22:50 devstack sudo[89360]: pam_unix(sudo:session): session closed for user root
Jul 30 20:22:50 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-7cecc211-98a9-4e0f-997c-f66f2db982f0 tempest-TaggedAttachmentsTest-1313745184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3467229e-66c1-4914-b88a-eef1c4a467b2" returned: 0 in 0.328s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:22:50 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-7cecc211-98a9-4e0f-997c-f66f2db982f0 tempest-TaggedAttachmentsTest-1313745184 None] <== create_volume: return (1005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:22:50 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-7cecc211-98a9-4e0f-997c-f66f2db982f0 tempest-TaggedAttachmentsTest-1313745184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:22:50 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-7cecc211-98a9-4e0f-997c-f66f2db982f0 tempest-TaggedAttachmentsTest-1313745184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92c3cdbf-79b2-4a65-a0ae-1b48ef35d923) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3467229e-66c1-4914-b88a-eef1c4a467b2', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:22:50 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-7cecc211-98a9-4e0f-997c-f66f2db982f0 tempest-TaggedAttachmentsTest-1313745184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31578673-f54d-4acc-979f-5a7eef2b2a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:22:50 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-7cecc211-98a9-4e0f-997c-f66f2db982f0 tempest-TaggedAttachmentsTest-1313745184 None] Volume volume-3467229e-66c1-4914-b88a-eef1c4a467b2 (3467229e-66c1-4914-b88a-eef1c4a467b2): created successfully
Jul 30 20:22:50 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-7cecc211-98a9-4e0f-997c-f66f2db982f0 tempest-TaggedAttachmentsTest-1313745184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31578673-f54d-4acc-979f-5a7eef2b2a27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:22:50 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-7cecc211-98a9-4e0f-997c-f66f2db982f0 tempest-TaggedAttachmentsTest-1313745184 None] Flow 'volume_create_manager' (e0ba5221-e679-46a9-9213-ef90324d10a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:22:50 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-7cecc211-98a9-4e0f-997c-f66f2db982f0 tempest-TaggedAttachmentsTest-1313745184 None] Created volume successfully.
Jul 30 20:23:00 devstack cinder-volume[88719]: DEBUG dbcounter [-] [88719] Writing DB stats cinder:UPDATE=3,cinder:SELECT=1,cinder:INSERT=1 {{(pid=88719) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 30 20:23:00 devstack cinder-volume[88719]: DEBUG dbcounter [-] [88719] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=88719) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 30 20:23:12 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-10f4a9c5-5e90-4fd2-a495-768a66491abe tempest-VolumesAdminNegativeTest-1048946469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:23:12 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-10f4a9c5-5e90-4fd2-a495-768a66491abe tempest-VolumesAdminNegativeTest-1048946469 None] Flow 'volume_create_manager' (a91e8119-8359-4581-8c0a-8a7603fdee08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:23:12 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-10f4a9c5-5e90-4fd2-a495-768a66491abe tempest-VolumesAdminNegativeTest-1048946469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b18a5410-82ed-4a34-a170-c9ca77e6cf9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:23:12 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-10f4a9c5-5e90-4fd2-a495-768a66491abe tempest-VolumesAdminNegativeTest-1048946469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b18a5410-82ed-4a34-a170-c9ca77e6cf9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:23:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1240783841',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f092be3c-e1ae-422e-a1fe-1143f4139323,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c67edd06903404ea3289a5a37298a35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:23:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:23:12Z,use_quota=True,user_id='d9bce38038864a23acf21413afd71120',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:23:12 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-10f4a9c5-5e90-4fd2-a495-768a66491abe tempest-VolumesAdminNegativeTest-1048946469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40ed57c3-8d3a-45d8-819a-c16643eb7b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:23:12 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-10f4a9c5-5e90-4fd2-a495-768a66491abe tempest-VolumesAdminNegativeTest-1048946469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40ed57c3-8d3a-45d8-819a-c16643eb7b1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:23:12 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-10f4a9c5-5e90-4fd2-a495-768a66491abe tempest-VolumesAdminNegativeTest-1048946469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dead3eb7-ad5b-4a92-a5f9-a0e1081ab8b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:23:12 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-10f4a9c5-5e90-4fd2-a495-768a66491abe tempest-VolumesAdminNegativeTest-1048946469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dead3eb7-ad5b-4a92-a5f9-a0e1081ab8b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f092be3c-e1ae-422e-a1fe-1143f4139323', 'volume_name': 'volume-f092be3c-e1ae-422e-a1fe-1143f4139323', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:23:12 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-10f4a9c5-5e90-4fd2-a495-768a66491abe tempest-VolumesAdminNegativeTest-1048946469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23694394-4f33-41f0-b898-f0e1269cf5a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:23:12 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-10f4a9c5-5e90-4fd2-a495-768a66491abe tempest-VolumesAdminNegativeTest-1048946469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23694394-4f33-41f0-b898-f0e1269cf5a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:23:12 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-10f4a9c5-5e90-4fd2-a495-768a66491abe tempest-VolumesAdminNegativeTest-1048946469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63ab37f1-64da-499e-96ce-80a2cf872a2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:23:12 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-10f4a9c5-5e90-4fd2-a495-768a66491abe tempest-VolumesAdminNegativeTest-1048946469 None] Volume f092be3c-e1ae-422e-a1fe-1143f4139323: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f092be3c-e1ae-422e-a1fe-1143f4139323', 'volume_size': 1}
Jul 30 20:23:12 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-10f4a9c5-5e90-4fd2-a495-768a66491abe tempest-VolumesAdminNegativeTest-1048946469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:23:12 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-10f4a9c5-5e90-4fd2-a495-768a66491abe tempest-VolumesAdminNegativeTest-1048946469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:23:12 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-10f4a9c5-5e90-4fd2-a495-768a66491abe tempest-VolumesAdminNegativeTest-1048946469 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:23:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1240783841',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f092be3c-e1ae-422e-a1fe-1143f4139323,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c67edd06903404ea3289a5a37298a35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:23:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:23:12Z,use_quota=True,user_id='d9bce38038864a23acf21413afd71120',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:23:12 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-10f4a9c5-5e90-4fd2-a495-768a66491abe tempest-VolumesAdminNegativeTest-1048946469 None] Creating volume f092be3c-e1ae-422e-a1fe-1143f4139323 {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:23:12 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-10f4a9c5-5e90-4fd2-a495-768a66491abe tempest-VolumesAdminNegativeTest-1048946469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:23:12 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-10f4a9c5-5e90-4fd2-a495-768a66491abe tempest-VolumesAdminNegativeTest-1048946469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:23:12 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-10f4a9c5-5e90-4fd2-a495-768a66491abe tempest-VolumesAdminNegativeTest-1048946469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:23:12 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-10f4a9c5-5e90-4fd2-a495-768a66491abe tempest-VolumesAdminNegativeTest-1048946469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:23:12 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-10f4a9c5-5e90-4fd2-a495-768a66491abe tempest-VolumesAdminNegativeTest-1048946469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:23:12 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-10f4a9c5-5e90-4fd2-a495-768a66491abe tempest-VolumesAdminNegativeTest-1048946469 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:23:12 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-10f4a9c5-5e90-4fd2-a495-768a66491abe tempest-VolumesAdminNegativeTest-1048946469 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:23:12 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-10f4a9c5-5e90-4fd2-a495-768a66491abe tempest-VolumesAdminNegativeTest-1048946469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f092be3c-e1ae-422e-a1fe-1143f4139323 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:23:12 devstack sudo[89747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f092be3c-e1ae-422e-a1fe-1143f4139323 1073741824
Jul 30 20:23:12 devstack sudo[89747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:23:13 devstack sudo[89747]: pam_unix(sudo:session): session closed for user root
Jul 30 20:23:13 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-10f4a9c5-5e90-4fd2-a495-768a66491abe tempest-VolumesAdminNegativeTest-1048946469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f092be3c-e1ae-422e-a1fe-1143f4139323 1073741824" returned: 0 in 1.028s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:23:13 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-10f4a9c5-5e90-4fd2-a495-768a66491abe tempest-VolumesAdminNegativeTest-1048946469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f092be3c-e1ae-422e-a1fe-1143f4139323 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:23:13 devstack sudo[89769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f092be3c-e1ae-422e-a1fe-1143f4139323
Jul 30 20:23:13 devstack sudo[89769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:23:14 devstack sudo[89769]: pam_unix(sudo:session): session closed for user root
Jul 30 20:23:14 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-10f4a9c5-5e90-4fd2-a495-768a66491abe tempest-VolumesAdminNegativeTest-1048946469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f092be3c-e1ae-422e-a1fe-1143f4139323" returned: 0 in 0.747s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:23:14 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-10f4a9c5-5e90-4fd2-a495-768a66491abe tempest-VolumesAdminNegativeTest-1048946469 None] <== create_volume: return (1942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:23:14 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-10f4a9c5-5e90-4fd2-a495-768a66491abe tempest-VolumesAdminNegativeTest-1048946469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.944s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:23:14 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-10f4a9c5-5e90-4fd2-a495-768a66491abe tempest-VolumesAdminNegativeTest-1048946469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63ab37f1-64da-499e-96ce-80a2cf872a2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f092be3c-e1ae-422e-a1fe-1143f4139323', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:23:14 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-10f4a9c5-5e90-4fd2-a495-768a66491abe tempest-VolumesAdminNegativeTest-1048946469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe7c674e-e5bc-4640-b0d8-adb14ebf6846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:23:14 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-10f4a9c5-5e90-4fd2-a495-768a66491abe tempest-VolumesAdminNegativeTest-1048946469 None] Volume volume-f092be3c-e1ae-422e-a1fe-1143f4139323 (f092be3c-e1ae-422e-a1fe-1143f4139323): created successfully
Jul 30 20:23:14 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-10f4a9c5-5e90-4fd2-a495-768a66491abe tempest-VolumesAdminNegativeTest-1048946469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe7c674e-e5bc-4640-b0d8-adb14ebf6846) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:23:14 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-10f4a9c5-5e90-4fd2-a495-768a66491abe tempest-VolumesAdminNegativeTest-1048946469 None] Flow 'volume_create_manager' (a91e8119-8359-4581-8c0a-8a7603fdee08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:23:14 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-10f4a9c5-5e90-4fd2-a495-768a66491abe tempest-VolumesAdminNegativeTest-1048946469 None] Created volume successfully.
Jul 30 20:23:16 devstack cinder-volume[88719]: DEBUG oslo_service.periodic_task [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88719) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 30 20:23:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:23:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:23:16 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:23:16 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:23:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.044s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:23:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:23:16 devstack sudo[89852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:23:16 devstack sudo[89852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:23:17 devstack sudo[89852]: pam_unix(sudo:session): session closed for user root
Jul 30 20:23:17 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 1.193s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:23:17 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:23:17 devstack cinder-volume[88719]: DEBUG oslo_service.periodic_task [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Running periodic task VolumeManager._thread_info {{(pid=88719) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 30 20:23:17 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] thread count: 6 {{(pid=88719) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 30 20:23:17 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] thread info: [<_MainThread(MainThread, started 132390416908416)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132390306497536)>, <Thread(Thread-3 (stat_writer), started daemon 132390304471680)>, <Thread(Rabbit-heartbeat, started daemon 132390303393408)>, <Thread(Thread-5 (_runner), started daemon 132390303543168)>, <Thread(Thread-7 (_runner), started daemon 132390303563392)>] {{(pid=88719) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 30 20:23:18 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-b1b85979-92b0-4594-9d19-4b35293a5b9f tempest-VolumesAdminNegativeTest-1048946469 None] Acquiring lock "cinder-f092be3c-e1ae-422e-a1fe-1143f4139323-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:23:18 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-b1b85979-92b0-4594-9d19-4b35293a5b9f tempest-VolumesAdminNegativeTest-1048946469 None] Lock "cinder-f092be3c-e1ae-422e-a1fe-1143f4139323-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:23:18 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-b1b85979-92b0-4594-9d19-4b35293a5b9f tempest-VolumesAdminNegativeTest-1048946469 None] Acquiring lock "cinder-quobyte-f092be3c-e1ae-422e-a1fe-1143f4139323" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:23:18 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-b1b85979-92b0-4594-9d19-4b35293a5b9f tempest-VolumesAdminNegativeTest-1048946469 None] Lock "cinder-quobyte-f092be3c-e1ae-422e-a1fe-1143f4139323" acquired by "delete_volume" :: waited 0.027s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:23:18 devstack cinder-volume[88719]: INFO oslo.privsep.daemon [None req-b1b85979-92b0-4594-9d19-4b35293a5b9f tempest-VolumesAdminNegativeTest-1048946469 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpyg6qo85e/privsep.sock']
Jul 30 20:23:18 devstack sudo[89877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpyg6qo85e/privsep.sock
Jul 30 20:23:18 devstack sudo[89877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:23:20 devstack cinder-volume[88719]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning:
Jul 30 20:23:20 devstack cinder-volume[88719]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jul 30 20:23:20 devstack cinder-volume[88719]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Jul 30 20:23:20 devstack cinder-volume[88719]: WARNING oslo.privsep.daemon [-] privsep log: 
Jul 30 20:23:20 devstack cinder-volume[88719]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Jul 30 20:23:20 devstack cinder-volume[88719]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Jul 30 20:23:20 devstack cinder-volume[88719]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jul 30 20:23:20 devstack cinder-volume[88719]: WARNING oslo.privsep.daemon [-] privsep log: 
Jul 30 20:23:20 devstack cinder-volume[88719]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet
Jul 30 20:23:21 devstack sudo[89877]: pam_unix(sudo:session): session closed for user root
Jul 30 20:23:21 devstack cinder-volume[88719]: INFO oslo.privsep.daemon [None req-b1b85979-92b0-4594-9d19-4b35293a5b9f tempest-VolumesAdminNegativeTest-1048946469 None] Spawned new privsep daemon via rootwrap
Jul 30 20:23:21 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [None req-b1b85979-92b0-4594-9d19-4b35293a5b9f tempest-VolumesAdminNegativeTest-1048946469 None] Accepted privsep connection to /tmp/tmpyg6qo85e/privsep.sock {{(pid=88719) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}}
Jul 30 20:23:21 devstack cinder-volume[88719]: INFO oslo.privsep.daemon [-] privsep daemon starting
Jul 30 20:23:21 devstack cinder-volume[88719]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Jul 30 20:23:21 devstack cinder-volume[88719]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Jul 30 20:23:21 devstack cinder-volume[88719]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 89911
Jul 30 20:23:21 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[a17e3564-50cf-4786-85e6-183b0cf0f3ea]: (2,) {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:23:21 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[4932e608-8d15-4066-a275-c6cb0d560526]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:23:21 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-b1b85979-92b0-4594-9d19-4b35293a5b9f tempest-VolumesAdminNegativeTest-1048946469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f092be3c-e1ae-422e-a1fe-1143f4139323 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:23:21 devstack sudo[89913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f092be3c-e1ae-422e-a1fe-1143f4139323
Jul 30 20:23:21 devstack sudo[89913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:23:22 devstack sudo[89913]: pam_unix(sudo:session): session closed for user root
Jul 30 20:23:22 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-b1b85979-92b0-4594-9d19-4b35293a5b9f tempest-VolumesAdminNegativeTest-1048946469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f092be3c-e1ae-422e-a1fe-1143f4139323" returned: 0 in 0.997s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:23:22 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-b1b85979-92b0-4594-9d19-4b35293a5b9f tempest-VolumesAdminNegativeTest-1048946469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f092be3c-e1ae-422e-a1fe-1143f4139323 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:23:22 devstack sudo[89918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f092be3c-e1ae-422e-a1fe-1143f4139323
Jul 30 20:23:22 devstack sudo[89918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:23:23 devstack sudo[89918]: pam_unix(sudo:session): session closed for user root
Jul 30 20:23:23 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-b1b85979-92b0-4594-9d19-4b35293a5b9f tempest-VolumesAdminNegativeTest-1048946469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f092be3c-e1ae-422e-a1fe-1143f4139323" returned: 0 in 0.488s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:23:23 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-b1b85979-92b0-4594-9d19-4b35293a5b9f tempest-VolumesAdminNegativeTest-1048946469 None] Lock "cinder-quobyte-f092be3c-e1ae-422e-a1fe-1143f4139323" released by "delete_volume" :: held 4.847s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:23:23 devstack cinder-volume[88719]: WARNING cinder.quota [None req-b1b85979-92b0-4594-9d19-4b35293a5b9f tempest-VolumesAdminNegativeTest-1048946469 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Jul 30 20:23:23 devstack cinder-volume[88719]: WARNING cinder.quota [None req-b1b85979-92b0-4594-9d19-4b35293a5b9f tempest-VolumesAdminNegativeTest-1048946469 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Jul 30 20:23:23 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-b1b85979-92b0-4594-9d19-4b35293a5b9f tempest-VolumesAdminNegativeTest-1048946469 None] Created reservations ['9933127a-4335-46d1-b3aa-7748a9dff1ef', '1789a97e-2e36-44dd-8cdd-f03357e4ac36', '69d67949-8df3-4bf5-aa93-665a722abb57', 'd2d9bf9b-0acf-4b60-9b74-1466036a6fa0'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:23:23 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-b1b85979-92b0-4594-9d19-4b35293a5b9f tempest-VolumesAdminNegativeTest-1048946469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:23:23 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-b1b85979-92b0-4594-9d19-4b35293a5b9f tempest-VolumesAdminNegativeTest-1048946469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:23:23 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-b1b85979-92b0-4594-9d19-4b35293a5b9f tempest-VolumesAdminNegativeTest-1048946469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:23:23 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-b1b85979-92b0-4594-9d19-4b35293a5b9f tempest-VolumesAdminNegativeTest-1048946469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:23:23 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-b1b85979-92b0-4594-9d19-4b35293a5b9f tempest-VolumesAdminNegativeTest-1048946469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:23:23 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-b1b85979-92b0-4594-9d19-4b35293a5b9f tempest-VolumesAdminNegativeTest-1048946469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:23:23 devstack sudo[89922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:23:23 devstack sudo[89922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:23:23 devstack sudo[89922]: pam_unix(sudo:session): session closed for user root
Jul 30 20:23:23 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-b1b85979-92b0-4594-9d19-4b35293a5b9f tempest-VolumesAdminNegativeTest-1048946469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.463s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:23:23 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-b1b85979-92b0-4594-9d19-4b35293a5b9f tempest-VolumesAdminNegativeTest-1048946469 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:23:23 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-b1b85979-92b0-4594-9d19-4b35293a5b9f tempest-VolumesAdminNegativeTest-1048946469 None] Deleted volume successfully.
Jul 30 20:23:23 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-b1b85979-92b0-4594-9d19-4b35293a5b9f tempest-VolumesAdminNegativeTest-1048946469 None] Lock "cinder-f092be3c-e1ae-422e-a1fe-1143f4139323-delete_volume" released by "delete_volume" :: held 5.812s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:23:33 devstack cinder-volume[88719]: DEBUG dbcounter [-] [88719] Writing DB stats cinder:SELECT=7,cinder:UPDATE=14,cinder:DELETE=1,cinder:INSERT=3 {{(pid=88719) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 30 20:23:33 devstack cinder-volume[88719]: DEBUG dbcounter [-] [88719] Writing DB stats cinder:SELECT=7,cinder:UPDATE=8,cinder:INSERT=2,cinder:DELETE=1 {{(pid=88719) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 30 20:23:40 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-a81e7799-af05-4844-b431-547d1ee7f6fe tempest-ServerActionsTestOtherA-940473852 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:23:40 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-a81e7799-af05-4844-b431-547d1ee7f6fe tempest-ServerActionsTestOtherA-940473852 None] Flow 'volume_create_manager' (932c3953-d660-4e6d-abe9-a12b89d006c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:23:40 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-a81e7799-af05-4844-b431-547d1ee7f6fe tempest-ServerActionsTestOtherA-940473852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3329019b-f198-4be7-bedc-45653b82b27f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:23:40 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-a81e7799-af05-4844-b431-547d1ee7f6fe tempest-ServerActionsTestOtherA-940473852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3329019b-f198-4be7-bedc-45653b82b27f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:23:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-220606050',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d517758-bd22-4132-aea6-50f086cc96e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c82cb68187b54e71bcb57fbc8e8dc037',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:23:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:23:40Z,use_quota=True,user_id='e23dff6da0bd449da39a7a044515da5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:23:40 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-a81e7799-af05-4844-b431-547d1ee7f6fe tempest-ServerActionsTestOtherA-940473852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5102ae6-cf4d-49cf-9a59-b8dcd814f6ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:23:40 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-a81e7799-af05-4844-b431-547d1ee7f6fe tempest-ServerActionsTestOtherA-940473852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5102ae6-cf4d-49cf-9a59-b8dcd814f6ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:23:40 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-a81e7799-af05-4844-b431-547d1ee7f6fe tempest-ServerActionsTestOtherA-940473852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74d8e340-f8b7-4596-97e5-2f0faca870cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:23:40 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-a81e7799-af05-4844-b431-547d1ee7f6fe tempest-ServerActionsTestOtherA-940473852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74d8e340-f8b7-4596-97e5-2f0faca870cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d517758-bd22-4132-aea6-50f086cc96e0', 'volume_name': 'volume-1d517758-bd22-4132-aea6-50f086cc96e0', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:23:40 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-a81e7799-af05-4844-b431-547d1ee7f6fe tempest-ServerActionsTestOtherA-940473852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54271209-bb8a-4c27-b7e8-bbc39668c5b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:23:40 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-a81e7799-af05-4844-b431-547d1ee7f6fe tempest-ServerActionsTestOtherA-940473852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54271209-bb8a-4c27-b7e8-bbc39668c5b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:23:40 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-a81e7799-af05-4844-b431-547d1ee7f6fe tempest-ServerActionsTestOtherA-940473852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f21a7fa-e653-426b-a6a0-e89050a29c68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:23:40 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-a81e7799-af05-4844-b431-547d1ee7f6fe tempest-ServerActionsTestOtherA-940473852 None] Volume 1d517758-bd22-4132-aea6-50f086cc96e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d517758-bd22-4132-aea6-50f086cc96e0', 'volume_size': 1}
Jul 30 20:23:40 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-a81e7799-af05-4844-b431-547d1ee7f6fe tempest-ServerActionsTestOtherA-940473852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:23:40 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-a81e7799-af05-4844-b431-547d1ee7f6fe tempest-ServerActionsTestOtherA-940473852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:23:40 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-a81e7799-af05-4844-b431-547d1ee7f6fe tempest-ServerActionsTestOtherA-940473852 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:23:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-220606050',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d517758-bd22-4132-aea6-50f086cc96e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c82cb68187b54e71bcb57fbc8e8dc037',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:23:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:23:40Z,use_quota=True,user_id='e23dff6da0bd449da39a7a044515da5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:23:40 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-a81e7799-af05-4844-b431-547d1ee7f6fe tempest-ServerActionsTestOtherA-940473852 None] Creating volume 1d517758-bd22-4132-aea6-50f086cc96e0 {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:23:40 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-a81e7799-af05-4844-b431-547d1ee7f6fe tempest-ServerActionsTestOtherA-940473852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:23:40 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-a81e7799-af05-4844-b431-547d1ee7f6fe tempest-ServerActionsTestOtherA-940473852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:23:40 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-a81e7799-af05-4844-b431-547d1ee7f6fe tempest-ServerActionsTestOtherA-940473852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:23:40 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-a81e7799-af05-4844-b431-547d1ee7f6fe tempest-ServerActionsTestOtherA-940473852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:23:40 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-a81e7799-af05-4844-b431-547d1ee7f6fe tempest-ServerActionsTestOtherA-940473852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:23:40 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-a81e7799-af05-4844-b431-547d1ee7f6fe tempest-ServerActionsTestOtherA-940473852 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:23:40 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-a81e7799-af05-4844-b431-547d1ee7f6fe tempest-ServerActionsTestOtherA-940473852 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:23:40 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-a81e7799-af05-4844-b431-547d1ee7f6fe tempest-ServerActionsTestOtherA-940473852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1d517758-bd22-4132-aea6-50f086cc96e0 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:23:40 devstack sudo[90052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1d517758-bd22-4132-aea6-50f086cc96e0 1073741824
Jul 30 20:23:40 devstack sudo[90052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:23:41 devstack sudo[90052]: pam_unix(sudo:session): session closed for user root
Jul 30 20:23:41 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-a81e7799-af05-4844-b431-547d1ee7f6fe tempest-ServerActionsTestOtherA-940473852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1d517758-bd22-4132-aea6-50f086cc96e0 1073741824" returned: 0 in 0.721s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:23:41 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-a81e7799-af05-4844-b431-547d1ee7f6fe tempest-ServerActionsTestOtherA-940473852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1d517758-bd22-4132-aea6-50f086cc96e0 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:23:41 devstack sudo[90070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1d517758-bd22-4132-aea6-50f086cc96e0
Jul 30 20:23:41 devstack sudo[90070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:23:41 devstack sudo[90070]: pam_unix(sudo:session): session closed for user root
Jul 30 20:23:41 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-a81e7799-af05-4844-b431-547d1ee7f6fe tempest-ServerActionsTestOtherA-940473852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1d517758-bd22-4132-aea6-50f086cc96e0" returned: 0 in 0.448s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:23:41 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-a81e7799-af05-4844-b431-547d1ee7f6fe tempest-ServerActionsTestOtherA-940473852 None] <== create_volume: return (1236ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:23:41 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-a81e7799-af05-4844-b431-547d1ee7f6fe tempest-ServerActionsTestOtherA-940473852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.240s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:23:41 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-a81e7799-af05-4844-b431-547d1ee7f6fe tempest-ServerActionsTestOtherA-940473852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f21a7fa-e653-426b-a6a0-e89050a29c68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d517758-bd22-4132-aea6-50f086cc96e0', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:23:41 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-a81e7799-af05-4844-b431-547d1ee7f6fe tempest-ServerActionsTestOtherA-940473852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eaeaa303-9030-4df0-b164-9981505cf7a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:23:41 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-a81e7799-af05-4844-b431-547d1ee7f6fe tempest-ServerActionsTestOtherA-940473852 None] Volume volume-1d517758-bd22-4132-aea6-50f086cc96e0 (1d517758-bd22-4132-aea6-50f086cc96e0): created successfully
Jul 30 20:23:41 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-a81e7799-af05-4844-b431-547d1ee7f6fe tempest-ServerActionsTestOtherA-940473852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eaeaa303-9030-4df0-b164-9981505cf7a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:23:41 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-a81e7799-af05-4844-b431-547d1ee7f6fe tempest-ServerActionsTestOtherA-940473852 None] Flow 'volume_create_manager' (932c3953-d660-4e6d-abe9-a12b89d006c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:23:41 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-a81e7799-af05-4844-b431-547d1ee7f6fe tempest-ServerActionsTestOtherA-940473852 None] Created volume successfully.
Jul 30 20:23:51 devstack cinder-volume[88719]: DEBUG dbcounter [-] [88719] Writing DB stats cinder:UPDATE=4,cinder:SELECT=2,cinder:DELETE=1 {{(pid=88719) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 30 20:23:59 devstack cinder-volume[88719]: DEBUG dbcounter [-] [88719] Writing DB stats cinder:SELECT=3,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=88719) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 30 20:24:08 devstack cinder-volume[88719]: WARNING py.warnings [req-e8dfd3d3-2459-4a27-acda-9265f749d909 req-11da724a-aede-47ae-ab17-4c45b8758523 tempest-TaggedAttachmentsTest-1313745184 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes_1", "volume_attachment" and FROM element "volumes".  Apply join condition(s) between each element to resolve.
Jul 30 20:24:08 devstack cinder-volume[88719]:   .first()
Jul 30 20:24:08 devstack cinder-volume[88719]: 
Jul 30 20:24:08 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [req-e8dfd3d3-2459-4a27-acda-9265f749d909 req-11da724a-aede-47ae-ab17-4c45b8758523 tempest-TaggedAttachmentsTest-1313745184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:24:08 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [req-e8dfd3d3-2459-4a27-acda-9265f749d909 req-11da724a-aede-47ae-ab17-4c45b8758523 tempest-TaggedAttachmentsTest-1313745184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:24:08 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [req-e8dfd3d3-2459-4a27-acda-9265f749d909 req-11da724a-aede-47ae-ab17-4c45b8758523 tempest-TaggedAttachmentsTest-1313745184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.052s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:24:08 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [req-e8dfd3d3-2459-4a27-acda-9265f749d909 req-11da724a-aede-47ae-ab17-4c45b8758523 tempest-TaggedAttachmentsTest-1313745184 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5', 'name': 'volume-3467229e-66c1-4914-b88a-eef1c4a467b2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '738e93bb-2ace-4374-9bf0-4a17d4bb4a83', 'enforce_multipath': True} {{(pid=88719) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 30 20:24:08 devstack cinder-volume[88719]: INFO cinder.volume.manager [req-e8dfd3d3-2459-4a27-acda-9265f749d909 req-11da724a-aede-47ae-ab17-4c45b8758523 tempest-TaggedAttachmentsTest-1313745184 None] attachment_update completed successfully.
Jul 30 20:24:12 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-621260b3-763c-4357-a917-4e2befef7e2a tempest-ServerRescueNegativeTestJSON-1380420888 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:24:12 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-621260b3-763c-4357-a917-4e2befef7e2a tempest-ServerRescueNegativeTestJSON-1380420888 None] Flow 'volume_create_manager' (169dd359-86bf-4d9e-8e21-04dfa198afcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:24:12 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-621260b3-763c-4357-a917-4e2befef7e2a tempest-ServerRescueNegativeTestJSON-1380420888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3cc01be-ed05-472b-a4ac-2f2f582e5857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:24:12 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-621260b3-763c-4357-a917-4e2befef7e2a tempest-ServerRescueNegativeTestJSON-1380420888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3cc01be-ed05-472b-a4ac-2f2f582e5857) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:24:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-874147543',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68687829-0ce7-4153-9eea-901d74ce9b89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef2baaaf02b1492e86969d87cbb94b01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:24:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:24:12Z,use_quota=True,user_id='5caec2ae6c38428e8b15894fbadd1897',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:24:12 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-621260b3-763c-4357-a917-4e2befef7e2a tempest-ServerRescueNegativeTestJSON-1380420888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e114275f-e656-4060-8288-69025b322953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:24:12 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-621260b3-763c-4357-a917-4e2befef7e2a tempest-ServerRescueNegativeTestJSON-1380420888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e114275f-e656-4060-8288-69025b322953) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:24:12 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-621260b3-763c-4357-a917-4e2befef7e2a tempest-ServerRescueNegativeTestJSON-1380420888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e21b579-e641-44ff-bc2d-69fde9cb95ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:24:12 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-621260b3-763c-4357-a917-4e2befef7e2a tempest-ServerRescueNegativeTestJSON-1380420888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e21b579-e641-44ff-bc2d-69fde9cb95ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68687829-0ce7-4153-9eea-901d74ce9b89', 'volume_name': 'volume-68687829-0ce7-4153-9eea-901d74ce9b89', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:24:12 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-621260b3-763c-4357-a917-4e2befef7e2a tempest-ServerRescueNegativeTestJSON-1380420888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f611b46-0542-4d4d-8ce2-abf60fa9e05d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:24:12 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-621260b3-763c-4357-a917-4e2befef7e2a tempest-ServerRescueNegativeTestJSON-1380420888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f611b46-0542-4d4d-8ce2-abf60fa9e05d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:24:12 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-621260b3-763c-4357-a917-4e2befef7e2a tempest-ServerRescueNegativeTestJSON-1380420888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (708533cc-a19a-4711-88a8-9c317abf3118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:24:12 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-621260b3-763c-4357-a917-4e2befef7e2a tempest-ServerRescueNegativeTestJSON-1380420888 None] Volume 68687829-0ce7-4153-9eea-901d74ce9b89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68687829-0ce7-4153-9eea-901d74ce9b89', 'volume_size': 1}
Jul 30 20:24:12 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-621260b3-763c-4357-a917-4e2befef7e2a tempest-ServerRescueNegativeTestJSON-1380420888 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:24:12 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-621260b3-763c-4357-a917-4e2befef7e2a tempest-ServerRescueNegativeTestJSON-1380420888 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:24:12 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-621260b3-763c-4357-a917-4e2befef7e2a tempest-ServerRescueNegativeTestJSON-1380420888 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:24:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-874147543',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68687829-0ce7-4153-9eea-901d74ce9b89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef2baaaf02b1492e86969d87cbb94b01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:24:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:24:12Z,use_quota=True,user_id='5caec2ae6c38428e8b15894fbadd1897',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:24:12 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-621260b3-763c-4357-a917-4e2befef7e2a tempest-ServerRescueNegativeTestJSON-1380420888 None] Creating volume 68687829-0ce7-4153-9eea-901d74ce9b89 {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:24:12 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-621260b3-763c-4357-a917-4e2befef7e2a tempest-ServerRescueNegativeTestJSON-1380420888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:24:12 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-621260b3-763c-4357-a917-4e2befef7e2a tempest-ServerRescueNegativeTestJSON-1380420888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:24:12 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-621260b3-763c-4357-a917-4e2befef7e2a tempest-ServerRescueNegativeTestJSON-1380420888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:24:12 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-621260b3-763c-4357-a917-4e2befef7e2a tempest-ServerRescueNegativeTestJSON-1380420888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:24:12 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-621260b3-763c-4357-a917-4e2befef7e2a tempest-ServerRescueNegativeTestJSON-1380420888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:24:12 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-621260b3-763c-4357-a917-4e2befef7e2a tempest-ServerRescueNegativeTestJSON-1380420888 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:24:12 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-621260b3-763c-4357-a917-4e2befef7e2a tempest-ServerRescueNegativeTestJSON-1380420888 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:24:12 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-621260b3-763c-4357-a917-4e2befef7e2a tempest-ServerRescueNegativeTestJSON-1380420888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-68687829-0ce7-4153-9eea-901d74ce9b89 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:24:12 devstack sudo[90942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-68687829-0ce7-4153-9eea-901d74ce9b89 1073741824
Jul 30 20:24:12 devstack sudo[90942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:24:13 devstack sudo[90942]: pam_unix(sudo:session): session closed for user root
Jul 30 20:24:13 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-621260b3-763c-4357-a917-4e2befef7e2a tempest-ServerRescueNegativeTestJSON-1380420888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-68687829-0ce7-4153-9eea-901d74ce9b89 1073741824" returned: 0 in 1.006s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:24:13 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-621260b3-763c-4357-a917-4e2befef7e2a tempest-ServerRescueNegativeTestJSON-1380420888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-68687829-0ce7-4153-9eea-901d74ce9b89 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:24:13 devstack sudo[90949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-68687829-0ce7-4153-9eea-901d74ce9b89
Jul 30 20:24:13 devstack sudo[90949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:24:13 devstack sudo[90949]: pam_unix(sudo:session): session closed for user root
Jul 30 20:24:14 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-621260b3-763c-4357-a917-4e2befef7e2a tempest-ServerRescueNegativeTestJSON-1380420888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-68687829-0ce7-4153-9eea-901d74ce9b89" returned: 0 in 0.447s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:24:14 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-621260b3-763c-4357-a917-4e2befef7e2a tempest-ServerRescueNegativeTestJSON-1380420888 None] <== create_volume: return (1566ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:24:14 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-621260b3-763c-4357-a917-4e2befef7e2a tempest-ServerRescueNegativeTestJSON-1380420888 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.569s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:24:14 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-621260b3-763c-4357-a917-4e2befef7e2a tempest-ServerRescueNegativeTestJSON-1380420888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (708533cc-a19a-4711-88a8-9c317abf3118) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68687829-0ce7-4153-9eea-901d74ce9b89', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:24:14 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-621260b3-763c-4357-a917-4e2befef7e2a tempest-ServerRescueNegativeTestJSON-1380420888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a852c48-983b-4ea9-9207-92d1e022d419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:24:14 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-621260b3-763c-4357-a917-4e2befef7e2a tempest-ServerRescueNegativeTestJSON-1380420888 None] Volume volume-68687829-0ce7-4153-9eea-901d74ce9b89 (68687829-0ce7-4153-9eea-901d74ce9b89): created successfully
Jul 30 20:24:14 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-621260b3-763c-4357-a917-4e2befef7e2a tempest-ServerRescueNegativeTestJSON-1380420888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a852c48-983b-4ea9-9207-92d1e022d419) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:24:14 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-621260b3-763c-4357-a917-4e2befef7e2a tempest-ServerRescueNegativeTestJSON-1380420888 None] Flow 'volume_create_manager' (169dd359-86bf-4d9e-8e21-04dfa198afcb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:24:14 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-621260b3-763c-4357-a917-4e2befef7e2a tempest-ServerRescueNegativeTestJSON-1380420888 None] Created volume successfully.
Jul 30 20:24:14 devstack cinder-volume[88719]: INFO cinder.volume.manager [req-1e929abc-f29a-45b5-b6dd-9eada6ce74af req-39c29e0c-1409-497b-a28b-1d51a54da5d8 tempest-TaggedAttachmentsTest-1313745184 None] Terminate volume connection completed successfully.
Jul 30 20:24:14 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [req-1e929abc-f29a-45b5-b6dd-9eada6ce74af req-39c29e0c-1409-497b-a28b-1d51a54da5d8 tempest-TaggedAttachmentsTest-1313745184 None] Deleting attachment 738e93bb-2ace-4374-9bf0-4a17d4bb4a83. {{(pid=88719) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 30 20:24:16 devstack cinder-volume[88719]: DEBUG oslo_service.periodic_task [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88719) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 30 20:24:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:24:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:24:16 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:24:16 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:24:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:24:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:24:16 devstack sudo[90988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:24:16 devstack sudo[90988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:24:17 devstack sudo[90988]: pam_unix(sudo:session): session closed for user root
Jul 30 20:24:17 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 1.369s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:24:17 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:24:17 devstack cinder-volume[88719]: DEBUG oslo_service.periodic_task [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Running periodic task VolumeManager._thread_info {{(pid=88719) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 30 20:24:17 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] thread count: 8 {{(pid=88719) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 30 20:24:17 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] thread info: [<_MainThread(MainThread, started 132390416908416)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132390306497536)>, <Thread(Thread-3 (stat_writer), started daemon 132390304471680)>, <Thread(Rabbit-heartbeat, started daemon 132390303393408)>, <Thread(Thread-5 (_runner), started daemon 132390303543168)>, <Thread(Thread-7 (_runner), started daemon 132390303563392)>, <Thread(fd_logger, started daemon 132390301344640)>, <Thread(privsep_reader, started daemon 132390301560640)>] {{(pid=88719) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 30 20:24:24 devstack cinder-volume[88719]: DEBUG dbcounter [-] [88719] Writing DB stats cinder:SELECT=7,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=88719) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 30 20:24:24 devstack cinder-volume[88719]: DEBUG dbcounter [-] [88719] Writing DB stats cinder:SELECT=12,cinder:UPDATE=3,cinder:INSERT=1 {{(pid=88719) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 30 20:24:28 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-44986404-a42c-4d57-a5f7-1f70c1355110 tempest-TaggedAttachmentsTest-1313745184 None] Acquiring lock "cinder-3467229e-66c1-4914-b88a-eef1c4a467b2-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:24:28 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-44986404-a42c-4d57-a5f7-1f70c1355110 tempest-TaggedAttachmentsTest-1313745184 None] Lock "cinder-3467229e-66c1-4914-b88a-eef1c4a467b2-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:24:28 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-44986404-a42c-4d57-a5f7-1f70c1355110 tempest-TaggedAttachmentsTest-1313745184 None] Acquiring lock "cinder-quobyte-3467229e-66c1-4914-b88a-eef1c4a467b2" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:24:28 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-44986404-a42c-4d57-a5f7-1f70c1355110 tempest-TaggedAttachmentsTest-1313745184 None] Lock "cinder-quobyte-3467229e-66c1-4914-b88a-eef1c4a467b2" acquired by "delete_volume" :: waited 0.062s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:24:28 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[df1bdaf1-cc1e-4166-831e-5b51320d90fc]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:24:28 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-44986404-a42c-4d57-a5f7-1f70c1355110 tempest-TaggedAttachmentsTest-1313745184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3467229e-66c1-4914-b88a-eef1c4a467b2 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:24:29 devstack sudo[91210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3467229e-66c1-4914-b88a-eef1c4a467b2
Jul 30 20:24:29 devstack sudo[91210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:24:29 devstack sudo[91210]: pam_unix(sudo:session): session closed for user root
Jul 30 20:24:29 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-44986404-a42c-4d57-a5f7-1f70c1355110 tempest-TaggedAttachmentsTest-1313745184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3467229e-66c1-4914-b88a-eef1c4a467b2" returned: 0 in 0.755s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:24:29 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-44986404-a42c-4d57-a5f7-1f70c1355110 tempest-TaggedAttachmentsTest-1313745184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3467229e-66c1-4914-b88a-eef1c4a467b2 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:24:29 devstack sudo[91220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3467229e-66c1-4914-b88a-eef1c4a467b2
Jul 30 20:24:29 devstack sudo[91220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:24:29 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-2297aa09-5827-4ef7-a6bb-e168b15effc2 tempest-ServerRescueNegativeTestJSON-1380420888 None] Acquiring lock "cinder-68687829-0ce7-4153-9eea-901d74ce9b89-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:24:29 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-2297aa09-5827-4ef7-a6bb-e168b15effc2 tempest-ServerRescueNegativeTestJSON-1380420888 None] Lock "cinder-68687829-0ce7-4153-9eea-901d74ce9b89-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:24:29 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-2297aa09-5827-4ef7-a6bb-e168b15effc2 tempest-ServerRescueNegativeTestJSON-1380420888 None] Acquiring lock "cinder-quobyte-68687829-0ce7-4153-9eea-901d74ce9b89" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:24:29 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-2297aa09-5827-4ef7-a6bb-e168b15effc2 tempest-ServerRescueNegativeTestJSON-1380420888 None] Lock "cinder-quobyte-68687829-0ce7-4153-9eea-901d74ce9b89" acquired by "delete_volume" :: waited 0.031s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:24:29 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3b65c47-ae84-4c12-b3f1-27304929590f]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:24:29 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2297aa09-5827-4ef7-a6bb-e168b15effc2 tempest-ServerRescueNegativeTestJSON-1380420888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-68687829-0ce7-4153-9eea-901d74ce9b89 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:24:29 devstack sudo[91220]: pam_unix(sudo:session): session closed for user root
Jul 30 20:24:29 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-44986404-a42c-4d57-a5f7-1f70c1355110 tempest-TaggedAttachmentsTest-1313745184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3467229e-66c1-4914-b88a-eef1c4a467b2" returned: 0 in 0.441s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:24:29 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-44986404-a42c-4d57-a5f7-1f70c1355110 tempest-TaggedAttachmentsTest-1313745184 None] Lock "cinder-quobyte-3467229e-66c1-4914-b88a-eef1c4a467b2" released by "delete_volume" :: held 1.293s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:24:30 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-44986404-a42c-4d57-a5f7-1f70c1355110 tempest-TaggedAttachmentsTest-1313745184 None] Created reservations ['e3555665-3fa2-4fdf-8f30-6120ad60fca3', '5675252b-563f-428e-9725-17b694f9a846', '4490589f-603f-4952-a93e-e11873a61ca0', '90111d64-223e-4bbb-bed9-cc335e5294b0'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:24:30 devstack sudo[91229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-68687829-0ce7-4153-9eea-901d74ce9b89
Jul 30 20:24:30 devstack sudo[91229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:24:30 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-44986404-a42c-4d57-a5f7-1f70c1355110 tempest-TaggedAttachmentsTest-1313745184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:24:30 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-44986404-a42c-4d57-a5f7-1f70c1355110 tempest-TaggedAttachmentsTest-1313745184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:24:30 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-44986404-a42c-4d57-a5f7-1f70c1355110 tempest-TaggedAttachmentsTest-1313745184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:24:30 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-44986404-a42c-4d57-a5f7-1f70c1355110 tempest-TaggedAttachmentsTest-1313745184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:24:30 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-44986404-a42c-4d57-a5f7-1f70c1355110 tempest-TaggedAttachmentsTest-1313745184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:24:30 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-44986404-a42c-4d57-a5f7-1f70c1355110 tempest-TaggedAttachmentsTest-1313745184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:24:30 devstack sudo[91238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:24:30 devstack sudo[91238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:24:30 devstack sudo[91229]: pam_unix(sudo:session): session closed for user root
Jul 30 20:24:30 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2297aa09-5827-4ef7-a6bb-e168b15effc2 tempest-ServerRescueNegativeTestJSON-1380420888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-68687829-0ce7-4153-9eea-901d74ce9b89" returned: 0 in 0.858s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:24:30 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2297aa09-5827-4ef7-a6bb-e168b15effc2 tempest-ServerRescueNegativeTestJSON-1380420888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-68687829-0ce7-4153-9eea-901d74ce9b89 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:24:30 devstack sudo[91248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-68687829-0ce7-4153-9eea-901d74ce9b89
Jul 30 20:24:30 devstack sudo[91248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:24:31 devstack sudo[91238]: pam_unix(sudo:session): session closed for user root
Jul 30 20:24:31 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-44986404-a42c-4d57-a5f7-1f70c1355110 tempest-TaggedAttachmentsTest-1313745184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.615s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:24:31 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-44986404-a42c-4d57-a5f7-1f70c1355110 tempest-TaggedAttachmentsTest-1313745184 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:24:31 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-44986404-a42c-4d57-a5f7-1f70c1355110 tempest-TaggedAttachmentsTest-1313745184 None] Deleted volume successfully.
Jul 30 20:24:31 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-44986404-a42c-4d57-a5f7-1f70c1355110 tempest-TaggedAttachmentsTest-1313745184 None] Lock "cinder-3467229e-66c1-4914-b88a-eef1c4a467b2-delete_volume" released by "delete_volume" :: held 2.552s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:24:31 devstack sudo[91248]: pam_unix(sudo:session): session closed for user root
Jul 30 20:24:31 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2297aa09-5827-4ef7-a6bb-e168b15effc2 tempest-ServerRescueNegativeTestJSON-1380420888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-68687829-0ce7-4153-9eea-901d74ce9b89" returned: 0 in 0.564s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:24:31 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-2297aa09-5827-4ef7-a6bb-e168b15effc2 tempest-ServerRescueNegativeTestJSON-1380420888 None] Lock "cinder-quobyte-68687829-0ce7-4153-9eea-901d74ce9b89" released by "delete_volume" :: held 1.524s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:24:31 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-2297aa09-5827-4ef7-a6bb-e168b15effc2 tempest-ServerRescueNegativeTestJSON-1380420888 None] Created reservations ['2fb50ac7-ebe7-4c9c-b589-c0ef419e46ea', '516bfe30-3ce4-43f5-99b2-f66e247d94fb', 'c6ebe0d4-2602-4241-bd38-1cca627f0120', '39aec2e9-2cc3-4688-9dd7-796f03fa278d'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:24:31 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-2297aa09-5827-4ef7-a6bb-e168b15effc2 tempest-ServerRescueNegativeTestJSON-1380420888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:24:31 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-2297aa09-5827-4ef7-a6bb-e168b15effc2 tempest-ServerRescueNegativeTestJSON-1380420888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:24:31 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-2297aa09-5827-4ef7-a6bb-e168b15effc2 tempest-ServerRescueNegativeTestJSON-1380420888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:24:31 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-2297aa09-5827-4ef7-a6bb-e168b15effc2 tempest-ServerRescueNegativeTestJSON-1380420888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:24:31 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-2297aa09-5827-4ef7-a6bb-e168b15effc2 tempest-ServerRescueNegativeTestJSON-1380420888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:24:31 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2297aa09-5827-4ef7-a6bb-e168b15effc2 tempest-ServerRescueNegativeTestJSON-1380420888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:24:31 devstack sudo[91260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:24:31 devstack sudo[91260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:24:31 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [req-2958d393-6846-4e95-8f57-3da766ffec6f req-10f980fc-de67-43ce-960d-52dd40e899ca tempest-ServerActionsTestOtherA-940473852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:24:31 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [req-2958d393-6846-4e95-8f57-3da766ffec6f req-10f980fc-de67-43ce-960d-52dd40e899ca tempest-ServerActionsTestOtherA-940473852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:24:31 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [req-2958d393-6846-4e95-8f57-3da766ffec6f req-10f980fc-de67-43ce-960d-52dd40e899ca tempest-ServerActionsTestOtherA-940473852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:24:31 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [req-2958d393-6846-4e95-8f57-3da766ffec6f req-10f980fc-de67-43ce-960d-52dd40e899ca tempest-ServerActionsTestOtherA-940473852 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5', 'name': 'volume-1d517758-bd22-4132-aea6-50f086cc96e0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7f26a820-8a81-4156-a8e9-b043212a08d9', 'enforce_multipath': True} {{(pid=88719) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 30 20:24:32 devstack cinder-volume[88719]: INFO cinder.volume.manager [req-2958d393-6846-4e95-8f57-3da766ffec6f req-10f980fc-de67-43ce-960d-52dd40e899ca tempest-ServerActionsTestOtherA-940473852 None] attachment_update completed successfully.
Jul 30 20:24:32 devstack sudo[91260]: pam_unix(sudo:session): session closed for user root
Jul 30 20:24:32 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2297aa09-5827-4ef7-a6bb-e168b15effc2 tempest-ServerRescueNegativeTestJSON-1380420888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.455s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:24:32 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-2297aa09-5827-4ef7-a6bb-e168b15effc2 tempest-ServerRescueNegativeTestJSON-1380420888 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:24:32 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-2297aa09-5827-4ef7-a6bb-e168b15effc2 tempest-ServerRescueNegativeTestJSON-1380420888 None] Deleted volume successfully.
Jul 30 20:24:32 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-2297aa09-5827-4ef7-a6bb-e168b15effc2 tempest-ServerRescueNegativeTestJSON-1380420888 None] Lock "cinder-68687829-0ce7-4153-9eea-901d74ce9b89-delete_volume" released by "delete_volume" :: held 2.423s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:24:40 devstack cinder-volume[88719]: INFO cinder.volume.manager [req-e0f46bdd-1ef8-4963-bcc5-203e6236d591 req-d5d16b93-8cf7-4877-a0ff-ab2376da9cb1 tempest-ServerActionsTestOtherA-940473852 None] Terminate volume connection completed successfully.
Jul 30 20:24:40 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [req-e0f46bdd-1ef8-4963-bcc5-203e6236d591 req-d5d16b93-8cf7-4877-a0ff-ab2376da9cb1 tempest-ServerActionsTestOtherA-940473852 None] Deleting attachment 7f26a820-8a81-4156-a8e9-b043212a08d9. {{(pid=88719) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 30 20:24:42 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [req-e0f46bdd-1ef8-4963-bcc5-203e6236d591 req-87da42b7-a68a-44ca-8f93-83e4e42bb154 tempest-ServerActionsTestOtherA-940473852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:24:42 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [req-e0f46bdd-1ef8-4963-bcc5-203e6236d591 req-87da42b7-a68a-44ca-8f93-83e4e42bb154 tempest-ServerActionsTestOtherA-940473852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:24:42 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [req-e0f46bdd-1ef8-4963-bcc5-203e6236d591 req-87da42b7-a68a-44ca-8f93-83e4e42bb154 tempest-ServerActionsTestOtherA-940473852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:24:42 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [req-e0f46bdd-1ef8-4963-bcc5-203e6236d591 req-87da42b7-a68a-44ca-8f93-83e4e42bb154 tempest-ServerActionsTestOtherA-940473852 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5', 'name': 'volume-1d517758-bd22-4132-aea6-50f086cc96e0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f0a2bff1-a48e-4992-855a-e8759ecc0b3f', 'enforce_multipath': True} {{(pid=88719) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 30 20:24:42 devstack cinder-volume[88719]: INFO cinder.volume.manager [req-e0f46bdd-1ef8-4963-bcc5-203e6236d591 req-87da42b7-a68a-44ca-8f93-83e4e42bb154 tempest-ServerActionsTestOtherA-940473852 None] attachment_update completed successfully.
Jul 30 20:24:43 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-989671de-abc7-44c0-9784-a221068d539c tempest-DeleteServersTestJSON-50863911 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:24:43 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-989671de-abc7-44c0-9784-a221068d539c tempest-DeleteServersTestJSON-50863911 None] Flow 'volume_create_manager' (412af64a-ff10-4d00-962b-b2e222ff6cd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:24:43 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-989671de-abc7-44c0-9784-a221068d539c tempest-DeleteServersTestJSON-50863911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2604a3eb-6ae5-41a4-9eb1-11b8f587d42c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:24:43 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-989671de-abc7-44c0-9784-a221068d539c tempest-DeleteServersTestJSON-50863911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2604a3eb-6ae5-41a4-9eb1-11b8f587d42c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:24:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-246944139',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69b89e85-1ba1-44a4-b28d-25be419047ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84d62d5a01a240f2a2ccc463712bf2d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:24:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:24:43Z,use_quota=True,user_id='c4bbe9a4cc3e4b629d0f0d70a6033f87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:24:43 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-989671de-abc7-44c0-9784-a221068d539c tempest-DeleteServersTestJSON-50863911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6b878b2-e970-413c-b21a-860c3506bcf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:24:43 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-989671de-abc7-44c0-9784-a221068d539c tempest-DeleteServersTestJSON-50863911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6b878b2-e970-413c-b21a-860c3506bcf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:24:43 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-989671de-abc7-44c0-9784-a221068d539c tempest-DeleteServersTestJSON-50863911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3771d29-bc70-4a58-ae47-4de1333f3e49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:24:43 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-989671de-abc7-44c0-9784-a221068d539c tempest-DeleteServersTestJSON-50863911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3771d29-bc70-4a58-ae47-4de1333f3e49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69b89e85-1ba1-44a4-b28d-25be419047ea', 'volume_name': 'volume-69b89e85-1ba1-44a4-b28d-25be419047ea', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:24:43 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-989671de-abc7-44c0-9784-a221068d539c tempest-DeleteServersTestJSON-50863911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03282fd1-0806-413b-9ef3-7ce436af7b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:24:43 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-989671de-abc7-44c0-9784-a221068d539c tempest-DeleteServersTestJSON-50863911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03282fd1-0806-413b-9ef3-7ce436af7b1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:24:43 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-989671de-abc7-44c0-9784-a221068d539c tempest-DeleteServersTestJSON-50863911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42a09006-b79b-47cb-a11a-0e701dcb449d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:24:43 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-989671de-abc7-44c0-9784-a221068d539c tempest-DeleteServersTestJSON-50863911 None] Volume 69b89e85-1ba1-44a4-b28d-25be419047ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69b89e85-1ba1-44a4-b28d-25be419047ea', 'volume_size': 1}
Jul 30 20:24:43 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-989671de-abc7-44c0-9784-a221068d539c tempest-DeleteServersTestJSON-50863911 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:24:43 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-989671de-abc7-44c0-9784-a221068d539c tempest-DeleteServersTestJSON-50863911 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:24:43 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-989671de-abc7-44c0-9784-a221068d539c tempest-DeleteServersTestJSON-50863911 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:24:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-246944139',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69b89e85-1ba1-44a4-b28d-25be419047ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84d62d5a01a240f2a2ccc463712bf2d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:24:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:24:43Z,use_quota=True,user_id='c4bbe9a4cc3e4b629d0f0d70a6033f87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:24:43 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-989671de-abc7-44c0-9784-a221068d539c tempest-DeleteServersTestJSON-50863911 None] Creating volume 69b89e85-1ba1-44a4-b28d-25be419047ea {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:24:43 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-989671de-abc7-44c0-9784-a221068d539c tempest-DeleteServersTestJSON-50863911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:24:43 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-989671de-abc7-44c0-9784-a221068d539c tempest-DeleteServersTestJSON-50863911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:24:43 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-989671de-abc7-44c0-9784-a221068d539c tempest-DeleteServersTestJSON-50863911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:24:43 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-989671de-abc7-44c0-9784-a221068d539c tempest-DeleteServersTestJSON-50863911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:24:43 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-989671de-abc7-44c0-9784-a221068d539c tempest-DeleteServersTestJSON-50863911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:24:43 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-989671de-abc7-44c0-9784-a221068d539c tempest-DeleteServersTestJSON-50863911 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:24:43 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-989671de-abc7-44c0-9784-a221068d539c tempest-DeleteServersTestJSON-50863911 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:24:43 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-989671de-abc7-44c0-9784-a221068d539c tempest-DeleteServersTestJSON-50863911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-69b89e85-1ba1-44a4-b28d-25be419047ea 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:24:43 devstack sudo[91885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-69b89e85-1ba1-44a4-b28d-25be419047ea 1073741824
Jul 30 20:24:43 devstack sudo[91885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:24:44 devstack sudo[91885]: pam_unix(sudo:session): session closed for user root
Jul 30 20:24:44 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-989671de-abc7-44c0-9784-a221068d539c tempest-DeleteServersTestJSON-50863911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-69b89e85-1ba1-44a4-b28d-25be419047ea 1073741824" returned: 0 in 0.956s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:24:44 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-989671de-abc7-44c0-9784-a221068d539c tempest-DeleteServersTestJSON-50863911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-69b89e85-1ba1-44a4-b28d-25be419047ea {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:24:44 devstack sudo[91974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-69b89e85-1ba1-44a4-b28d-25be419047ea
Jul 30 20:24:44 devstack sudo[91974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:24:45 devstack sudo[91974]: pam_unix(sudo:session): session closed for user root
Jul 30 20:24:45 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-989671de-abc7-44c0-9784-a221068d539c tempest-DeleteServersTestJSON-50863911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-69b89e85-1ba1-44a4-b28d-25be419047ea" returned: 0 in 0.443s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:24:45 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-989671de-abc7-44c0-9784-a221068d539c tempest-DeleteServersTestJSON-50863911 None] <== create_volume: return (1488ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:24:45 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-989671de-abc7-44c0-9784-a221068d539c tempest-DeleteServersTestJSON-50863911 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.499s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:24:45 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-989671de-abc7-44c0-9784-a221068d539c tempest-DeleteServersTestJSON-50863911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42a09006-b79b-47cb-a11a-0e701dcb449d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69b89e85-1ba1-44a4-b28d-25be419047ea', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:24:45 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-989671de-abc7-44c0-9784-a221068d539c tempest-DeleteServersTestJSON-50863911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe1cb75e-8a3e-4bc4-9fe3-147be66b069c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:24:45 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-989671de-abc7-44c0-9784-a221068d539c tempest-DeleteServersTestJSON-50863911 None] Volume volume-69b89e85-1ba1-44a4-b28d-25be419047ea (69b89e85-1ba1-44a4-b28d-25be419047ea): created successfully
Jul 30 20:24:45 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-989671de-abc7-44c0-9784-a221068d539c tempest-DeleteServersTestJSON-50863911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe1cb75e-8a3e-4bc4-9fe3-147be66b069c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:24:45 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-989671de-abc7-44c0-9784-a221068d539c tempest-DeleteServersTestJSON-50863911 None] Flow 'volume_create_manager' (412af64a-ff10-4d00-962b-b2e222ff6cd4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:24:45 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-989671de-abc7-44c0-9784-a221068d539c tempest-DeleteServersTestJSON-50863911 None] Created volume successfully.
Jul 30 20:24:47 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [req-6138b65b-5e90-41e4-bdce-1db8bbb95ed5 req-e89b0d50-90dc-4199-b063-ad130be64f88 tempest-DeleteServersTestJSON-50863911 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:24:47 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [req-6138b65b-5e90-41e4-bdce-1db8bbb95ed5 req-e89b0d50-90dc-4199-b063-ad130be64f88 tempest-DeleteServersTestJSON-50863911 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:24:47 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [req-6138b65b-5e90-41e4-bdce-1db8bbb95ed5 req-e89b0d50-90dc-4199-b063-ad130be64f88 tempest-DeleteServersTestJSON-50863911 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.044s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:24:47 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [req-6138b65b-5e90-41e4-bdce-1db8bbb95ed5 req-e89b0d50-90dc-4199-b063-ad130be64f88 tempest-DeleteServersTestJSON-50863911 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5', 'name': 'volume-69b89e85-1ba1-44a4-b28d-25be419047ea', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '14dd72cf-ee7d-4828-bca8-1270b9d7109d', 'enforce_multipath': True} {{(pid=88719) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 30 20:24:47 devstack cinder-volume[88719]: INFO cinder.volume.manager [req-6138b65b-5e90-41e4-bdce-1db8bbb95ed5 req-e89b0d50-90dc-4199-b063-ad130be64f88 tempest-DeleteServersTestJSON-50863911 None] attachment_update completed successfully.
Jul 30 20:24:53 devstack cinder-volume[88719]: INFO cinder.volume.manager [req-81a6d73d-d379-4c77-a230-9f93f5569239 req-7df354c6-6b47-4315-b802-dd3358eaf982 tempest-DeleteServersTestJSON-50863911 None] Terminate volume connection completed successfully.
Jul 30 20:24:53 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [req-81a6d73d-d379-4c77-a230-9f93f5569239 req-7df354c6-6b47-4315-b802-dd3358eaf982 tempest-DeleteServersTestJSON-50863911 None] Deleting attachment 14dd72cf-ee7d-4828-bca8-1270b9d7109d. {{(pid=88719) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 30 20:24:55 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-1a83f3ce-02d6-48ad-ab34-8c2e27b01a09 tempest-DeleteServersTestJSON-50863911 None] Acquiring lock "cinder-69b89e85-1ba1-44a4-b28d-25be419047ea-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:24:55 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-1a83f3ce-02d6-48ad-ab34-8c2e27b01a09 tempest-DeleteServersTestJSON-50863911 None] Lock "cinder-69b89e85-1ba1-44a4-b28d-25be419047ea-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:24:55 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-1a83f3ce-02d6-48ad-ab34-8c2e27b01a09 tempest-DeleteServersTestJSON-50863911 None] Acquiring lock "cinder-quobyte-69b89e85-1ba1-44a4-b28d-25be419047ea" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:24:55 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-1a83f3ce-02d6-48ad-ab34-8c2e27b01a09 tempest-DeleteServersTestJSON-50863911 None] Lock "cinder-quobyte-69b89e85-1ba1-44a4-b28d-25be419047ea" acquired by "delete_volume" :: waited 0.020s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:24:55 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e7600e0-17cb-4800-bc19-16d92aef3e3e]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:24:55 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-1a83f3ce-02d6-48ad-ab34-8c2e27b01a09 tempest-DeleteServersTestJSON-50863911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-69b89e85-1ba1-44a4-b28d-25be419047ea {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:24:55 devstack sudo[92452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-69b89e85-1ba1-44a4-b28d-25be419047ea
Jul 30 20:24:55 devstack sudo[92452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:24:56 devstack sudo[92452]: pam_unix(sudo:session): session closed for user root
Jul 30 20:24:56 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-1a83f3ce-02d6-48ad-ab34-8c2e27b01a09 tempest-DeleteServersTestJSON-50863911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-69b89e85-1ba1-44a4-b28d-25be419047ea" returned: 0 in 0.501s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:24:56 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-1a83f3ce-02d6-48ad-ab34-8c2e27b01a09 tempest-DeleteServersTestJSON-50863911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-69b89e85-1ba1-44a4-b28d-25be419047ea {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:24:56 devstack sudo[92457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-69b89e85-1ba1-44a4-b28d-25be419047ea
Jul 30 20:24:56 devstack sudo[92457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:24:56 devstack sudo[92457]: pam_unix(sudo:session): session closed for user root
Jul 30 20:24:56 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-1a83f3ce-02d6-48ad-ab34-8c2e27b01a09 tempest-DeleteServersTestJSON-50863911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-69b89e85-1ba1-44a4-b28d-25be419047ea" returned: 0 in 0.443s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:24:56 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-1a83f3ce-02d6-48ad-ab34-8c2e27b01a09 tempest-DeleteServersTestJSON-50863911 None] Lock "cinder-quobyte-69b89e85-1ba1-44a4-b28d-25be419047ea" released by "delete_volume" :: held 1.018s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:24:56 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-1a83f3ce-02d6-48ad-ab34-8c2e27b01a09 tempest-DeleteServersTestJSON-50863911 None] Created reservations ['7cc97ee2-07ad-4ba7-90b1-105f5bfec32a', '2fa9630d-f58f-4de1-b0a0-50d184b2e6a0', '416a76fa-adf9-4029-9b4c-99f4f3f6b4eb', '8d41b617-15c5-4cfa-9cdc-25c682d7858f'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:24:56 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-1a83f3ce-02d6-48ad-ab34-8c2e27b01a09 tempest-DeleteServersTestJSON-50863911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:24:56 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-1a83f3ce-02d6-48ad-ab34-8c2e27b01a09 tempest-DeleteServersTestJSON-50863911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:24:56 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-1a83f3ce-02d6-48ad-ab34-8c2e27b01a09 tempest-DeleteServersTestJSON-50863911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:24:56 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-1a83f3ce-02d6-48ad-ab34-8c2e27b01a09 tempest-DeleteServersTestJSON-50863911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:24:56 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-1a83f3ce-02d6-48ad-ab34-8c2e27b01a09 tempest-DeleteServersTestJSON-50863911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:24:56 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-1a83f3ce-02d6-48ad-ab34-8c2e27b01a09 tempest-DeleteServersTestJSON-50863911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:24:56 devstack sudo[92460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:24:56 devstack sudo[92460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:24:57 devstack sudo[92460]: pam_unix(sudo:session): session closed for user root
Jul 30 20:24:57 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-1a83f3ce-02d6-48ad-ab34-8c2e27b01a09 tempest-DeleteServersTestJSON-50863911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.339s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:24:57 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-1a83f3ce-02d6-48ad-ab34-8c2e27b01a09 tempest-DeleteServersTestJSON-50863911 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:24:57 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-1a83f3ce-02d6-48ad-ab34-8c2e27b01a09 tempest-DeleteServersTestJSON-50863911 None] Deleted volume successfully.
Jul 30 20:24:57 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-1a83f3ce-02d6-48ad-ab34-8c2e27b01a09 tempest-DeleteServersTestJSON-50863911 None] Lock "cinder-69b89e85-1ba1-44a4-b28d-25be419047ea-delete_volume" released by "delete_volume" :: held 1.678s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:25:06 devstack cinder-volume[88719]: DEBUG dbcounter [-] [88719] Writing DB stats cinder:SELECT=38,cinder:UPDATE=29,cinder:INSERT=7,cinder:DELETE=1 {{(pid=88719) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 30 20:25:07 devstack cinder-volume[88719]: DEBUG dbcounter [-] [88719] Writing DB stats cinder:UPDATE=34,cinder:SELECT=39,cinder:INSERT=6,cinder:DELETE=3 {{(pid=88719) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 30 20:25:14 devstack cinder-volume[88719]: INFO cinder.volume.manager [req-ecd8aeb8-c8c6-41c2-be9f-ce2fa13915fb req-572919e5-f125-4321-8f21-930e6d9e0e6d tempest-ServerActionsTestOtherA-940473852 None] Terminate volume connection completed successfully.
Jul 30 20:25:14 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [req-ecd8aeb8-c8c6-41c2-be9f-ce2fa13915fb req-572919e5-f125-4321-8f21-930e6d9e0e6d tempest-ServerActionsTestOtherA-940473852 None] Deleting attachment f0a2bff1-a48e-4992-855a-e8759ecc0b3f. {{(pid=88719) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 30 20:25:16 devstack cinder-volume[88719]: DEBUG oslo_service.periodic_task [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88719) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 30 20:25:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:25:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:25:16 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:25:16 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:25:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:25:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:25:16 devstack sudo[92960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:25:16 devstack sudo[92960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:25:16 devstack sudo[92960]: pam_unix(sudo:session): session closed for user root
Jul 30 20:25:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.526s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:25:16 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:25:24 devstack cinder-volume[88719]: DEBUG dbcounter [-] [88719] Writing DB stats cinder:SELECT=1 {{(pid=88719) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 30 20:25:24 devstack cinder-volume[88719]: DEBUG dbcounter [-] [88719] Writing DB stats cinder:SELECT=1 {{(pid=88719) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 30 20:25:25 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-dc80bdb3-545c-4c60-8e96-931564f8edef tempest-ServerActionsTestOtherA-940473852 None] Acquiring lock "cinder-1d517758-bd22-4132-aea6-50f086cc96e0-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:25:25 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-dc80bdb3-545c-4c60-8e96-931564f8edef tempest-ServerActionsTestOtherA-940473852 None] Lock "cinder-1d517758-bd22-4132-aea6-50f086cc96e0-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:25:25 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-dc80bdb3-545c-4c60-8e96-931564f8edef tempest-ServerActionsTestOtherA-940473852 None] Acquiring lock "cinder-quobyte-1d517758-bd22-4132-aea6-50f086cc96e0" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:25:25 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-dc80bdb3-545c-4c60-8e96-931564f8edef tempest-ServerActionsTestOtherA-940473852 None] Lock "cinder-quobyte-1d517758-bd22-4132-aea6-50f086cc96e0" acquired by "delete_volume" :: waited 0.025s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:25:26 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[b282ce03-647d-4b72-a760-23f9d197f1ff]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:25:26 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-dc80bdb3-545c-4c60-8e96-931564f8edef tempest-ServerActionsTestOtherA-940473852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1d517758-bd22-4132-aea6-50f086cc96e0 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:25:26 devstack sudo[93077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1d517758-bd22-4132-aea6-50f086cc96e0
Jul 30 20:25:26 devstack sudo[93077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:25:26 devstack sudo[93077]: pam_unix(sudo:session): session closed for user root
Jul 30 20:25:26 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-dc80bdb3-545c-4c60-8e96-931564f8edef tempest-ServerActionsTestOtherA-940473852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1d517758-bd22-4132-aea6-50f086cc96e0" returned: 0 in 0.540s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:25:26 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-dc80bdb3-545c-4c60-8e96-931564f8edef tempest-ServerActionsTestOtherA-940473852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1d517758-bd22-4132-aea6-50f086cc96e0 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:25:26 devstack sudo[93099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1d517758-bd22-4132-aea6-50f086cc96e0
Jul 30 20:25:26 devstack sudo[93099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:25:26 devstack sudo[93099]: pam_unix(sudo:session): session closed for user root
Jul 30 20:25:26 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-dc80bdb3-545c-4c60-8e96-931564f8edef tempest-ServerActionsTestOtherA-940473852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1d517758-bd22-4132-aea6-50f086cc96e0" returned: 0 in 0.379s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:25:26 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-dc80bdb3-545c-4c60-8e96-931564f8edef tempest-ServerActionsTestOtherA-940473852 None] Lock "cinder-quobyte-1d517758-bd22-4132-aea6-50f086cc96e0" released by "delete_volume" :: held 1.002s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:25:27 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-dc80bdb3-545c-4c60-8e96-931564f8edef tempest-ServerActionsTestOtherA-940473852 None] Created reservations ['79367b18-906c-40d5-82f7-5708a00f2c4b', 'f63a1b11-c1ea-4d63-a348-cc406d89fe51', '358911e0-c637-4754-9cf5-1177e33b61f4', '0f8abba0-0293-4fd8-9545-b57ec8ca8423'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:25:27 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-dc80bdb3-545c-4c60-8e96-931564f8edef tempest-ServerActionsTestOtherA-940473852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:25:27 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-dc80bdb3-545c-4c60-8e96-931564f8edef tempest-ServerActionsTestOtherA-940473852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:25:27 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-dc80bdb3-545c-4c60-8e96-931564f8edef tempest-ServerActionsTestOtherA-940473852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:25:27 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-dc80bdb3-545c-4c60-8e96-931564f8edef tempest-ServerActionsTestOtherA-940473852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:25:27 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-dc80bdb3-545c-4c60-8e96-931564f8edef tempest-ServerActionsTestOtherA-940473852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:25:27 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-dc80bdb3-545c-4c60-8e96-931564f8edef tempest-ServerActionsTestOtherA-940473852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:25:27 devstack sudo[93124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:25:27 devstack sudo[93124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:25:27 devstack sudo[93124]: pam_unix(sudo:session): session closed for user root
Jul 30 20:25:27 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-dc80bdb3-545c-4c60-8e96-931564f8edef tempest-ServerActionsTestOtherA-940473852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.318s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:25:27 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-dc80bdb3-545c-4c60-8e96-931564f8edef tempest-ServerActionsTestOtherA-940473852 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:25:27 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-dc80bdb3-545c-4c60-8e96-931564f8edef tempest-ServerActionsTestOtherA-940473852 None] Deleted volume successfully.
Jul 30 20:25:27 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-dc80bdb3-545c-4c60-8e96-931564f8edef tempest-ServerActionsTestOtherA-940473852 None] Lock "cinder-1d517758-bd22-4132-aea6-50f086cc96e0-delete_volume" released by "delete_volume" :: held 1.648s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:25:37 devstack cinder-volume[88719]: DEBUG dbcounter [-] [88719] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=8 {{(pid=88719) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 30 20:25:37 devstack cinder-volume[88719]: DEBUG dbcounter [-] [88719] Writing DB stats cinder:UPDATE=8,cinder:SELECT=4,cinder:INSERT=3,cinder:DELETE=1 {{(pid=88719) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 30 20:25:51 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [req-e2ccbc08-ea2a-470f-bdf3-46702ce52153 req-f08622ca-9068-4a26-b19b-66b5c035fb8e tempest-VolumesGetTestJSON-678483474 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:25:51 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [req-e2ccbc08-ea2a-470f-bdf3-46702ce52153 req-f08622ca-9068-4a26-b19b-66b5c035fb8e tempest-VolumesGetTestJSON-678483474 None] Flow 'volume_create_manager' (ef0b4c33-80b8-41f9-ab41-2bba94b449b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:25:51 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [req-e2ccbc08-ea2a-470f-bdf3-46702ce52153 req-f08622ca-9068-4a26-b19b-66b5c035fb8e tempest-VolumesGetTestJSON-678483474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dab620d8-fcbc-4c8e-b17a-aadc20c2766c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:25:51 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [req-e2ccbc08-ea2a-470f-bdf3-46702ce52153 req-f08622ca-9068-4a26-b19b-66b5c035fb8e tempest-VolumesGetTestJSON-678483474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dab620d8-fcbc-4c8e-b17a-aadc20c2766c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:25:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-894983373',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dc1713f-2069-4c57-9728-f9850570cbba,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c013b002fd214af088b27f4d8c26a857',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:25:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:25:51Z,use_quota=True,user_id='504463a684624ec0a47f2061fb251e0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:25:51 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [req-e2ccbc08-ea2a-470f-bdf3-46702ce52153 req-f08622ca-9068-4a26-b19b-66b5c035fb8e tempest-VolumesGetTestJSON-678483474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e79713a-d04d-4d7e-a73f-ffeaca352ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:25:51 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [req-e2ccbc08-ea2a-470f-bdf3-46702ce52153 req-f08622ca-9068-4a26-b19b-66b5c035fb8e tempest-VolumesGetTestJSON-678483474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e79713a-d04d-4d7e-a73f-ffeaca352ed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:25:51 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [req-e2ccbc08-ea2a-470f-bdf3-46702ce52153 req-f08622ca-9068-4a26-b19b-66b5c035fb8e tempest-VolumesGetTestJSON-678483474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bc8c2e8-7399-409c-9542-81812fb80bae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:25:51 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [req-e2ccbc08-ea2a-470f-bdf3-46702ce52153 req-f08622ca-9068-4a26-b19b-66b5c035fb8e tempest-VolumesGetTestJSON-678483474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bc8c2e8-7399-409c-9542-81812fb80bae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2dc1713f-2069-4c57-9728-f9850570cbba', 'volume_name': 'volume-2dc1713f-2069-4c57-9728-f9850570cbba', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:25:51 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [req-e2ccbc08-ea2a-470f-bdf3-46702ce52153 req-f08622ca-9068-4a26-b19b-66b5c035fb8e tempest-VolumesGetTestJSON-678483474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc725402-6978-4bca-8d7a-027648828815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:25:51 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [req-e2ccbc08-ea2a-470f-bdf3-46702ce52153 req-f08622ca-9068-4a26-b19b-66b5c035fb8e tempest-VolumesGetTestJSON-678483474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc725402-6978-4bca-8d7a-027648828815) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:25:51 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [req-e2ccbc08-ea2a-470f-bdf3-46702ce52153 req-f08622ca-9068-4a26-b19b-66b5c035fb8e tempest-VolumesGetTestJSON-678483474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d29fa8c9-febd-4d34-9163-79f0b67603eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:25:51 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [req-e2ccbc08-ea2a-470f-bdf3-46702ce52153 req-f08622ca-9068-4a26-b19b-66b5c035fb8e tempest-VolumesGetTestJSON-678483474 None] Volume 2dc1713f-2069-4c57-9728-f9850570cbba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2dc1713f-2069-4c57-9728-f9850570cbba', 'volume_size': 1}
Jul 30 20:25:51 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [req-e2ccbc08-ea2a-470f-bdf3-46702ce52153 req-f08622ca-9068-4a26-b19b-66b5c035fb8e tempest-VolumesGetTestJSON-678483474 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:25:51 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [req-e2ccbc08-ea2a-470f-bdf3-46702ce52153 req-f08622ca-9068-4a26-b19b-66b5c035fb8e tempest-VolumesGetTestJSON-678483474 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:25:51 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [req-e2ccbc08-ea2a-470f-bdf3-46702ce52153 req-f08622ca-9068-4a26-b19b-66b5c035fb8e tempest-VolumesGetTestJSON-678483474 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:25:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-894983373',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dc1713f-2069-4c57-9728-f9850570cbba,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c013b002fd214af088b27f4d8c26a857',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:25:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:25:51Z,use_quota=True,user_id='504463a684624ec0a47f2061fb251e0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:25:51 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [req-e2ccbc08-ea2a-470f-bdf3-46702ce52153 req-f08622ca-9068-4a26-b19b-66b5c035fb8e tempest-VolumesGetTestJSON-678483474 None] Creating volume 2dc1713f-2069-4c57-9728-f9850570cbba {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:25:51 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [req-e2ccbc08-ea2a-470f-bdf3-46702ce52153 req-f08622ca-9068-4a26-b19b-66b5c035fb8e tempest-VolumesGetTestJSON-678483474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:25:51 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [req-e2ccbc08-ea2a-470f-bdf3-46702ce52153 req-f08622ca-9068-4a26-b19b-66b5c035fb8e tempest-VolumesGetTestJSON-678483474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:25:51 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [req-e2ccbc08-ea2a-470f-bdf3-46702ce52153 req-f08622ca-9068-4a26-b19b-66b5c035fb8e tempest-VolumesGetTestJSON-678483474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:25:51 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [req-e2ccbc08-ea2a-470f-bdf3-46702ce52153 req-f08622ca-9068-4a26-b19b-66b5c035fb8e tempest-VolumesGetTestJSON-678483474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:25:51 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [req-e2ccbc08-ea2a-470f-bdf3-46702ce52153 req-f08622ca-9068-4a26-b19b-66b5c035fb8e tempest-VolumesGetTestJSON-678483474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:25:51 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [req-e2ccbc08-ea2a-470f-bdf3-46702ce52153 req-f08622ca-9068-4a26-b19b-66b5c035fb8e tempest-VolumesGetTestJSON-678483474 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:25:51 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [req-e2ccbc08-ea2a-470f-bdf3-46702ce52153 req-f08622ca-9068-4a26-b19b-66b5c035fb8e tempest-VolumesGetTestJSON-678483474 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:25:51 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [req-e2ccbc08-ea2a-470f-bdf3-46702ce52153 req-f08622ca-9068-4a26-b19b-66b5c035fb8e tempest-VolumesGetTestJSON-678483474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2dc1713f-2069-4c57-9728-f9850570cbba 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:25:51 devstack sudo[93497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2dc1713f-2069-4c57-9728-f9850570cbba 1073741824
Jul 30 20:25:51 devstack sudo[93497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:25:52 devstack sudo[93497]: pam_unix(sudo:session): session closed for user root
Jul 30 20:25:52 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [req-e2ccbc08-ea2a-470f-bdf3-46702ce52153 req-f08622ca-9068-4a26-b19b-66b5c035fb8e tempest-VolumesGetTestJSON-678483474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2dc1713f-2069-4c57-9728-f9850570cbba 1073741824" returned: 0 in 0.871s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:25:52 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [req-e2ccbc08-ea2a-470f-bdf3-46702ce52153 req-f08622ca-9068-4a26-b19b-66b5c035fb8e tempest-VolumesGetTestJSON-678483474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2dc1713f-2069-4c57-9728-f9850570cbba {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:25:52 devstack sudo[93528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2dc1713f-2069-4c57-9728-f9850570cbba
Jul 30 20:25:52 devstack sudo[93528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:25:52 devstack sudo[93528]: pam_unix(sudo:session): session closed for user root
Jul 30 20:25:52 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [req-e2ccbc08-ea2a-470f-bdf3-46702ce52153 req-f08622ca-9068-4a26-b19b-66b5c035fb8e tempest-VolumesGetTestJSON-678483474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2dc1713f-2069-4c57-9728-f9850570cbba" returned: 0 in 0.400s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:25:52 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [req-e2ccbc08-ea2a-470f-bdf3-46702ce52153 req-f08622ca-9068-4a26-b19b-66b5c035fb8e tempest-VolumesGetTestJSON-678483474 None] <== create_volume: return (1356ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:25:52 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [req-e2ccbc08-ea2a-470f-bdf3-46702ce52153 req-f08622ca-9068-4a26-b19b-66b5c035fb8e tempest-VolumesGetTestJSON-678483474 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.360s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:25:52 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [req-e2ccbc08-ea2a-470f-bdf3-46702ce52153 req-f08622ca-9068-4a26-b19b-66b5c035fb8e tempest-VolumesGetTestJSON-678483474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d29fa8c9-febd-4d34-9163-79f0b67603eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2dc1713f-2069-4c57-9728-f9850570cbba', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:25:52 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [req-e2ccbc08-ea2a-470f-bdf3-46702ce52153 req-f08622ca-9068-4a26-b19b-66b5c035fb8e tempest-VolumesGetTestJSON-678483474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a728e5a3-0e1d-49aa-9604-b06b25042d3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:25:52 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [req-e2ccbc08-ea2a-470f-bdf3-46702ce52153 req-f08622ca-9068-4a26-b19b-66b5c035fb8e tempest-VolumesGetTestJSON-678483474 None] Volume volume-2dc1713f-2069-4c57-9728-f9850570cbba (2dc1713f-2069-4c57-9728-f9850570cbba): created successfully
Jul 30 20:25:52 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [req-e2ccbc08-ea2a-470f-bdf3-46702ce52153 req-f08622ca-9068-4a26-b19b-66b5c035fb8e tempest-VolumesGetTestJSON-678483474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a728e5a3-0e1d-49aa-9604-b06b25042d3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:25:52 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [req-e2ccbc08-ea2a-470f-bdf3-46702ce52153 req-f08622ca-9068-4a26-b19b-66b5c035fb8e tempest-VolumesGetTestJSON-678483474 None] Flow 'volume_create_manager' (ef0b4c33-80b8-41f9-ab41-2bba94b449b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:25:53 devstack cinder-volume[88719]: INFO cinder.volume.manager [req-e2ccbc08-ea2a-470f-bdf3-46702ce52153 req-f08622ca-9068-4a26-b19b-66b5c035fb8e tempest-VolumesGetTestJSON-678483474 None] Created volume successfully.
Jul 30 20:25:53 devstack cinder-volume[88719]: DEBUG cinder.coordination [req-5415f9e7-5a2f-4aa3-8851-b9ef031512d6 req-195e0ce4-ac57-4bcd-88e5-1766063aa61e tempest-VolumesGetTestJSON-678483474 None] Acquiring lock "cinder-2dc1713f-2069-4c57-9728-f9850570cbba-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:25:53 devstack cinder-volume[88719]: DEBUG cinder.coordination [req-5415f9e7-5a2f-4aa3-8851-b9ef031512d6 req-195e0ce4-ac57-4bcd-88e5-1766063aa61e tempest-VolumesGetTestJSON-678483474 None] Lock "cinder-2dc1713f-2069-4c57-9728-f9850570cbba-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:25:54 devstack cinder-volume[88719]: DEBUG cinder.coordination [req-5415f9e7-5a2f-4aa3-8851-b9ef031512d6 req-195e0ce4-ac57-4bcd-88e5-1766063aa61e tempest-VolumesGetTestJSON-678483474 None] Acquiring lock "cinder-quobyte-2dc1713f-2069-4c57-9728-f9850570cbba" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:25:54 devstack cinder-volume[88719]: DEBUG cinder.coordination [req-5415f9e7-5a2f-4aa3-8851-b9ef031512d6 req-195e0ce4-ac57-4bcd-88e5-1766063aa61e tempest-VolumesGetTestJSON-678483474 None] Lock "cinder-quobyte-2dc1713f-2069-4c57-9728-f9850570cbba" acquired by "delete_volume" :: waited 0.027s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:25:54 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[d846ab28-2334-436b-83f6-a621eb116604]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:25:54 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [req-5415f9e7-5a2f-4aa3-8851-b9ef031512d6 req-195e0ce4-ac57-4bcd-88e5-1766063aa61e tempest-VolumesGetTestJSON-678483474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2dc1713f-2069-4c57-9728-f9850570cbba {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:25:54 devstack sudo[93561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2dc1713f-2069-4c57-9728-f9850570cbba
Jul 30 20:25:54 devstack sudo[93561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:25:54 devstack sudo[93561]: pam_unix(sudo:session): session closed for user root
Jul 30 20:25:54 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [req-5415f9e7-5a2f-4aa3-8851-b9ef031512d6 req-195e0ce4-ac57-4bcd-88e5-1766063aa61e tempest-VolumesGetTestJSON-678483474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2dc1713f-2069-4c57-9728-f9850570cbba" returned: 0 in 0.447s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:25:54 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [req-5415f9e7-5a2f-4aa3-8851-b9ef031512d6 req-195e0ce4-ac57-4bcd-88e5-1766063aa61e tempest-VolumesGetTestJSON-678483474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2dc1713f-2069-4c57-9728-f9850570cbba {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:25:54 devstack sudo[93567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2dc1713f-2069-4c57-9728-f9850570cbba
Jul 30 20:25:54 devstack sudo[93567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:25:54 devstack sudo[93567]: pam_unix(sudo:session): session closed for user root
Jul 30 20:25:54 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [req-5415f9e7-5a2f-4aa3-8851-b9ef031512d6 req-195e0ce4-ac57-4bcd-88e5-1766063aa61e tempest-VolumesGetTestJSON-678483474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2dc1713f-2069-4c57-9728-f9850570cbba" returned: 0 in 0.438s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:25:54 devstack cinder-volume[88719]: DEBUG cinder.coordination [req-5415f9e7-5a2f-4aa3-8851-b9ef031512d6 req-195e0ce4-ac57-4bcd-88e5-1766063aa61e tempest-VolumesGetTestJSON-678483474 None] Lock "cinder-quobyte-2dc1713f-2069-4c57-9728-f9850570cbba" released by "delete_volume" :: held 0.952s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:25:55 devstack cinder-volume[88719]: DEBUG cinder.quota [req-5415f9e7-5a2f-4aa3-8851-b9ef031512d6 req-195e0ce4-ac57-4bcd-88e5-1766063aa61e tempest-VolumesGetTestJSON-678483474 None] Created reservations ['ab4878c9-57d0-4594-8bf6-0028db11f82c', '893f7ce1-c7a8-4743-8858-aa8f60835cc4', '6332467c-93ce-4ef8-91a2-00aecb1cc0ed', 'f5c311b7-d18c-4db8-bb82-01caaf2660b3'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:25:55 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [req-5415f9e7-5a2f-4aa3-8851-b9ef031512d6 req-195e0ce4-ac57-4bcd-88e5-1766063aa61e tempest-VolumesGetTestJSON-678483474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:25:55 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [req-5415f9e7-5a2f-4aa3-8851-b9ef031512d6 req-195e0ce4-ac57-4bcd-88e5-1766063aa61e tempest-VolumesGetTestJSON-678483474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:25:55 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [req-5415f9e7-5a2f-4aa3-8851-b9ef031512d6 req-195e0ce4-ac57-4bcd-88e5-1766063aa61e tempest-VolumesGetTestJSON-678483474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:25:55 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [req-5415f9e7-5a2f-4aa3-8851-b9ef031512d6 req-195e0ce4-ac57-4bcd-88e5-1766063aa61e tempest-VolumesGetTestJSON-678483474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:25:55 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [req-5415f9e7-5a2f-4aa3-8851-b9ef031512d6 req-195e0ce4-ac57-4bcd-88e5-1766063aa61e tempest-VolumesGetTestJSON-678483474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:25:55 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [req-5415f9e7-5a2f-4aa3-8851-b9ef031512d6 req-195e0ce4-ac57-4bcd-88e5-1766063aa61e tempest-VolumesGetTestJSON-678483474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:25:55 devstack sudo[93572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:25:55 devstack sudo[93572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:25:55 devstack sudo[93572]: pam_unix(sudo:session): session closed for user root
Jul 30 20:25:55 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [req-5415f9e7-5a2f-4aa3-8851-b9ef031512d6 req-195e0ce4-ac57-4bcd-88e5-1766063aa61e tempest-VolumesGetTestJSON-678483474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.327s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:25:55 devstack cinder-volume[88719]: DEBUG cinder.manager [req-5415f9e7-5a2f-4aa3-8851-b9ef031512d6 req-195e0ce4-ac57-4bcd-88e5-1766063aa61e tempest-VolumesGetTestJSON-678483474 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:25:55 devstack cinder-volume[88719]: INFO cinder.volume.manager [req-5415f9e7-5a2f-4aa3-8851-b9ef031512d6 req-195e0ce4-ac57-4bcd-88e5-1766063aa61e tempest-VolumesGetTestJSON-678483474 None] Deleted volume successfully.
Jul 30 20:25:55 devstack cinder-volume[88719]: DEBUG cinder.coordination [req-5415f9e7-5a2f-4aa3-8851-b9ef031512d6 req-195e0ce4-ac57-4bcd-88e5-1766063aa61e tempest-VolumesGetTestJSON-678483474 None] Lock "cinder-2dc1713f-2069-4c57-9728-f9850570cbba-delete_volume" released by "delete_volume" :: held 1.603s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:25:59 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d1cdb39-cd54-480a-8fb1-f99ae6dcb591 tempest-AttachVolumeTestJSON-1478692577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:25:59 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5d1cdb39-cd54-480a-8fb1-f99ae6dcb591 tempest-AttachVolumeTestJSON-1478692577 None] Flow 'volume_create_manager' (d7183f09-a010-41f3-99af-07294cfed45e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:25:59 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5d1cdb39-cd54-480a-8fb1-f99ae6dcb591 tempest-AttachVolumeTestJSON-1478692577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96e57773-509b-4938-8681-4a8203bf3ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:25:59 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5d1cdb39-cd54-480a-8fb1-f99ae6dcb591 tempest-AttachVolumeTestJSON-1478692577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96e57773-509b-4938-8681-4a8203bf3ced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:25:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1704713602',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5acd4330-bcb0-4b07-96cd-e73f620b65c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37bd84cc34c046a2ad58fd613c9cbc0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:25:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:25:59Z,use_quota=True,user_id='a81f9614803347f1b168a0a5b9c8cc61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:25:59 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5d1cdb39-cd54-480a-8fb1-f99ae6dcb591 tempest-AttachVolumeTestJSON-1478692577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e9abbe6-6720-49dd-be6d-079f77879603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:25:59 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5d1cdb39-cd54-480a-8fb1-f99ae6dcb591 tempest-AttachVolumeTestJSON-1478692577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e9abbe6-6720-49dd-be6d-079f77879603) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:25:59 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5d1cdb39-cd54-480a-8fb1-f99ae6dcb591 tempest-AttachVolumeTestJSON-1478692577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcc66c2e-0415-4d1a-bb4e-d8e9ba13a72a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:25:59 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5d1cdb39-cd54-480a-8fb1-f99ae6dcb591 tempest-AttachVolumeTestJSON-1478692577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcc66c2e-0415-4d1a-bb4e-d8e9ba13a72a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5acd4330-bcb0-4b07-96cd-e73f620b65c5', 'volume_name': 'volume-5acd4330-bcb0-4b07-96cd-e73f620b65c5', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:25:59 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5d1cdb39-cd54-480a-8fb1-f99ae6dcb591 tempest-AttachVolumeTestJSON-1478692577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47fbecba-e7ce-4ebf-9481-f17d1a1c5597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:25:59 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5d1cdb39-cd54-480a-8fb1-f99ae6dcb591 tempest-AttachVolumeTestJSON-1478692577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47fbecba-e7ce-4ebf-9481-f17d1a1c5597) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:25:59 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5d1cdb39-cd54-480a-8fb1-f99ae6dcb591 tempest-AttachVolumeTestJSON-1478692577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c41321c4-0922-472e-aa9a-a2b4e8fcd67b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:25:59 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-5d1cdb39-cd54-480a-8fb1-f99ae6dcb591 tempest-AttachVolumeTestJSON-1478692577 None] Volume 5acd4330-bcb0-4b07-96cd-e73f620b65c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5acd4330-bcb0-4b07-96cd-e73f620b65c5', 'volume_size': 1}
Jul 30 20:25:59 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-5d1cdb39-cd54-480a-8fb1-f99ae6dcb591 tempest-AttachVolumeTestJSON-1478692577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:25:59 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-5d1cdb39-cd54-480a-8fb1-f99ae6dcb591 tempest-AttachVolumeTestJSON-1478692577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:25:59 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-5d1cdb39-cd54-480a-8fb1-f99ae6dcb591 tempest-AttachVolumeTestJSON-1478692577 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:25:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1704713602',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5acd4330-bcb0-4b07-96cd-e73f620b65c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37bd84cc34c046a2ad58fd613c9cbc0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:25:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:25:59Z,use_quota=True,user_id='a81f9614803347f1b168a0a5b9c8cc61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:25:59 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-5d1cdb39-cd54-480a-8fb1-f99ae6dcb591 tempest-AttachVolumeTestJSON-1478692577 None] Creating volume 5acd4330-bcb0-4b07-96cd-e73f620b65c5 {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:25:59 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-5d1cdb39-cd54-480a-8fb1-f99ae6dcb591 tempest-AttachVolumeTestJSON-1478692577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:25:59 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-5d1cdb39-cd54-480a-8fb1-f99ae6dcb591 tempest-AttachVolumeTestJSON-1478692577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:25:59 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-5d1cdb39-cd54-480a-8fb1-f99ae6dcb591 tempest-AttachVolumeTestJSON-1478692577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:25:59 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-5d1cdb39-cd54-480a-8fb1-f99ae6dcb591 tempest-AttachVolumeTestJSON-1478692577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:25:59 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-5d1cdb39-cd54-480a-8fb1-f99ae6dcb591 tempest-AttachVolumeTestJSON-1478692577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:25:59 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-5d1cdb39-cd54-480a-8fb1-f99ae6dcb591 tempest-AttachVolumeTestJSON-1478692577 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:25:59 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-5d1cdb39-cd54-480a-8fb1-f99ae6dcb591 tempest-AttachVolumeTestJSON-1478692577 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:25:59 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-5d1cdb39-cd54-480a-8fb1-f99ae6dcb591 tempest-AttachVolumeTestJSON-1478692577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5acd4330-bcb0-4b07-96cd-e73f620b65c5 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:25:59 devstack sudo[93650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5acd4330-bcb0-4b07-96cd-e73f620b65c5 1073741824
Jul 30 20:25:59 devstack sudo[93650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:25:59 devstack sudo[93650]: pam_unix(sudo:session): session closed for user root
Jul 30 20:25:59 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-5d1cdb39-cd54-480a-8fb1-f99ae6dcb591 tempest-AttachVolumeTestJSON-1478692577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5acd4330-bcb0-4b07-96cd-e73f620b65c5 1073741824" returned: 0 in 0.504s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:25:59 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-5d1cdb39-cd54-480a-8fb1-f99ae6dcb591 tempest-AttachVolumeTestJSON-1478692577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5acd4330-bcb0-4b07-96cd-e73f620b65c5 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:25:59 devstack sudo[93656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5acd4330-bcb0-4b07-96cd-e73f620b65c5
Jul 30 20:25:59 devstack sudo[93656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:26:00 devstack sudo[93656]: pam_unix(sudo:session): session closed for user root
Jul 30 20:26:00 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-5d1cdb39-cd54-480a-8fb1-f99ae6dcb591 tempest-AttachVolumeTestJSON-1478692577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5acd4330-bcb0-4b07-96cd-e73f620b65c5" returned: 0 in 0.263s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:26:00 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-5d1cdb39-cd54-480a-8fb1-f99ae6dcb591 tempest-AttachVolumeTestJSON-1478692577 None] <== create_volume: return (810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:26:00 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-5d1cdb39-cd54-480a-8fb1-f99ae6dcb591 tempest-AttachVolumeTestJSON-1478692577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.813s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:26:00 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5d1cdb39-cd54-480a-8fb1-f99ae6dcb591 tempest-AttachVolumeTestJSON-1478692577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c41321c4-0922-472e-aa9a-a2b4e8fcd67b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5acd4330-bcb0-4b07-96cd-e73f620b65c5', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:26:00 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5d1cdb39-cd54-480a-8fb1-f99ae6dcb591 tempest-AttachVolumeTestJSON-1478692577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a125504-daf5-4ea3-bcc2-7247b7918599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:26:00 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-5d1cdb39-cd54-480a-8fb1-f99ae6dcb591 tempest-AttachVolumeTestJSON-1478692577 None] Volume volume-5acd4330-bcb0-4b07-96cd-e73f620b65c5 (5acd4330-bcb0-4b07-96cd-e73f620b65c5): created successfully
Jul 30 20:26:00 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5d1cdb39-cd54-480a-8fb1-f99ae6dcb591 tempest-AttachVolumeTestJSON-1478692577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a125504-daf5-4ea3-bcc2-7247b7918599) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:26:00 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5d1cdb39-cd54-480a-8fb1-f99ae6dcb591 tempest-AttachVolumeTestJSON-1478692577 None] Flow 'volume_create_manager' (d7183f09-a010-41f3-99af-07294cfed45e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:26:00 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-5d1cdb39-cd54-480a-8fb1-f99ae6dcb591 tempest-AttachVolumeTestJSON-1478692577 None] Created volume successfully.
Jul 30 20:26:00 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-a28c8bb6-dc4f-4601-91fe-a59f3ee3fcb2 tempest-BackendsCapabilitiesAdminTestsJSON-1823883219 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.754093170166, 'free_capacity_gb': 1775.754093170166, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88719) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Jul 30 20:26:00 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-23a4fb8d-4782-47bc-b994-fe8ddf573109 tempest-BackendsCapabilitiesAdminTestsJSON-1823883219 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.754093170166, 'free_capacity_gb': 1775.754093170166, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88719) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Jul 30 20:26:00 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bb30601-0e35-419a-96f1-a820b712443c tempest-ServersNegativeTestJSON-397937286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:26:00 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-4bb30601-0e35-419a-96f1-a820b712443c tempest-ServersNegativeTestJSON-397937286 None] Flow 'volume_create_manager' (bbdee1c3-6bfa-48fc-82e0-68f1df2ed412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:26:00 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-4bb30601-0e35-419a-96f1-a820b712443c tempest-ServersNegativeTestJSON-397937286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9384ef2-be28-457d-9954-a3eabe4ef8a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:26:00 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-4bb30601-0e35-419a-96f1-a820b712443c tempest-ServersNegativeTestJSON-397937286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9384ef2-be28-457d-9954-a3eabe4ef8a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:26:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1543142948',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52722ea6-16d9-41c8-bb8b-dcd7209d3c92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d97e7a58d0148efa4d351f11b86fafe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:26:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:26:01Z,use_quota=True,user_id='9f985bec46394d84bb11b1a8fc3f89c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:26:00 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-4bb30601-0e35-419a-96f1-a820b712443c tempest-ServersNegativeTestJSON-397937286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32a82442-6b88-4685-bb86-29fd7b13f53c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:26:00 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-4bb30601-0e35-419a-96f1-a820b712443c tempest-ServersNegativeTestJSON-397937286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32a82442-6b88-4685-bb86-29fd7b13f53c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:26:00 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-4bb30601-0e35-419a-96f1-a820b712443c tempest-ServersNegativeTestJSON-397937286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9d577d0-deaf-4bd0-b902-d6e56167d5a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:26:00 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-4bb30601-0e35-419a-96f1-a820b712443c tempest-ServersNegativeTestJSON-397937286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9d577d0-deaf-4bd0-b902-d6e56167d5a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52722ea6-16d9-41c8-bb8b-dcd7209d3c92', 'volume_name': 'volume-52722ea6-16d9-41c8-bb8b-dcd7209d3c92', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:26:00 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-4bb30601-0e35-419a-96f1-a820b712443c tempest-ServersNegativeTestJSON-397937286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4486f16-ce54-46b7-a861-1c8e0c367e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:26:00 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-4bb30601-0e35-419a-96f1-a820b712443c tempest-ServersNegativeTestJSON-397937286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4486f16-ce54-46b7-a861-1c8e0c367e4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:26:00 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-4bb30601-0e35-419a-96f1-a820b712443c tempest-ServersNegativeTestJSON-397937286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73900c76-a1f2-4648-9402-a154d8b65db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:26:00 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-4bb30601-0e35-419a-96f1-a820b712443c tempest-ServersNegativeTestJSON-397937286 None] Volume 52722ea6-16d9-41c8-bb8b-dcd7209d3c92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52722ea6-16d9-41c8-bb8b-dcd7209d3c92', 'volume_size': 1}
Jul 30 20:26:00 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-4bb30601-0e35-419a-96f1-a820b712443c tempest-ServersNegativeTestJSON-397937286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:26:00 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-4bb30601-0e35-419a-96f1-a820b712443c tempest-ServersNegativeTestJSON-397937286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:26:00 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-4bb30601-0e35-419a-96f1-a820b712443c tempest-ServersNegativeTestJSON-397937286 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:26:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1543142948',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52722ea6-16d9-41c8-bb8b-dcd7209d3c92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d97e7a58d0148efa4d351f11b86fafe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:26:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:26:01Z,use_quota=True,user_id='9f985bec46394d84bb11b1a8fc3f89c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:26:00 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-4bb30601-0e35-419a-96f1-a820b712443c tempest-ServersNegativeTestJSON-397937286 None] Creating volume 52722ea6-16d9-41c8-bb8b-dcd7209d3c92 {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:26:00 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-4bb30601-0e35-419a-96f1-a820b712443c tempest-ServersNegativeTestJSON-397937286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:26:00 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-4bb30601-0e35-419a-96f1-a820b712443c tempest-ServersNegativeTestJSON-397937286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:26:00 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-4bb30601-0e35-419a-96f1-a820b712443c tempest-ServersNegativeTestJSON-397937286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:26:00 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-4bb30601-0e35-419a-96f1-a820b712443c tempest-ServersNegativeTestJSON-397937286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:26:00 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-4bb30601-0e35-419a-96f1-a820b712443c tempest-ServersNegativeTestJSON-397937286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:26:00 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-4bb30601-0e35-419a-96f1-a820b712443c tempest-ServersNegativeTestJSON-397937286 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:26:00 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-4bb30601-0e35-419a-96f1-a820b712443c tempest-ServersNegativeTestJSON-397937286 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:26:00 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-4bb30601-0e35-419a-96f1-a820b712443c tempest-ServersNegativeTestJSON-397937286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-52722ea6-16d9-41c8-bb8b-dcd7209d3c92 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:26:00 devstack sudo[93660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-52722ea6-16d9-41c8-bb8b-dcd7209d3c92 1073741824
Jul 30 20:26:00 devstack sudo[93660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:26:01 devstack sudo[93660]: pam_unix(sudo:session): session closed for user root
Jul 30 20:26:01 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-4bb30601-0e35-419a-96f1-a820b712443c tempest-ServersNegativeTestJSON-397937286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-52722ea6-16d9-41c8-bb8b-dcd7209d3c92 1073741824" returned: 0 in 0.464s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:26:01 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-4bb30601-0e35-419a-96f1-a820b712443c tempest-ServersNegativeTestJSON-397937286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-52722ea6-16d9-41c8-bb8b-dcd7209d3c92 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:26:01 devstack sudo[93666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-52722ea6-16d9-41c8-bb8b-dcd7209d3c92
Jul 30 20:26:01 devstack sudo[93666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:26:01 devstack sudo[93666]: pam_unix(sudo:session): session closed for user root
Jul 30 20:26:01 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-4bb30601-0e35-419a-96f1-a820b712443c tempest-ServersNegativeTestJSON-397937286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-52722ea6-16d9-41c8-bb8b-dcd7209d3c92" returned: 0 in 0.307s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:26:01 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-4bb30601-0e35-419a-96f1-a820b712443c tempest-ServersNegativeTestJSON-397937286 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:26:01 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-4bb30601-0e35-419a-96f1-a820b712443c tempest-ServersNegativeTestJSON-397937286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.817s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:26:01 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-4bb30601-0e35-419a-96f1-a820b712443c tempest-ServersNegativeTestJSON-397937286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73900c76-a1f2-4648-9402-a154d8b65db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52722ea6-16d9-41c8-bb8b-dcd7209d3c92', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:26:01 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-4bb30601-0e35-419a-96f1-a820b712443c tempest-ServersNegativeTestJSON-397937286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6370e825-4c34-4480-913a-f59127c65aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:26:01 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-4bb30601-0e35-419a-96f1-a820b712443c tempest-ServersNegativeTestJSON-397937286 None] Volume volume-52722ea6-16d9-41c8-bb8b-dcd7209d3c92 (52722ea6-16d9-41c8-bb8b-dcd7209d3c92): created successfully
Jul 30 20:26:01 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-4bb30601-0e35-419a-96f1-a820b712443c tempest-ServersNegativeTestJSON-397937286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6370e825-4c34-4480-913a-f59127c65aea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:26:01 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-4bb30601-0e35-419a-96f1-a820b712443c tempest-ServersNegativeTestJSON-397937286 None] Flow 'volume_create_manager' (bbdee1c3-6bfa-48fc-82e0-68f1df2ed412) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:26:01 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-4bb30601-0e35-419a-96f1-a820b712443c tempest-ServersNegativeTestJSON-397937286 None] Created volume successfully.
Jul 30 20:26:02 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [req-0c03d450-6d62-46e3-825a-71cde74c7fca req-27d6979d-05a8-4c9c-8cae-a66682301f02 tempest-AttachVolumeTestJSON-1478692577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:26:02 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [req-0c03d450-6d62-46e3-825a-71cde74c7fca req-27d6979d-05a8-4c9c-8cae-a66682301f02 tempest-AttachVolumeTestJSON-1478692577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:26:02 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [req-0c03d450-6d62-46e3-825a-71cde74c7fca req-27d6979d-05a8-4c9c-8cae-a66682301f02 tempest-AttachVolumeTestJSON-1478692577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:26:02 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [req-0c03d450-6d62-46e3-825a-71cde74c7fca req-27d6979d-05a8-4c9c-8cae-a66682301f02 tempest-AttachVolumeTestJSON-1478692577 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5', 'name': 'volume-5acd4330-bcb0-4b07-96cd-e73f620b65c5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f55e25cc-e933-44ca-b28b-94c9cc726e89', 'enforce_multipath': True} {{(pid=88719) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 30 20:26:03 devstack cinder-volume[88719]: INFO cinder.volume.manager [req-0c03d450-6d62-46e3-825a-71cde74c7fca req-27d6979d-05a8-4c9c-8cae-a66682301f02 tempest-AttachVolumeTestJSON-1478692577 None] attachment_update completed successfully.
Jul 30 20:26:04 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-e61aee28-93a7-419d-91ed-608c3bc5d644 tempest-ServersNegativeTestJSON-397937286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:26:04 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e61aee28-93a7-419d-91ed-608c3bc5d644 tempest-ServersNegativeTestJSON-397937286 None] Flow 'volume_create_manager' (c49f0407-7b58-409a-9b57-c3ec3dd7f564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:26:04 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e61aee28-93a7-419d-91ed-608c3bc5d644 tempest-ServersNegativeTestJSON-397937286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6396b41-daae-4ebe-8f30-565a3816a368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:26:04 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e61aee28-93a7-419d-91ed-608c3bc5d644 tempest-ServersNegativeTestJSON-397937286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6396b41-daae-4ebe-8f30-565a3816a368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:26:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-393097049',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dae1b42b-1242-43f0-8c79-d71d0ddb7521,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d97e7a58d0148efa4d351f11b86fafe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:26:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:26:05Z,use_quota=True,user_id='9f985bec46394d84bb11b1a8fc3f89c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:26:04 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e61aee28-93a7-419d-91ed-608c3bc5d644 tempest-ServersNegativeTestJSON-397937286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7aa9df70-f6f6-4b85-9dff-b13fc5db278a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:26:04 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e61aee28-93a7-419d-91ed-608c3bc5d644 tempest-ServersNegativeTestJSON-397937286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7aa9df70-f6f6-4b85-9dff-b13fc5db278a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:26:04 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e61aee28-93a7-419d-91ed-608c3bc5d644 tempest-ServersNegativeTestJSON-397937286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8995a276-3d3e-47d8-8a6a-c1d8fb0a3b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:26:04 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e61aee28-93a7-419d-91ed-608c3bc5d644 tempest-ServersNegativeTestJSON-397937286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8995a276-3d3e-47d8-8a6a-c1d8fb0a3b90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dae1b42b-1242-43f0-8c79-d71d0ddb7521', 'volume_name': 'volume-dae1b42b-1242-43f0-8c79-d71d0ddb7521', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:26:04 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e61aee28-93a7-419d-91ed-608c3bc5d644 tempest-ServersNegativeTestJSON-397937286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b19ded1-8022-4864-9098-ff5585965889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:26:04 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e61aee28-93a7-419d-91ed-608c3bc5d644 tempest-ServersNegativeTestJSON-397937286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b19ded1-8022-4864-9098-ff5585965889) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:26:04 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e61aee28-93a7-419d-91ed-608c3bc5d644 tempest-ServersNegativeTestJSON-397937286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e02caa7-ec01-40ec-a508-8b16cd00d678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:26:04 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-e61aee28-93a7-419d-91ed-608c3bc5d644 tempest-ServersNegativeTestJSON-397937286 None] Volume dae1b42b-1242-43f0-8c79-d71d0ddb7521: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dae1b42b-1242-43f0-8c79-d71d0ddb7521', 'volume_size': 1}
Jul 30 20:26:04 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-e61aee28-93a7-419d-91ed-608c3bc5d644 tempest-ServersNegativeTestJSON-397937286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:26:04 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-e61aee28-93a7-419d-91ed-608c3bc5d644 tempest-ServersNegativeTestJSON-397937286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:26:04 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-e61aee28-93a7-419d-91ed-608c3bc5d644 tempest-ServersNegativeTestJSON-397937286 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:26:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-393097049',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dae1b42b-1242-43f0-8c79-d71d0ddb7521,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d97e7a58d0148efa4d351f11b86fafe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:26:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:26:05Z,use_quota=True,user_id='9f985bec46394d84bb11b1a8fc3f89c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:26:04 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-e61aee28-93a7-419d-91ed-608c3bc5d644 tempest-ServersNegativeTestJSON-397937286 None] Creating volume dae1b42b-1242-43f0-8c79-d71d0ddb7521 {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:26:04 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-e61aee28-93a7-419d-91ed-608c3bc5d644 tempest-ServersNegativeTestJSON-397937286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:26:04 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-e61aee28-93a7-419d-91ed-608c3bc5d644 tempest-ServersNegativeTestJSON-397937286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:26:04 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-e61aee28-93a7-419d-91ed-608c3bc5d644 tempest-ServersNegativeTestJSON-397937286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:26:04 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-e61aee28-93a7-419d-91ed-608c3bc5d644 tempest-ServersNegativeTestJSON-397937286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:26:04 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-e61aee28-93a7-419d-91ed-608c3bc5d644 tempest-ServersNegativeTestJSON-397937286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:26:04 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-e61aee28-93a7-419d-91ed-608c3bc5d644 tempest-ServersNegativeTestJSON-397937286 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:26:04 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-e61aee28-93a7-419d-91ed-608c3bc5d644 tempest-ServersNegativeTestJSON-397937286 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:26:04 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-e61aee28-93a7-419d-91ed-608c3bc5d644 tempest-ServersNegativeTestJSON-397937286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-dae1b42b-1242-43f0-8c79-d71d0ddb7521 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:26:04 devstack sudo[94070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-dae1b42b-1242-43f0-8c79-d71d0ddb7521 1073741824
Jul 30 20:26:04 devstack sudo[94070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:26:05 devstack sudo[94070]: pam_unix(sudo:session): session closed for user root
Jul 30 20:26:05 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-e61aee28-93a7-419d-91ed-608c3bc5d644 tempest-ServersNegativeTestJSON-397937286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-dae1b42b-1242-43f0-8c79-d71d0ddb7521 1073741824" returned: 0 in 0.643s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:26:05 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-e61aee28-93a7-419d-91ed-608c3bc5d644 tempest-ServersNegativeTestJSON-397937286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-dae1b42b-1242-43f0-8c79-d71d0ddb7521 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:26:05 devstack sudo[94084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-dae1b42b-1242-43f0-8c79-d71d0ddb7521
Jul 30 20:26:05 devstack sudo[94084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:26:05 devstack sudo[94084]: pam_unix(sudo:session): session closed for user root
Jul 30 20:26:05 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-e61aee28-93a7-419d-91ed-608c3bc5d644 tempest-ServersNegativeTestJSON-397937286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-dae1b42b-1242-43f0-8c79-d71d0ddb7521" returned: 0 in 0.282s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:26:05 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-e61aee28-93a7-419d-91ed-608c3bc5d644 tempest-ServersNegativeTestJSON-397937286 None] <== create_volume: return (985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:26:05 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-e61aee28-93a7-419d-91ed-608c3bc5d644 tempest-ServersNegativeTestJSON-397937286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:26:05 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e61aee28-93a7-419d-91ed-608c3bc5d644 tempest-ServersNegativeTestJSON-397937286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e02caa7-ec01-40ec-a508-8b16cd00d678) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dae1b42b-1242-43f0-8c79-d71d0ddb7521', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:26:05 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e61aee28-93a7-419d-91ed-608c3bc5d644 tempest-ServersNegativeTestJSON-397937286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d9376f8-5706-4cc1-a167-573f4b40b577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:26:05 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-e61aee28-93a7-419d-91ed-608c3bc5d644 tempest-ServersNegativeTestJSON-397937286 None] Volume volume-dae1b42b-1242-43f0-8c79-d71d0ddb7521 (dae1b42b-1242-43f0-8c79-d71d0ddb7521): created successfully
Jul 30 20:26:05 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e61aee28-93a7-419d-91ed-608c3bc5d644 tempest-ServersNegativeTestJSON-397937286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d9376f8-5706-4cc1-a167-573f4b40b577) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:26:05 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e61aee28-93a7-419d-91ed-608c3bc5d644 tempest-ServersNegativeTestJSON-397937286 None] Flow 'volume_create_manager' (c49f0407-7b58-409a-9b57-c3ec3dd7f564) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:26:05 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-e61aee28-93a7-419d-91ed-608c3bc5d644 tempest-ServersNegativeTestJSON-397937286 None] Created volume successfully.
Jul 30 20:26:06 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-c2f915c0-a954-487a-b652-82d84d2374e8 tempest-GroupSnapshotsV319Test-1206656491 None] Group tempest-GroupSnapshotsV319Test-Group-736374285: creating
Jul 30 20:26:06 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-c2f915c0-a954-487a-b652-82d84d2374e8 tempest-GroupSnapshotsV319Test-1206656491 None] Group tempest-GroupSnapshotsV319Test-Group-736374285: created successfully
Jul 30 20:26:06 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-c2f915c0-a954-487a-b652-82d84d2374e8 tempest-GroupSnapshotsV319Test-1206656491 None] Create group completed successfully.
Jul 30 20:26:07 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-53f6d34e-31bd-46c6-aae9-20dd41b788ef tempest-ServersNegativeTestJSON-397937286 None] Acquiring lock "cinder-dae1b42b-1242-43f0-8c79-d71d0ddb7521-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:26:07 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-53f6d34e-31bd-46c6-aae9-20dd41b788ef tempest-ServersNegativeTestJSON-397937286 None] Lock "cinder-dae1b42b-1242-43f0-8c79-d71d0ddb7521-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:26:07 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-53f6d34e-31bd-46c6-aae9-20dd41b788ef tempest-ServersNegativeTestJSON-397937286 None] Acquiring lock "cinder-quobyte-dae1b42b-1242-43f0-8c79-d71d0ddb7521" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:26:07 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-53f6d34e-31bd-46c6-aae9-20dd41b788ef tempest-ServersNegativeTestJSON-397937286 None] Lock "cinder-quobyte-dae1b42b-1242-43f0-8c79-d71d0ddb7521" acquired by "delete_volume" :: waited 0.016s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:26:07 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0ea8c7a-3541-48c9-abe9-fbe88ad68e5d]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:26:07 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-53f6d34e-31bd-46c6-aae9-20dd41b788ef tempest-ServersNegativeTestJSON-397937286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-dae1b42b-1242-43f0-8c79-d71d0ddb7521 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:26:07 devstack sudo[94097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-dae1b42b-1242-43f0-8c79-d71d0ddb7521
Jul 30 20:26:07 devstack sudo[94097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:26:07 devstack sudo[94097]: pam_unix(sudo:session): session closed for user root
Jul 30 20:26:07 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-53f6d34e-31bd-46c6-aae9-20dd41b788ef tempest-ServersNegativeTestJSON-397937286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-dae1b42b-1242-43f0-8c79-d71d0ddb7521" returned: 0 in 0.527s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:26:07 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-53f6d34e-31bd-46c6-aae9-20dd41b788ef tempest-ServersNegativeTestJSON-397937286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-dae1b42b-1242-43f0-8c79-d71d0ddb7521 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:26:07 devstack sudo[94139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-dae1b42b-1242-43f0-8c79-d71d0ddb7521
Jul 30 20:26:07 devstack sudo[94139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:26:08 devstack sudo[94139]: pam_unix(sudo:session): session closed for user root
Jul 30 20:26:08 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-53f6d34e-31bd-46c6-aae9-20dd41b788ef tempest-ServersNegativeTestJSON-397937286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-dae1b42b-1242-43f0-8c79-d71d0ddb7521" returned: 0 in 0.402s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:26:08 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-53f6d34e-31bd-46c6-aae9-20dd41b788ef tempest-ServersNegativeTestJSON-397937286 None] Lock "cinder-quobyte-dae1b42b-1242-43f0-8c79-d71d0ddb7521" released by "delete_volume" :: held 0.983s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:26:08 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-53f6d34e-31bd-46c6-aae9-20dd41b788ef tempest-ServersNegativeTestJSON-397937286 None] Created reservations ['d4a6abdd-3e5a-43f8-a68b-7b9acd92a0e8', '4b4a0a64-7ee3-412d-af04-b3d7400c57ff', '5baec33d-9daa-43ec-b312-d23023652693', '7b2041bd-6d40-4cfa-92fd-a21b239dbe8e'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:26:08 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-28e4e734-6a97-4f95-b958-4b7bd4eff4d8 tempest-GroupSnapshotsV319Test-1206656491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:26:08 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-28e4e734-6a97-4f95-b958-4b7bd4eff4d8 tempest-GroupSnapshotsV319Test-1206656491 None] Flow 'volume_create_manager' (0b0776d0-7eef-4a30-ac6b-05fd2b054abc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:26:08 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-28e4e734-6a97-4f95-b958-4b7bd4eff4d8 tempest-GroupSnapshotsV319Test-1206656491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e9cd52b-fb79-4c27-b837-2d381b830731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:26:08 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-53f6d34e-31bd-46c6-aae9-20dd41b788ef tempest-ServersNegativeTestJSON-397937286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:26:08 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-53f6d34e-31bd-46c6-aae9-20dd41b788ef tempest-ServersNegativeTestJSON-397937286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:26:08 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-53f6d34e-31bd-46c6-aae9-20dd41b788ef tempest-ServersNegativeTestJSON-397937286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:26:08 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-53f6d34e-31bd-46c6-aae9-20dd41b788ef tempest-ServersNegativeTestJSON-397937286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:26:08 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-53f6d34e-31bd-46c6-aae9-20dd41b788ef tempest-ServersNegativeTestJSON-397937286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:26:08 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-53f6d34e-31bd-46c6-aae9-20dd41b788ef tempest-ServersNegativeTestJSON-397937286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:26:08 devstack sudo[94215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:26:08 devstack sudo[94215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:26:08 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-28e4e734-6a97-4f95-b958-4b7bd4eff4d8 tempest-GroupSnapshotsV319Test-1206656491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e9cd52b-fb79-4c27-b837-2d381b830731) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:26:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1893381175',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=f72d2d43-2256-4990-a9c1-802a15caa95f,host='devstack@QuobyteHD#QuobyteHD',id=5522de5a-dc0d-47af-ba5c-4a7c0dd4fbc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d81a15357aec47e7bf1a3629fae903fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:26:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:26:08Z,use_quota=True,user_id='b2fca03c2e5049599494e56ba230a1c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(622a2e32-e164-493c-bf78-7497ff9e686b),volume_type_id=622a2e32-e164-493c-bf78-7497ff9e686b)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:26:08 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-28e4e734-6a97-4f95-b958-4b7bd4eff4d8 tempest-GroupSnapshotsV319Test-1206656491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67110c54-fb49-41ec-9a9e-7e5568ae460e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:26:08 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-28e4e734-6a97-4f95-b958-4b7bd4eff4d8 tempest-GroupSnapshotsV319Test-1206656491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67110c54-fb49-41ec-9a9e-7e5568ae460e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:26:08 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-28e4e734-6a97-4f95-b958-4b7bd4eff4d8 tempest-GroupSnapshotsV319Test-1206656491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a7d743e-18ef-4966-b410-2fcfbfdc6237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:26:08 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-28e4e734-6a97-4f95-b958-4b7bd4eff4d8 tempest-GroupSnapshotsV319Test-1206656491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a7d743e-18ef-4966-b410-2fcfbfdc6237) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5522de5a-dc0d-47af-ba5c-4a7c0dd4fbc6', 'volume_name': 'volume-5522de5a-dc0d-47af-ba5c-4a7c0dd4fbc6', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:26:08 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-28e4e734-6a97-4f95-b958-4b7bd4eff4d8 tempest-GroupSnapshotsV319Test-1206656491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d41eb103-26a0-489d-8a9c-2671ec33bafd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:26:08 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-28e4e734-6a97-4f95-b958-4b7bd4eff4d8 tempest-GroupSnapshotsV319Test-1206656491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d41eb103-26a0-489d-8a9c-2671ec33bafd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:26:08 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-28e4e734-6a97-4f95-b958-4b7bd4eff4d8 tempest-GroupSnapshotsV319Test-1206656491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1de1e715-3627-45db-a600-5d0d3a303059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:26:08 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-28e4e734-6a97-4f95-b958-4b7bd4eff4d8 tempest-GroupSnapshotsV319Test-1206656491 None] Volume 5522de5a-dc0d-47af-ba5c-4a7c0dd4fbc6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5522de5a-dc0d-47af-ba5c-4a7c0dd4fbc6', 'volume_size': 1}
Jul 30 20:26:08 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-28e4e734-6a97-4f95-b958-4b7bd4eff4d8 tempest-GroupSnapshotsV319Test-1206656491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:26:08 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-28e4e734-6a97-4f95-b958-4b7bd4eff4d8 tempest-GroupSnapshotsV319Test-1206656491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:26:08 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-28e4e734-6a97-4f95-b958-4b7bd4eff4d8 tempest-GroupSnapshotsV319Test-1206656491 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=f72d2d43-2256-4990-a9c1-802a15caa95f,created_at=2026-07-30T18:26:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1893381175',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=f72d2d43-2256-4990-a9c1-802a15caa95f,host='devstack@QuobyteHD#QuobyteHD',id=5522de5a-dc0d-47af-ba5c-4a7c0dd4fbc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d81a15357aec47e7bf1a3629fae903fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:26:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:26:08Z,use_quota=True,user_id='b2fca03c2e5049599494e56ba230a1c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(622a2e32-e164-493c-bf78-7497ff9e686b),volume_type_id=622a2e32-e164-493c-bf78-7497ff9e686b)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:26:08 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-28e4e734-6a97-4f95-b958-4b7bd4eff4d8 tempest-GroupSnapshotsV319Test-1206656491 None] Creating volume 5522de5a-dc0d-47af-ba5c-4a7c0dd4fbc6 {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:26:08 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-28e4e734-6a97-4f95-b958-4b7bd4eff4d8 tempest-GroupSnapshotsV319Test-1206656491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:26:08 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-28e4e734-6a97-4f95-b958-4b7bd4eff4d8 tempest-GroupSnapshotsV319Test-1206656491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:26:08 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-28e4e734-6a97-4f95-b958-4b7bd4eff4d8 tempest-GroupSnapshotsV319Test-1206656491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:26:08 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-28e4e734-6a97-4f95-b958-4b7bd4eff4d8 tempest-GroupSnapshotsV319Test-1206656491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:26:08 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-28e4e734-6a97-4f95-b958-4b7bd4eff4d8 tempest-GroupSnapshotsV319Test-1206656491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:26:08 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-28e4e734-6a97-4f95-b958-4b7bd4eff4d8 tempest-GroupSnapshotsV319Test-1206656491 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:26:08 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-28e4e734-6a97-4f95-b958-4b7bd4eff4d8 tempest-GroupSnapshotsV319Test-1206656491 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:26:08 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-28e4e734-6a97-4f95-b958-4b7bd4eff4d8 tempest-GroupSnapshotsV319Test-1206656491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5522de5a-dc0d-47af-ba5c-4a7c0dd4fbc6 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:26:08 devstack sudo[94221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5522de5a-dc0d-47af-ba5c-4a7c0dd4fbc6 1073741824
Jul 30 20:26:08 devstack sudo[94221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:26:08 devstack sudo[94215]: pam_unix(sudo:session): session closed for user root
Jul 30 20:26:08 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-53f6d34e-31bd-46c6-aae9-20dd41b788ef tempest-ServersNegativeTestJSON-397937286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.361s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:26:08 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-53f6d34e-31bd-46c6-aae9-20dd41b788ef tempest-ServersNegativeTestJSON-397937286 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:26:08 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-53f6d34e-31bd-46c6-aae9-20dd41b788ef tempest-ServersNegativeTestJSON-397937286 None] Deleted volume successfully.
Jul 30 20:26:08 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-53f6d34e-31bd-46c6-aae9-20dd41b788ef tempest-ServersNegativeTestJSON-397937286 None] Lock "cinder-dae1b42b-1242-43f0-8c79-d71d0ddb7521-delete_volume" released by "delete_volume" :: held 1.789s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:26:09 devstack sudo[94221]: pam_unix(sudo:session): session closed for user root
Jul 30 20:26:09 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-28e4e734-6a97-4f95-b958-4b7bd4eff4d8 tempest-GroupSnapshotsV319Test-1206656491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5522de5a-dc0d-47af-ba5c-4a7c0dd4fbc6 1073741824" returned: 0 in 0.554s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:26:09 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-28e4e734-6a97-4f95-b958-4b7bd4eff4d8 tempest-GroupSnapshotsV319Test-1206656491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5522de5a-dc0d-47af-ba5c-4a7c0dd4fbc6 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:26:09 devstack sudo[94251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5522de5a-dc0d-47af-ba5c-4a7c0dd4fbc6
Jul 30 20:26:09 devstack sudo[94251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:26:09 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-f446b17d-d232-4243-ba65-cb9b85ca5ee0 tempest-ServersNegativeTestJSON-397937286 None] Acquiring lock "cinder-52722ea6-16d9-41c8-bb8b-dcd7209d3c92-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:26:09 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-f446b17d-d232-4243-ba65-cb9b85ca5ee0 tempest-ServersNegativeTestJSON-397937286 None] Lock "cinder-52722ea6-16d9-41c8-bb8b-dcd7209d3c92-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:26:09 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-f446b17d-d232-4243-ba65-cb9b85ca5ee0 tempest-ServersNegativeTestJSON-397937286 None] Acquiring lock "cinder-quobyte-52722ea6-16d9-41c8-bb8b-dcd7209d3c92" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:26:09 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-f446b17d-d232-4243-ba65-cb9b85ca5ee0 tempest-ServersNegativeTestJSON-397937286 None] Lock "cinder-quobyte-52722ea6-16d9-41c8-bb8b-dcd7209d3c92" acquired by "delete_volume" :: waited 0.032s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:26:09 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9ac1fb0-0cc1-43fa-9fb0-41766d885eda]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:26:09 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f446b17d-d232-4243-ba65-cb9b85ca5ee0 tempest-ServersNegativeTestJSON-397937286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-52722ea6-16d9-41c8-bb8b-dcd7209d3c92 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:26:09 devstack sudo[94251]: pam_unix(sudo:session): session closed for user root
Jul 30 20:26:09 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-28e4e734-6a97-4f95-b958-4b7bd4eff4d8 tempest-GroupSnapshotsV319Test-1206656491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5522de5a-dc0d-47af-ba5c-4a7c0dd4fbc6" returned: 0 in 0.476s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:26:09 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-28e4e734-6a97-4f95-b958-4b7bd4eff4d8 tempest-GroupSnapshotsV319Test-1206656491 None] <== create_volume: return (1126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:26:09 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-28e4e734-6a97-4f95-b958-4b7bd4eff4d8 tempest-GroupSnapshotsV319Test-1206656491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.130s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:26:09 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-28e4e734-6a97-4f95-b958-4b7bd4eff4d8 tempest-GroupSnapshotsV319Test-1206656491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1de1e715-3627-45db-a600-5d0d3a303059) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5522de5a-dc0d-47af-ba5c-4a7c0dd4fbc6', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:26:09 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-28e4e734-6a97-4f95-b958-4b7bd4eff4d8 tempest-GroupSnapshotsV319Test-1206656491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96c18919-0d55-4004-b285-7970fbf0ad0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:26:09 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-28e4e734-6a97-4f95-b958-4b7bd4eff4d8 tempest-GroupSnapshotsV319Test-1206656491 None] Volume volume-5522de5a-dc0d-47af-ba5c-4a7c0dd4fbc6 (5522de5a-dc0d-47af-ba5c-4a7c0dd4fbc6): created successfully
Jul 30 20:26:09 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-28e4e734-6a97-4f95-b958-4b7bd4eff4d8 tempest-GroupSnapshotsV319Test-1206656491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96c18919-0d55-4004-b285-7970fbf0ad0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:26:09 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-28e4e734-6a97-4f95-b958-4b7bd4eff4d8 tempest-GroupSnapshotsV319Test-1206656491 None] Flow 'volume_create_manager' (0b0776d0-7eef-4a30-ac6b-05fd2b054abc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:26:09 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-28e4e734-6a97-4f95-b958-4b7bd4eff4d8 tempest-GroupSnapshotsV319Test-1206656491 None] Created volume successfully.
Jul 30 20:26:09 devstack sudo[94591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-52722ea6-16d9-41c8-bb8b-dcd7209d3c92
Jul 30 20:26:09 devstack sudo[94591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:26:10 devstack sudo[94591]: pam_unix(sudo:session): session closed for user root
Jul 30 20:26:10 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f446b17d-d232-4243-ba65-cb9b85ca5ee0 tempest-ServersNegativeTestJSON-397937286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-52722ea6-16d9-41c8-bb8b-dcd7209d3c92" returned: 0 in 0.498s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:26:10 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f446b17d-d232-4243-ba65-cb9b85ca5ee0 tempest-ServersNegativeTestJSON-397937286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-52722ea6-16d9-41c8-bb8b-dcd7209d3c92 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:26:10 devstack sudo[94615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-52722ea6-16d9-41c8-bb8b-dcd7209d3c92
Jul 30 20:26:10 devstack sudo[94615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:26:10 devstack sudo[94615]: pam_unix(sudo:session): session closed for user root
Jul 30 20:26:10 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f446b17d-d232-4243-ba65-cb9b85ca5ee0 tempest-ServersNegativeTestJSON-397937286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-52722ea6-16d9-41c8-bb8b-dcd7209d3c92" returned: 0 in 0.281s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:26:10 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-f446b17d-d232-4243-ba65-cb9b85ca5ee0 tempest-ServersNegativeTestJSON-397937286 None] Lock "cinder-quobyte-52722ea6-16d9-41c8-bb8b-dcd7209d3c92" released by "delete_volume" :: held 0.843s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:26:10 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-f446b17d-d232-4243-ba65-cb9b85ca5ee0 tempest-ServersNegativeTestJSON-397937286 None] Created reservations ['73b186de-4cc2-4a14-94bc-9985d6c959c6', 'c606effb-8d3b-4b50-bdcb-c3c05660e6d4', '23154a75-ba4e-41a0-8c18-08219655610d', '393d0b76-9ce5-40a1-80a0-ec1bcfbd5cd1'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:26:10 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-f446b17d-d232-4243-ba65-cb9b85ca5ee0 tempest-ServersNegativeTestJSON-397937286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:26:10 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-f446b17d-d232-4243-ba65-cb9b85ca5ee0 tempest-ServersNegativeTestJSON-397937286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:26:10 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-f446b17d-d232-4243-ba65-cb9b85ca5ee0 tempest-ServersNegativeTestJSON-397937286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:26:10 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-f446b17d-d232-4243-ba65-cb9b85ca5ee0 tempest-ServersNegativeTestJSON-397937286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:26:10 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-f446b17d-d232-4243-ba65-cb9b85ca5ee0 tempest-ServersNegativeTestJSON-397937286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:26:10 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f446b17d-d232-4243-ba65-cb9b85ca5ee0 tempest-ServersNegativeTestJSON-397937286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:26:10 devstack sudo[94632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:26:10 devstack sudo[94632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:26:10 devstack sudo[94632]: pam_unix(sudo:session): session closed for user root
Jul 30 20:26:10 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f446b17d-d232-4243-ba65-cb9b85ca5ee0 tempest-ServersNegativeTestJSON-397937286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.295s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:26:10 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-f446b17d-d232-4243-ba65-cb9b85ca5ee0 tempest-ServersNegativeTestJSON-397937286 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:26:10 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-f446b17d-d232-4243-ba65-cb9b85ca5ee0 tempest-ServersNegativeTestJSON-397937286 None] Deleted volume successfully.
Jul 30 20:26:10 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-f446b17d-d232-4243-ba65-cb9b85ca5ee0 tempest-ServersNegativeTestJSON-397937286 None] Lock "cinder-52722ea6-16d9-41c8-bb8b-dcd7209d3c92-delete_volume" released by "delete_volume" :: held 1.381s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:26:11 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-f1d0806f-693c-44c6-abb0-20e7c398b2b7 tempest-GroupSnapshotsV319Test-1206656491 None] GroupSnapshot 22bb87ca-a00b-455e-9bee-eb03e10c4e4b: creating.
Jul 30 20:26:11 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-f1d0806f-693c-44c6-abb0-20e7c398b2b7 tempest-GroupSnapshotsV319Test-1206656491 None] Group snapshot 22bb87ca-a00b-455e-9bee-eb03e10c4e4b: creating. {{(pid=88719) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jul 30 20:26:11 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-f1d0806f-693c-44c6-abb0-20e7c398b2b7 tempest-GroupSnapshotsV319Test-1206656491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:26:11 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-f1d0806f-693c-44c6-abb0-20e7c398b2b7 tempest-GroupSnapshotsV319Test-1206656491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:26:11 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-f1d0806f-693c-44c6-abb0-20e7c398b2b7 tempest-GroupSnapshotsV319Test-1206656491 None] Creating offline snapshot 38332b49-f487-4d41-968f-506bcd8f670d of volume 5522de5a-dc0d-47af-ba5c-4a7c0dd4fbc6 {{(pid=88719) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 30 20:26:11 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b2d051a-e4ca-4392-8220-d37fcaeb19ea]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:26:11 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f1d0806f-693c-44c6-abb0-20e7c398b2b7 tempest-GroupSnapshotsV319Test-1206656491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5522de5a-dc0d-47af-ba5c-4a7c0dd4fbc6 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:26:11 devstack sudo[94648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5522de5a-dc0d-47af-ba5c-4a7c0dd4fbc6
Jul 30 20:26:11 devstack sudo[94648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:26:11 devstack sudo[94648]: pam_unix(sudo:session): session closed for user root
Jul 30 20:26:11 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f1d0806f-693c-44c6-abb0-20e7c398b2b7 tempest-GroupSnapshotsV319Test-1206656491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5522de5a-dc0d-47af-ba5c-4a7c0dd4fbc6" returned: 0 in 0.567s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:26:11 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f1d0806f-693c-44c6-abb0-20e7c398b2b7 tempest-GroupSnapshotsV319Test-1206656491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5522de5a-dc0d-47af-ba5c-4a7c0dd4fbc6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5522de5a-dc0d-47af-ba5c-4a7c0dd4fbc6.38332b49-f487-4d41-968f-506bcd8f670d 1G {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:26:11 devstack sudo[94671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5522de5a-dc0d-47af-ba5c-4a7c0dd4fbc6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5522de5a-dc0d-47af-ba5c-4a7c0dd4fbc6.38332b49-f487-4d41-968f-506bcd8f670d 1G
Jul 30 20:26:11 devstack sudo[94671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:26:12 devstack sudo[94671]: pam_unix(sudo:session): session closed for user root
Jul 30 20:26:12 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f1d0806f-693c-44c6-abb0-20e7c398b2b7 tempest-GroupSnapshotsV319Test-1206656491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5522de5a-dc0d-47af-ba5c-4a7c0dd4fbc6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5522de5a-dc0d-47af-ba5c-4a7c0dd4fbc6.38332b49-f487-4d41-968f-506bcd8f670d 1G" returned: 0 in 0.654s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:26:12 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f1d0806f-693c-44c6-abb0-20e7c398b2b7 tempest-GroupSnapshotsV319Test-1206656491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5522de5a-dc0d-47af-ba5c-4a7c0dd4fbc6 -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5522de5a-dc0d-47af-ba5c-4a7c0dd4fbc6.38332b49-f487-4d41-968f-506bcd8f670d {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:26:12 devstack sudo[94688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5522de5a-dc0d-47af-ba5c-4a7c0dd4fbc6 -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5522de5a-dc0d-47af-ba5c-4a7c0dd4fbc6.38332b49-f487-4d41-968f-506bcd8f670d
Jul 30 20:26:12 devstack sudo[94688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:26:13 devstack sudo[94688]: pam_unix(sudo:session): session closed for user root
Jul 30 20:26:13 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f1d0806f-693c-44c6-abb0-20e7c398b2b7 tempest-GroupSnapshotsV319Test-1206656491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5522de5a-dc0d-47af-ba5c-4a7c0dd4fbc6 -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5522de5a-dc0d-47af-ba5c-4a7c0dd4fbc6.38332b49-f487-4d41-968f-506bcd8f670d" returned: 0 in 0.515s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:26:13 devstack cinder-volume[88719]: WARNING cinder.volume.drivers.remotefs [None req-f1d0806f-693c-44c6-abb0-20e7c398b2b7 tempest-GroupSnapshotsV319Test-1206656491 None] /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5522de5a-dc0d-47af-ba5c-4a7c0dd4fbc6.38332b49-f487-4d41-968f-506bcd8f670d is being set with open permissions: ugo+rw: NotImplementedError
Jul 30 20:26:13 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f1d0806f-693c-44c6-abb0-20e7c398b2b7 tempest-GroupSnapshotsV319Test-1206656491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5522de5a-dc0d-47af-ba5c-4a7c0dd4fbc6.38332b49-f487-4d41-968f-506bcd8f670d {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:26:13 devstack sudo[94694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5522de5a-dc0d-47af-ba5c-4a7c0dd4fbc6.38332b49-f487-4d41-968f-506bcd8f670d
Jul 30 20:26:13 devstack sudo[94694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:26:13 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-d139ffa2-87cc-4372-85fe-3bf289c72878 tempest-AttachVolumeNegativeTest-1614371178 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:26:13 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-d139ffa2-87cc-4372-85fe-3bf289c72878 tempest-AttachVolumeNegativeTest-1614371178 None] Flow 'volume_create_manager' (6bbc0612-389c-4084-bf1e-8fbf4ee5e044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:26:13 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-d139ffa2-87cc-4372-85fe-3bf289c72878 tempest-AttachVolumeNegativeTest-1614371178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b46609ca-b1b7-40f0-94cb-072200ef4ca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:26:13 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-d139ffa2-87cc-4372-85fe-3bf289c72878 tempest-AttachVolumeNegativeTest-1614371178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b46609ca-b1b7-40f0-94cb-072200ef4ca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:26:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-109354523',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f52881f2-8a6e-47dd-b6a1-ee4679a5629a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94612bdf28ad4dcc8603985e17aaea85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:26:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:26:13Z,use_quota=True,user_id='b3458179c6164555a4b1c503e06fdef3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:26:13 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-d139ffa2-87cc-4372-85fe-3bf289c72878 tempest-AttachVolumeNegativeTest-1614371178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53469aaa-2a94-45d5-a000-9408062a6ebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:26:13 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-d139ffa2-87cc-4372-85fe-3bf289c72878 tempest-AttachVolumeNegativeTest-1614371178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53469aaa-2a94-45d5-a000-9408062a6ebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:26:13 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-d139ffa2-87cc-4372-85fe-3bf289c72878 tempest-AttachVolumeNegativeTest-1614371178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c8fc0e0-cc2a-4fe4-8a3c-bec7d016905c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:26:13 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-d139ffa2-87cc-4372-85fe-3bf289c72878 tempest-AttachVolumeNegativeTest-1614371178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c8fc0e0-cc2a-4fe4-8a3c-bec7d016905c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f52881f2-8a6e-47dd-b6a1-ee4679a5629a', 'volume_name': 'volume-f52881f2-8a6e-47dd-b6a1-ee4679a5629a', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:26:13 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-d139ffa2-87cc-4372-85fe-3bf289c72878 tempest-AttachVolumeNegativeTest-1614371178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9ce30ab-b52d-46cd-8dc1-7268c0139efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:26:13 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-d139ffa2-87cc-4372-85fe-3bf289c72878 tempest-AttachVolumeNegativeTest-1614371178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9ce30ab-b52d-46cd-8dc1-7268c0139efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:26:13 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-d139ffa2-87cc-4372-85fe-3bf289c72878 tempest-AttachVolumeNegativeTest-1614371178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b763a230-e3f6-4277-96cd-3ce77f2db08b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:26:13 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-d139ffa2-87cc-4372-85fe-3bf289c72878 tempest-AttachVolumeNegativeTest-1614371178 None] Volume f52881f2-8a6e-47dd-b6a1-ee4679a5629a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f52881f2-8a6e-47dd-b6a1-ee4679a5629a', 'volume_size': 1}
Jul 30 20:26:13 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-d139ffa2-87cc-4372-85fe-3bf289c72878 tempest-AttachVolumeNegativeTest-1614371178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:26:13 devstack sudo[94694]: pam_unix(sudo:session): session closed for user root
Jul 30 20:26:13 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f1d0806f-693c-44c6-abb0-20e7c398b2b7 tempest-GroupSnapshotsV319Test-1206656491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5522de5a-dc0d-47af-ba5c-4a7c0dd4fbc6.38332b49-f487-4d41-968f-506bcd8f670d" returned: 0 in 0.520s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:26:13 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f1d0806f-693c-44c6-abb0-20e7c398b2b7 tempest-GroupSnapshotsV319Test-1206656491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5522de5a-dc0d-47af-ba5c-4a7c0dd4fbc6.info {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:26:13 devstack sudo[94698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5522de5a-dc0d-47af-ba5c-4a7c0dd4fbc6.info
Jul 30 20:26:13 devstack sudo[94698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:26:13 devstack sudo[94698]: pam_unix(sudo:session): session closed for user root
Jul 30 20:26:13 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f1d0806f-693c-44c6-abb0-20e7c398b2b7 tempest-GroupSnapshotsV319Test-1206656491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5522de5a-dc0d-47af-ba5c-4a7c0dd4fbc6.info" returned: 0 in 0.285s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:26:13 devstack cinder-volume[88719]: WARNING cinder.volume.drivers.remotefs [None req-f1d0806f-693c-44c6-abb0-20e7c398b2b7 tempest-GroupSnapshotsV319Test-1206656491 None] /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5522de5a-dc0d-47af-ba5c-4a7c0dd4fbc6.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 30 20:26:13 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f1d0806f-693c-44c6-abb0-20e7c398b2b7 tempest-GroupSnapshotsV319Test-1206656491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5522de5a-dc0d-47af-ba5c-4a7c0dd4fbc6.info {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:26:13 devstack sudo[94701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5522de5a-dc0d-47af-ba5c-4a7c0dd4fbc6.info
Jul 30 20:26:13 devstack sudo[94701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:26:14 devstack sudo[94701]: pam_unix(sudo:session): session closed for user root
Jul 30 20:26:14 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f1d0806f-693c-44c6-abb0-20e7c398b2b7 tempest-GroupSnapshotsV319Test-1206656491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5522de5a-dc0d-47af-ba5c-4a7c0dd4fbc6.info" returned: 0 in 0.315s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:26:14 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-f1d0806f-693c-44c6-abb0-20e7c398b2b7 tempest-GroupSnapshotsV319Test-1206656491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.987s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:26:14 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-d139ffa2-87cc-4372-85fe-3bf289c72878 tempest-AttachVolumeNegativeTest-1614371178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.802s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:26:14 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-d139ffa2-87cc-4372-85fe-3bf289c72878 tempest-AttachVolumeNegativeTest-1614371178 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:26:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-109354523',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f52881f2-8a6e-47dd-b6a1-ee4679a5629a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94612bdf28ad4dcc8603985e17aaea85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:26:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:26:13Z,use_quota=True,user_id='b3458179c6164555a4b1c503e06fdef3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:26:14 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-d139ffa2-87cc-4372-85fe-3bf289c72878 tempest-AttachVolumeNegativeTest-1614371178 None] Creating volume f52881f2-8a6e-47dd-b6a1-ee4679a5629a {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:26:14 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-d139ffa2-87cc-4372-85fe-3bf289c72878 tempest-AttachVolumeNegativeTest-1614371178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:26:14 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-d139ffa2-87cc-4372-85fe-3bf289c72878 tempest-AttachVolumeNegativeTest-1614371178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:26:14 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-d139ffa2-87cc-4372-85fe-3bf289c72878 tempest-AttachVolumeNegativeTest-1614371178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:26:14 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-d139ffa2-87cc-4372-85fe-3bf289c72878 tempest-AttachVolumeNegativeTest-1614371178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:26:14 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-d139ffa2-87cc-4372-85fe-3bf289c72878 tempest-AttachVolumeNegativeTest-1614371178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:26:14 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-d139ffa2-87cc-4372-85fe-3bf289c72878 tempest-AttachVolumeNegativeTest-1614371178 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:26:14 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-d139ffa2-87cc-4372-85fe-3bf289c72878 tempest-AttachVolumeNegativeTest-1614371178 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:26:14 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-d139ffa2-87cc-4372-85fe-3bf289c72878 tempest-AttachVolumeNegativeTest-1614371178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f52881f2-8a6e-47dd-b6a1-ee4679a5629a 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:26:14 devstack sudo[94706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f52881f2-8a6e-47dd-b6a1-ee4679a5629a 1073741824
Jul 30 20:26:14 devstack sudo[94706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:26:14 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-f1d0806f-693c-44c6-abb0-20e7c398b2b7 tempest-GroupSnapshotsV319Test-1206656491 None] group_snapshot 22bb87ca-a00b-455e-9bee-eb03e10c4e4b: created successfully
Jul 30 20:26:14 devstack sudo[94706]: pam_unix(sudo:session): session closed for user root
Jul 30 20:26:14 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-d139ffa2-87cc-4372-85fe-3bf289c72878 tempest-AttachVolumeNegativeTest-1614371178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f52881f2-8a6e-47dd-b6a1-ee4679a5629a 1073741824" returned: 0 in 0.665s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:26:14 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-d139ffa2-87cc-4372-85fe-3bf289c72878 tempest-AttachVolumeNegativeTest-1614371178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f52881f2-8a6e-47dd-b6a1-ee4679a5629a {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:26:15 devstack sudo[94712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f52881f2-8a6e-47dd-b6a1-ee4679a5629a
Jul 30 20:26:15 devstack sudo[94712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:26:15 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-e745acfd-7ed2-4616-8e3e-a224fc996dfc tempest-GroupSnapshotsV319Test-1206656491 None] group_snapshot 22bb87ca-a00b-455e-9bee-eb03e10c4e4b: deleting
Jul 30 20:26:15 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e745acfd-7ed2-4616-8e3e-a224fc996dfc tempest-GroupSnapshotsV319Test-1206656491 None] group_snapshot 22bb87ca-a00b-455e-9bee-eb03e10c4e4b: deleting {{(pid=88719) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jul 30 20:26:15 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-e745acfd-7ed2-4616-8e3e-a224fc996dfc tempest-GroupSnapshotsV319Test-1206656491 None] Acquiring lock "cinder-quobyte-5522de5a-dc0d-47af-ba5c-4a7c0dd4fbc6" by "delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:26:15 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-e745acfd-7ed2-4616-8e3e-a224fc996dfc tempest-GroupSnapshotsV319Test-1206656491 None] Lock "cinder-quobyte-5522de5a-dc0d-47af-ba5c-4a7c0dd4fbc6" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:26:15 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-e745acfd-7ed2-4616-8e3e-a224fc996dfc tempest-GroupSnapshotsV319Test-1206656491 None] Acquiring lock "cinder-quobyte-38332b49-f487-4d41-968f-506bcd8f670d" by "_delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:26:15 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-e745acfd-7ed2-4616-8e3e-a224fc996dfc tempest-GroupSnapshotsV319Test-1206656491 None] Lock "cinder-quobyte-38332b49-f487-4d41-968f-506bcd8f670d" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:26:15 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-e745acfd-7ed2-4616-8e3e-a224fc996dfc tempest-GroupSnapshotsV319Test-1206656491 None] Deleting offline snapshot 38332b49-f487-4d41-968f-506bcd8f670d of volume 5522de5a-dc0d-47af-ba5c-4a7c0dd4fbc6 {{(pid=88719) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 30 20:26:15 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-e745acfd-7ed2-4616-8e3e-a224fc996dfc tempest-GroupSnapshotsV319Test-1206656491 None] snapshot_file for this snap is: volume-5522de5a-dc0d-47af-ba5c-4a7c0dd4fbc6.38332b49-f487-4d41-968f-506bcd8f670d {{(pid=88719) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 30 20:26:15 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[50dbdd11-1bce-4406-8709-cdfdeb012661]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:26:15 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-e745acfd-7ed2-4616-8e3e-a224fc996dfc tempest-GroupSnapshotsV319Test-1206656491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5522de5a-dc0d-47af-ba5c-4a7c0dd4fbc6.38332b49-f487-4d41-968f-506bcd8f670d {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:26:15 devstack sudo[94712]: pam_unix(sudo:session): session closed for user root
Jul 30 20:26:15 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-d139ffa2-87cc-4372-85fe-3bf289c72878 tempest-AttachVolumeNegativeTest-1614371178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f52881f2-8a6e-47dd-b6a1-ee4679a5629a" returned: 0 in 0.401s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:26:15 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-d139ffa2-87cc-4372-85fe-3bf289c72878 tempest-AttachVolumeNegativeTest-1614371178 None] <== create_volume: return (1131ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:26:15 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-d139ffa2-87cc-4372-85fe-3bf289c72878 tempest-AttachVolumeNegativeTest-1614371178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.139s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:26:15 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-d139ffa2-87cc-4372-85fe-3bf289c72878 tempest-AttachVolumeNegativeTest-1614371178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b763a230-e3f6-4277-96cd-3ce77f2db08b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f52881f2-8a6e-47dd-b6a1-ee4679a5629a', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:26:15 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-d139ffa2-87cc-4372-85fe-3bf289c72878 tempest-AttachVolumeNegativeTest-1614371178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddf04732-c1f8-4035-98fd-d378beded0e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:26:15 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-d139ffa2-87cc-4372-85fe-3bf289c72878 tempest-AttachVolumeNegativeTest-1614371178 None] Volume volume-f52881f2-8a6e-47dd-b6a1-ee4679a5629a (f52881f2-8a6e-47dd-b6a1-ee4679a5629a): created successfully
Jul 30 20:26:15 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-d139ffa2-87cc-4372-85fe-3bf289c72878 tempest-AttachVolumeNegativeTest-1614371178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddf04732-c1f8-4035-98fd-d378beded0e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:26:15 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-d139ffa2-87cc-4372-85fe-3bf289c72878 tempest-AttachVolumeNegativeTest-1614371178 None] Flow 'volume_create_manager' (6bbc0612-389c-4084-bf1e-8fbf4ee5e044) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:26:15 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-d139ffa2-87cc-4372-85fe-3bf289c72878 tempest-AttachVolumeNegativeTest-1614371178 None] Created volume successfully.
Jul 30 20:26:15 devstack sudo[94715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5522de5a-dc0d-47af-ba5c-4a7c0dd4fbc6.38332b49-f487-4d41-968f-506bcd8f670d
Jul 30 20:26:15 devstack sudo[94715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:26:15 devstack sudo[94715]: pam_unix(sudo:session): session closed for user root
Jul 30 20:26:15 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-e745acfd-7ed2-4616-8e3e-a224fc996dfc tempest-GroupSnapshotsV319Test-1206656491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5522de5a-dc0d-47af-ba5c-4a7c0dd4fbc6.38332b49-f487-4d41-968f-506bcd8f670d" returned: 0 in 0.489s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:26:15 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-e745acfd-7ed2-4616-8e3e-a224fc996dfc tempest-GroupSnapshotsV319Test-1206656491 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5522de5a-dc0d-47af-ba5c-4a7c0dd4fbc6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88719) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 30 20:26:15 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c74181e-e8b5-4417-ab44-56732a0e178b]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:26:15 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-e745acfd-7ed2-4616-8e3e-a224fc996dfc tempest-GroupSnapshotsV319Test-1206656491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5522de5a-dc0d-47af-ba5c-4a7c0dd4fbc6 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:26:15 devstack sudo[94720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5522de5a-dc0d-47af-ba5c-4a7c0dd4fbc6
Jul 30 20:26:15 devstack sudo[94720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:26:16 devstack sudo[94720]: pam_unix(sudo:session): session closed for user root
Jul 30 20:26:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-e745acfd-7ed2-4616-8e3e-a224fc996dfc tempest-GroupSnapshotsV319Test-1206656491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5522de5a-dc0d-47af-ba5c-4a7c0dd4fbc6" returned: 0 in 0.416s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:26:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-e745acfd-7ed2-4616-8e3e-a224fc996dfc tempest-GroupSnapshotsV319Test-1206656491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5522de5a-dc0d-47af-ba5c-4a7c0dd4fbc6.38332b49-f487-4d41-968f-506bcd8f670d {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:26:16 devstack sudo[94726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5522de5a-dc0d-47af-ba5c-4a7c0dd4fbc6.38332b49-f487-4d41-968f-506bcd8f670d
Jul 30 20:26:16 devstack sudo[94726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:26:16 devstack cinder-volume[88719]: DEBUG oslo_service.periodic_task [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88719) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 30 20:26:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:26:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:26:16 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:26:16 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:26:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:26:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:26:16 devstack sudo[94728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:26:16 devstack sudo[94728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:26:16 devstack sudo[94726]: pam_unix(sudo:session): session closed for user root
Jul 30 20:26:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-e745acfd-7ed2-4616-8e3e-a224fc996dfc tempest-GroupSnapshotsV319Test-1206656491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5522de5a-dc0d-47af-ba5c-4a7c0dd4fbc6.38332b49-f487-4d41-968f-506bcd8f670d" returned: 0 in 0.390s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:26:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-e745acfd-7ed2-4616-8e3e-a224fc996dfc tempest-GroupSnapshotsV319Test-1206656491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5522de5a-dc0d-47af-ba5c-4a7c0dd4fbc6.38332b49-f487-4d41-968f-506bcd8f670d {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:26:16 devstack sudo[94735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5522de5a-dc0d-47af-ba5c-4a7c0dd4fbc6.38332b49-f487-4d41-968f-506bcd8f670d
Jul 30 20:26:16 devstack sudo[94735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:26:16 devstack sudo[94728]: pam_unix(sudo:session): session closed for user root
Jul 30 20:26:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.368s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:26:16 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:26:16 devstack cinder-volume[88719]: DEBUG oslo_service.periodic_task [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Running periodic task VolumeManager._thread_info {{(pid=88719) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 30 20:26:16 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] thread count: 8 {{(pid=88719) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 30 20:26:16 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] thread info: [<_MainThread(MainThread, started 132390416908416)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132390306497536)>, <Thread(Thread-3 (stat_writer), started daemon 132390304471680)>, <Thread(Rabbit-heartbeat, started daemon 132390303393408)>, <Thread(Thread-5 (_runner), started daemon 132390303543168)>, <Thread(Thread-7 (_runner), started daemon 132390303563392)>, <Thread(fd_logger, started daemon 132390301344640)>, <Thread(privsep_reader, started daemon 132390301560640)>] {{(pid=88719) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 30 20:26:17 devstack sudo[94735]: pam_unix(sudo:session): session closed for user root
Jul 30 20:26:17 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-e745acfd-7ed2-4616-8e3e-a224fc996dfc tempest-GroupSnapshotsV319Test-1206656491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5522de5a-dc0d-47af-ba5c-4a7c0dd4fbc6.38332b49-f487-4d41-968f-506bcd8f670d" returned: 0 in 0.320s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:26:17 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-e745acfd-7ed2-4616-8e3e-a224fc996dfc tempest-GroupSnapshotsV319Test-1206656491 None] Lock "cinder-quobyte-38332b49-f487-4d41-968f-506bcd8f670d" released by "_delete_snapshot" :: held 1.782s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:26:17 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-e745acfd-7ed2-4616-8e3e-a224fc996dfc tempest-GroupSnapshotsV319Test-1206656491 None] Lock "cinder-quobyte-5522de5a-dc0d-47af-ba5c-4a7c0dd4fbc6" released by "delete_snapshot" :: held 1.819s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:26:17 devstack cinder-volume[88719]: WARNING cinder.quota [None req-e745acfd-7ed2-4616-8e3e-a224fc996dfc tempest-GroupSnapshotsV319Test-1206656491 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-767279643 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-767279643, it is now deprecated. Please use the default quota class for default quota.
Jul 30 20:26:17 devstack cinder-volume[88719]: WARNING cinder.quota [None req-e745acfd-7ed2-4616-8e3e-a224fc996dfc tempest-GroupSnapshotsV319Test-1206656491 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-767279643 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-767279643, it is now deprecated. Please use the default quota class for default quota.
Jul 30 20:26:17 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-e745acfd-7ed2-4616-8e3e-a224fc996dfc tempest-GroupSnapshotsV319Test-1206656491 None] Created reservations ['8c24946d-288e-41b2-8309-83028f67fcf3', '46825d00-ee02-4fa7-9f81-2ddf5567f99d', 'da6de0c9-3c07-4ad5-b060-b8571d0587be', 'a913c73f-871e-4e01-945c-b2d9b05e5524'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:26:17 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-e745acfd-7ed2-4616-8e3e-a224fc996dfc tempest-GroupSnapshotsV319Test-1206656491 None] group_snapshot 22bb87ca-a00b-455e-9bee-eb03e10c4e4b: deleted successfully
Jul 30 20:26:17 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [req-6338bf9c-d681-4b9d-9004-89a65913d681 req-a27e74e8-4276-41f4-830f-674a0dc2d1b0 tempest-AttachVolumeNegativeTest-1614371178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:26:17 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [req-6338bf9c-d681-4b9d-9004-89a65913d681 req-a27e74e8-4276-41f4-830f-674a0dc2d1b0 tempest-AttachVolumeNegativeTest-1614371178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:26:17 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [req-6338bf9c-d681-4b9d-9004-89a65913d681 req-a27e74e8-4276-41f4-830f-674a0dc2d1b0 tempest-AttachVolumeNegativeTest-1614371178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:26:17 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [req-6338bf9c-d681-4b9d-9004-89a65913d681 req-a27e74e8-4276-41f4-830f-674a0dc2d1b0 tempest-AttachVolumeNegativeTest-1614371178 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5', 'name': 'volume-f52881f2-8a6e-47dd-b6a1-ee4679a5629a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4ed529ec-13b4-468e-bda6-951c853bcc81', 'enforce_multipath': True} {{(pid=88719) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 30 20:26:17 devstack cinder-volume[88719]: INFO cinder.volume.manager [req-6338bf9c-d681-4b9d-9004-89a65913d681 req-a27e74e8-4276-41f4-830f-674a0dc2d1b0 tempest-AttachVolumeNegativeTest-1614371178 None] attachment_update completed successfully.
Jul 30 20:26:18 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-c44135a7-955e-42f7-98cc-5151c3db4e24 tempest-GroupSnapshotsV319Test-1206656491 None] Acquiring lock "cinder-quobyte-5522de5a-dc0d-47af-ba5c-4a7c0dd4fbc6" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:26:18 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-c44135a7-955e-42f7-98cc-5151c3db4e24 tempest-GroupSnapshotsV319Test-1206656491 None] Lock "cinder-quobyte-5522de5a-dc0d-47af-ba5c-4a7c0dd4fbc6" acquired by "delete_volume" :: waited 0.029s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:26:18 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[e272aa98-24b7-4503-90ec-60ec2622682c]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:26:18 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-c44135a7-955e-42f7-98cc-5151c3db4e24 tempest-GroupSnapshotsV319Test-1206656491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5522de5a-dc0d-47af-ba5c-4a7c0dd4fbc6 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:26:18 devstack sudo[94755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5522de5a-dc0d-47af-ba5c-4a7c0dd4fbc6
Jul 30 20:26:18 devstack sudo[94755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:26:18 devstack sudo[94755]: pam_unix(sudo:session): session closed for user root
Jul 30 20:26:18 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-c44135a7-955e-42f7-98cc-5151c3db4e24 tempest-GroupSnapshotsV319Test-1206656491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5522de5a-dc0d-47af-ba5c-4a7c0dd4fbc6" returned: 0 in 0.541s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:26:18 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-c44135a7-955e-42f7-98cc-5151c3db4e24 tempest-GroupSnapshotsV319Test-1206656491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5522de5a-dc0d-47af-ba5c-4a7c0dd4fbc6 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:26:18 devstack sudo[94761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5522de5a-dc0d-47af-ba5c-4a7c0dd4fbc6
Jul 30 20:26:18 devstack sudo[94761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:26:19 devstack sudo[94761]: pam_unix(sudo:session): session closed for user root
Jul 30 20:26:19 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-c44135a7-955e-42f7-98cc-5151c3db4e24 tempest-GroupSnapshotsV319Test-1206656491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5522de5a-dc0d-47af-ba5c-4a7c0dd4fbc6" returned: 0 in 0.261s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:26:19 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-c44135a7-955e-42f7-98cc-5151c3db4e24 tempest-GroupSnapshotsV319Test-1206656491 None] Lock "cinder-quobyte-5522de5a-dc0d-47af-ba5c-4a7c0dd4fbc6" released by "delete_volume" :: held 0.863s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:26:19 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-c44135a7-955e-42f7-98cc-5151c3db4e24 tempest-GroupSnapshotsV319Test-1206656491 None] Created reservations ['2283d5a0-ad1d-484a-ac9d-073dbf194441'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:26:19 devstack cinder-volume[88719]: WARNING cinder.quota [None req-c44135a7-955e-42f7-98cc-5151c3db4e24 tempest-GroupSnapshotsV319Test-1206656491 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-767279643 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-767279643, it is now deprecated. Please use the default quota class for default quota.
Jul 30 20:26:19 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-c44135a7-955e-42f7-98cc-5151c3db4e24 tempest-GroupSnapshotsV319Test-1206656491 None] Created reservations ['1482c494-2ecd-42e2-a65d-324cb4ae49f7', '266cb6d8-f627-41ab-9f5c-73409a5a045f', '22914763-fbb6-4cb0-aeb0-a0781cb3a12d', '7dfba201-a032-4589-bc80-0f5ad7c968a6'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:26:19 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-c44135a7-955e-42f7-98cc-5151c3db4e24 tempest-GroupSnapshotsV319Test-1206656491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:26:19 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-c44135a7-955e-42f7-98cc-5151c3db4e24 tempest-GroupSnapshotsV319Test-1206656491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:26:19 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-c44135a7-955e-42f7-98cc-5151c3db4e24 tempest-GroupSnapshotsV319Test-1206656491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:26:19 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-c44135a7-955e-42f7-98cc-5151c3db4e24 tempest-GroupSnapshotsV319Test-1206656491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:26:19 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-c44135a7-955e-42f7-98cc-5151c3db4e24 tempest-GroupSnapshotsV319Test-1206656491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:26:19 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-c44135a7-955e-42f7-98cc-5151c3db4e24 tempest-GroupSnapshotsV319Test-1206656491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:26:19 devstack sudo[94765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:26:19 devstack sudo[94765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:26:19 devstack sudo[94765]: pam_unix(sudo:session): session closed for user root
Jul 30 20:26:19 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-c44135a7-955e-42f7-98cc-5151c3db4e24 tempest-GroupSnapshotsV319Test-1206656491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.339s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:26:19 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-c44135a7-955e-42f7-98cc-5151c3db4e24 tempest-GroupSnapshotsV319Test-1206656491 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:26:19 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-c44135a7-955e-42f7-98cc-5151c3db4e24 tempest-GroupSnapshotsV319Test-1206656491 None] Delete group completed successfully.
Jul 30 20:26:26 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-35927e81-c34f-462b-ae07-13d03df6d471 tempest-GroupsV314Test-254783784 None] Group tempest-GroupsV314Test-Group-210357796: creating
Jul 30 20:26:26 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-35927e81-c34f-462b-ae07-13d03df6d471 tempest-GroupsV314Test-254783784 None] Group tempest-GroupsV314Test-Group-210357796: created successfully
Jul 30 20:26:26 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-35927e81-c34f-462b-ae07-13d03df6d471 tempest-GroupsV314Test-254783784 None] Create group completed successfully.
Jul 30 20:26:28 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7b22bdf-3452-47f5-a4a0-ccd8988705df tempest-GroupsV314Test-254783784 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:26:28 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-c7b22bdf-3452-47f5-a4a0-ccd8988705df tempest-GroupsV314Test-254783784 None] Flow 'volume_create_manager' (35d55f92-b7c5-4f5a-8c13-5bebf1b421b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:26:28 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-c7b22bdf-3452-47f5-a4a0-ccd8988705df tempest-GroupsV314Test-254783784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d61c310d-24b4-473e-baeb-da9728be6278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:26:28 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-c7b22bdf-3452-47f5-a4a0-ccd8988705df tempest-GroupsV314Test-254783784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d61c310d-24b4-473e-baeb-da9728be6278) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:26:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-211191984',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=b63e7868-37f1-45c7-8dc1-3f99fd7857c6,host='devstack@QuobyteHD#QuobyteHD',id=21077ff4-fa82-43a9-868b-3aab84c4f912,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56fef473264845eda39e50f53f45d4b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:26:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:26:29Z,use_quota=True,user_id='698b6bcb99344e3ab09eabc822cc953f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6698ed-a880-4465-8c8f-e39c25c5dc08),volume_type_id=df6698ed-a880-4465-8c8f-e39c25c5dc08)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:26:28 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-c7b22bdf-3452-47f5-a4a0-ccd8988705df tempest-GroupsV314Test-254783784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82e0fbf6-1c04-4178-8b59-6a672fde650f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:26:28 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-c7b22bdf-3452-47f5-a4a0-ccd8988705df tempest-GroupsV314Test-254783784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82e0fbf6-1c04-4178-8b59-6a672fde650f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:26:28 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-c7b22bdf-3452-47f5-a4a0-ccd8988705df tempest-GroupsV314Test-254783784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4de6b568-f157-4a2f-96f0-91cc95db82de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:26:28 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-c7b22bdf-3452-47f5-a4a0-ccd8988705df tempest-GroupsV314Test-254783784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4de6b568-f157-4a2f-96f0-91cc95db82de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21077ff4-fa82-43a9-868b-3aab84c4f912', 'volume_name': 'volume-21077ff4-fa82-43a9-868b-3aab84c4f912', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:26:28 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-c7b22bdf-3452-47f5-a4a0-ccd8988705df tempest-GroupsV314Test-254783784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9414c0b6-5dd8-4771-98d1-db9be41fdf2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:26:28 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-c7b22bdf-3452-47f5-a4a0-ccd8988705df tempest-GroupsV314Test-254783784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9414c0b6-5dd8-4771-98d1-db9be41fdf2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:26:28 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-c7b22bdf-3452-47f5-a4a0-ccd8988705df tempest-GroupsV314Test-254783784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfdd75d5-53c4-4610-b898-832f83c2c0e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:26:28 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-c7b22bdf-3452-47f5-a4a0-ccd8988705df tempest-GroupsV314Test-254783784 None] Volume 21077ff4-fa82-43a9-868b-3aab84c4f912: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21077ff4-fa82-43a9-868b-3aab84c4f912', 'volume_size': 1}
Jul 30 20:26:28 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-c7b22bdf-3452-47f5-a4a0-ccd8988705df tempest-GroupsV314Test-254783784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:26:28 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-c7b22bdf-3452-47f5-a4a0-ccd8988705df tempest-GroupsV314Test-254783784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:26:28 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-c7b22bdf-3452-47f5-a4a0-ccd8988705df tempest-GroupsV314Test-254783784 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=b63e7868-37f1-45c7-8dc1-3f99fd7857c6,created_at=2026-07-30T18:26:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-211191984',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=b63e7868-37f1-45c7-8dc1-3f99fd7857c6,host='devstack@QuobyteHD#QuobyteHD',id=21077ff4-fa82-43a9-868b-3aab84c4f912,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56fef473264845eda39e50f53f45d4b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:26:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:26:29Z,use_quota=True,user_id='698b6bcb99344e3ab09eabc822cc953f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6698ed-a880-4465-8c8f-e39c25c5dc08),volume_type_id=df6698ed-a880-4465-8c8f-e39c25c5dc08)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:26:28 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-c7b22bdf-3452-47f5-a4a0-ccd8988705df tempest-GroupsV314Test-254783784 None] Creating volume 21077ff4-fa82-43a9-868b-3aab84c4f912 {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:26:28 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-c7b22bdf-3452-47f5-a4a0-ccd8988705df tempest-GroupsV314Test-254783784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:26:28 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-c7b22bdf-3452-47f5-a4a0-ccd8988705df tempest-GroupsV314Test-254783784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:26:28 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-c7b22bdf-3452-47f5-a4a0-ccd8988705df tempest-GroupsV314Test-254783784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:26:28 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-c7b22bdf-3452-47f5-a4a0-ccd8988705df tempest-GroupsV314Test-254783784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:26:28 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-c7b22bdf-3452-47f5-a4a0-ccd8988705df tempest-GroupsV314Test-254783784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:26:28 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-c7b22bdf-3452-47f5-a4a0-ccd8988705df tempest-GroupsV314Test-254783784 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:26:28 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-c7b22bdf-3452-47f5-a4a0-ccd8988705df tempest-GroupsV314Test-254783784 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:26:28 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-c7b22bdf-3452-47f5-a4a0-ccd8988705df tempest-GroupsV314Test-254783784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-21077ff4-fa82-43a9-868b-3aab84c4f912 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:26:28 devstack sudo[94822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-21077ff4-fa82-43a9-868b-3aab84c4f912 1073741824
Jul 30 20:26:28 devstack sudo[94822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:26:29 devstack sudo[94822]: pam_unix(sudo:session): session closed for user root
Jul 30 20:26:29 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-c7b22bdf-3452-47f5-a4a0-ccd8988705df tempest-GroupsV314Test-254783784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-21077ff4-fa82-43a9-868b-3aab84c4f912 1073741824" returned: 0 in 0.787s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:26:29 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-c7b22bdf-3452-47f5-a4a0-ccd8988705df tempest-GroupsV314Test-254783784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-21077ff4-fa82-43a9-868b-3aab84c4f912 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:26:29 devstack sudo[94854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-21077ff4-fa82-43a9-868b-3aab84c4f912
Jul 30 20:26:29 devstack sudo[94854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:26:29 devstack sudo[94854]: pam_unix(sudo:session): session closed for user root
Jul 30 20:26:29 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-c7b22bdf-3452-47f5-a4a0-ccd8988705df tempest-GroupsV314Test-254783784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-21077ff4-fa82-43a9-868b-3aab84c4f912" returned: 0 in 0.358s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:26:29 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-c7b22bdf-3452-47f5-a4a0-ccd8988705df tempest-GroupsV314Test-254783784 None] <== create_volume: return (1205ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:26:29 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-c7b22bdf-3452-47f5-a4a0-ccd8988705df tempest-GroupsV314Test-254783784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.211s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:26:30 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-c7b22bdf-3452-47f5-a4a0-ccd8988705df tempest-GroupsV314Test-254783784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfdd75d5-53c4-4610-b898-832f83c2c0e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21077ff4-fa82-43a9-868b-3aab84c4f912', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:26:30 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-c7b22bdf-3452-47f5-a4a0-ccd8988705df tempest-GroupsV314Test-254783784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e118495d-568c-4840-b282-7861c23f216c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:26:30 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-c7b22bdf-3452-47f5-a4a0-ccd8988705df tempest-GroupsV314Test-254783784 None] Volume volume-21077ff4-fa82-43a9-868b-3aab84c4f912 (21077ff4-fa82-43a9-868b-3aab84c4f912): created successfully
Jul 30 20:26:30 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-c7b22bdf-3452-47f5-a4a0-ccd8988705df tempest-GroupsV314Test-254783784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e118495d-568c-4840-b282-7861c23f216c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:26:30 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-c7b22bdf-3452-47f5-a4a0-ccd8988705df tempest-GroupsV314Test-254783784 None] Flow 'volume_create_manager' (35d55f92-b7c5-4f5a-8c13-5bebf1b421b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:26:30 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-c7b22bdf-3452-47f5-a4a0-ccd8988705df tempest-GroupsV314Test-254783784 None] Created volume successfully.
Jul 30 20:26:32 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-5a71ccd8-74d1-4db8-bc92-f5059f05430f tempest-GroupsV314Test-254783784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:26:32 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-5a71ccd8-74d1-4db8-bc92-f5059f05430f tempest-GroupsV314Test-254783784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:26:32 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-5a71ccd8-74d1-4db8-bc92-f5059f05430f tempest-GroupsV314Test-254783784 None] Cloning volume 21077ff4-fa82-43a9-868b-3aab84c4f912 to volume 0dfffc13-3f7d-4ace-9853-eae16390bca0
Jul 30 20:26:32 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-5a71ccd8-74d1-4db8-bc92-f5059f05430f tempest-GroupsV314Test-254783784 None] Creating offline snapshot 31d1019f-07a7-4153-95ad-3639e07e5412 of volume 21077ff4-fa82-43a9-868b-3aab84c4f912 {{(pid=88719) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 30 20:26:32 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[675f5228-e3bd-4f0e-9b77-2aa91afa14d7]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:26:32 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-5a71ccd8-74d1-4db8-bc92-f5059f05430f tempest-GroupsV314Test-254783784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-21077ff4-fa82-43a9-868b-3aab84c4f912 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:26:32 devstack sudo[94885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-21077ff4-fa82-43a9-868b-3aab84c4f912
Jul 30 20:26:32 devstack sudo[94885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:26:32 devstack sudo[94885]: pam_unix(sudo:session): session closed for user root
Jul 30 20:26:32 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-5a71ccd8-74d1-4db8-bc92-f5059f05430f tempest-GroupsV314Test-254783784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-21077ff4-fa82-43a9-868b-3aab84c4f912" returned: 0 in 0.454s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:26:32 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-5a71ccd8-74d1-4db8-bc92-f5059f05430f tempest-GroupsV314Test-254783784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-21077ff4-fa82-43a9-868b-3aab84c4f912,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-21077ff4-fa82-43a9-868b-3aab84c4f912.31d1019f-07a7-4153-95ad-3639e07e5412 1G {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:26:32 devstack sudo[94892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-21077ff4-fa82-43a9-868b-3aab84c4f912,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-21077ff4-fa82-43a9-868b-3aab84c4f912.31d1019f-07a7-4153-95ad-3639e07e5412 1G
Jul 30 20:26:32 devstack sudo[94892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:26:33 devstack sudo[94892]: pam_unix(sudo:session): session closed for user root
Jul 30 20:26:33 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-5a71ccd8-74d1-4db8-bc92-f5059f05430f tempest-GroupsV314Test-254783784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-21077ff4-fa82-43a9-868b-3aab84c4f912,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-21077ff4-fa82-43a9-868b-3aab84c4f912.31d1019f-07a7-4153-95ad-3639e07e5412 1G" returned: 0 in 0.756s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:26:33 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-5a71ccd8-74d1-4db8-bc92-f5059f05430f tempest-GroupsV314Test-254783784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21077ff4-fa82-43a9-868b-3aab84c4f912 -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-21077ff4-fa82-43a9-868b-3aab84c4f912.31d1019f-07a7-4153-95ad-3639e07e5412 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:26:33 devstack sudo[94902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21077ff4-fa82-43a9-868b-3aab84c4f912 -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-21077ff4-fa82-43a9-868b-3aab84c4f912.31d1019f-07a7-4153-95ad-3639e07e5412
Jul 30 20:26:33 devstack sudo[94902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:26:34 devstack sudo[94902]: pam_unix(sudo:session): session closed for user root
Jul 30 20:26:34 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-5a71ccd8-74d1-4db8-bc92-f5059f05430f tempest-GroupsV314Test-254783784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21077ff4-fa82-43a9-868b-3aab84c4f912 -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-21077ff4-fa82-43a9-868b-3aab84c4f912.31d1019f-07a7-4153-95ad-3639e07e5412" returned: 0 in 0.617s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:26:34 devstack cinder-volume[88719]: WARNING cinder.volume.drivers.remotefs [None req-5a71ccd8-74d1-4db8-bc92-f5059f05430f tempest-GroupsV314Test-254783784 None] /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-21077ff4-fa82-43a9-868b-3aab84c4f912.31d1019f-07a7-4153-95ad-3639e07e5412 is being set with open permissions: ugo+rw: NotImplementedError
Jul 30 20:26:34 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-5a71ccd8-74d1-4db8-bc92-f5059f05430f tempest-GroupsV314Test-254783784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-21077ff4-fa82-43a9-868b-3aab84c4f912.31d1019f-07a7-4153-95ad-3639e07e5412 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:26:34 devstack sudo[94909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-21077ff4-fa82-43a9-868b-3aab84c4f912.31d1019f-07a7-4153-95ad-3639e07e5412
Jul 30 20:26:34 devstack sudo[94909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:26:34 devstack sudo[94909]: pam_unix(sudo:session): session closed for user root
Jul 30 20:26:34 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-5a71ccd8-74d1-4db8-bc92-f5059f05430f tempest-GroupsV314Test-254783784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-21077ff4-fa82-43a9-868b-3aab84c4f912.31d1019f-07a7-4153-95ad-3639e07e5412" returned: 0 in 0.406s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:26:34 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-5a71ccd8-74d1-4db8-bc92-f5059f05430f tempest-GroupsV314Test-254783784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-21077ff4-fa82-43a9-868b-3aab84c4f912.info {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:26:34 devstack sudo[94912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-21077ff4-fa82-43a9-868b-3aab84c4f912.info
Jul 30 20:26:34 devstack sudo[94912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:26:34 devstack sudo[94912]: pam_unix(sudo:session): session closed for user root
Jul 30 20:26:34 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-5a71ccd8-74d1-4db8-bc92-f5059f05430f tempest-GroupsV314Test-254783784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-21077ff4-fa82-43a9-868b-3aab84c4f912.info" returned: 0 in 0.305s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:26:34 devstack cinder-volume[88719]: WARNING cinder.volume.drivers.remotefs [None req-5a71ccd8-74d1-4db8-bc92-f5059f05430f tempest-GroupsV314Test-254783784 None] /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-21077ff4-fa82-43a9-868b-3aab84c4f912.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 30 20:26:34 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-5a71ccd8-74d1-4db8-bc92-f5059f05430f tempest-GroupsV314Test-254783784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-21077ff4-fa82-43a9-868b-3aab84c4f912.info {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:26:34 devstack sudo[94915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-21077ff4-fa82-43a9-868b-3aab84c4f912.info
Jul 30 20:26:34 devstack sudo[94915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:26:35 devstack sudo[94915]: pam_unix(sudo:session): session closed for user root
Jul 30 20:26:35 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-5a71ccd8-74d1-4db8-bc92-f5059f05430f tempest-GroupsV314Test-254783784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-21077ff4-fa82-43a9-868b-3aab84c4f912.info" returned: 0 in 0.359s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:26:35 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-5a71ccd8-74d1-4db8-bc92-f5059f05430f tempest-GroupsV314Test-254783784 None] Acquiring lock "cinder-quobyte-0dfffc13-3f7d-4ace-9853-eae16390bca0" by "_copy_volume_from_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:26:35 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-5a71ccd8-74d1-4db8-bc92-f5059f05430f tempest-GroupsV314Test-254783784 None] Lock "cinder-quobyte-0dfffc13-3f7d-4ace-9853-eae16390bca0" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:26:35 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-5a71ccd8-74d1-4db8-bc92-f5059f05430f tempest-GroupsV314Test-254783784 None] snapshot: 31d1019f-07a7-4153-95ad-3639e07e5412, volume: 0dfffc13-3f7d-4ace-9853-eae16390bca0,  {{(pid=88719) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}}
Jul 30 20:26:35 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-5a71ccd8-74d1-4db8-bc92-f5059f05430f tempest-GroupsV314Test-254783784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:26:35 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-5a71ccd8-74d1-4db8-bc92-f5059f05430f tempest-GroupsV314Test-254783784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:26:35 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-5a71ccd8-74d1-4db8-bc92-f5059f05430f tempest-GroupsV314Test-254783784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:26:35 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-5a71ccd8-74d1-4db8-bc92-f5059f05430f tempest-GroupsV314Test-254783784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:26:35 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-5a71ccd8-74d1-4db8-bc92-f5059f05430f tempest-GroupsV314Test-254783784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:26:35 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9fc0fbb-c0e9-421b-aada-629ae298c307]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:26:35 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-5a71ccd8-74d1-4db8-bc92-f5059f05430f tempest-GroupsV314Test-254783784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-21077ff4-fa82-43a9-868b-3aab84c4f912.31d1019f-07a7-4153-95ad-3639e07e5412 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:26:35 devstack sudo[94921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-21077ff4-fa82-43a9-868b-3aab84c4f912.31d1019f-07a7-4153-95ad-3639e07e5412
Jul 30 20:26:35 devstack sudo[94921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:26:36 devstack sudo[94921]: pam_unix(sudo:session): session closed for user root
Jul 30 20:26:36 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-5a71ccd8-74d1-4db8-bc92-f5059f05430f tempest-GroupsV314Test-254783784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-21077ff4-fa82-43a9-868b-3aab84c4f912.31d1019f-07a7-4153-95ad-3639e07e5412" returned: 0 in 0.928s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:26:36 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-5a71ccd8-74d1-4db8-bc92-f5059f05430f tempest-GroupsV314Test-254783784 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-21077ff4-fa82-43a9-868b-3aab84c4f912(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88719) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 30 20:26:36 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f546693-0399-4e27-a1bf-aa7f32b1b59e]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:26:36 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-5a71ccd8-74d1-4db8-bc92-f5059f05430f tempest-GroupsV314Test-254783784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-21077ff4-fa82-43a9-868b-3aab84c4f912 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:26:36 devstack sudo[94927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-21077ff4-fa82-43a9-868b-3aab84c4f912
Jul 30 20:26:36 devstack sudo[94927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:26:36 devstack sudo[94927]: pam_unix(sudo:session): session closed for user root
Jul 30 20:26:36 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-5a71ccd8-74d1-4db8-bc92-f5059f05430f tempest-GroupsV314Test-254783784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-21077ff4-fa82-43a9-868b-3aab84c4f912" returned: 0 in 0.520s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:26:36 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-5a71ccd8-74d1-4db8-bc92-f5059f05430f tempest-GroupsV314Test-254783784 None] will copy from snapshot at /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-21077ff4-fa82-43a9-868b-3aab84c4f912 {{(pid=88719) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}}
Jul 30 20:26:36 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-5a71ccd8-74d1-4db8-bc92-f5059f05430f tempest-GroupsV314Test-254783784 None] Creating direct copy from snapshot {{(pid=88719) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}}
Jul 30 20:26:36 devstack cinder-volume[88719]: DEBUG cinder.utils [None req-5a71ccd8-74d1-4db8-bc92-f5059f05430f tempest-GroupsV314Test-254783784 None] Path /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0dfffc13-3f7d-4ace-9853-eae16390bca0 not found in is_blk_device check {{(pid=88719) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 30 20:26:36 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-5a71ccd8-74d1-4db8-bc92-f5059f05430f tempest-GroupsV314Test-254783784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-21077ff4-fa82-43a9-868b-3aab84c4f912 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0dfffc13-3f7d-4ace-9853-eae16390bca0 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:26:36 devstack sudo[94937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-21077ff4-fa82-43a9-868b-3aab84c4f912 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0dfffc13-3f7d-4ace-9853-eae16390bca0
Jul 30 20:26:36 devstack sudo[94937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:26:37 devstack cinder-volume[88719]: INFO cinder.volume.manager [req-fd5ef465-072b-4c1e-a1e6-d9c830954b81 req-5b2eb51c-d5fd-4df5-b41d-e69e72558548 tempest-AttachVolumeTestJSON-1478692577 None] Terminate volume connection completed successfully.
Jul 30 20:26:37 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [req-fd5ef465-072b-4c1e-a1e6-d9c830954b81 req-5b2eb51c-d5fd-4df5-b41d-e69e72558548 tempest-AttachVolumeTestJSON-1478692577 None] Deleting attachment f55e25cc-e933-44ca-b28b-94c9cc726e89. {{(pid=88719) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 30 20:26:45 devstack sudo[94937]: pam_unix(sudo:session): session closed for user root
Jul 30 20:26:45 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-5a71ccd8-74d1-4db8-bc92-f5059f05430f tempest-GroupsV314Test-254783784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-21077ff4-fa82-43a9-868b-3aab84c4f912 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0dfffc13-3f7d-4ace-9853-eae16390bca0" returned: 0 in 8.347s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:26:45 devstack cinder-volume[88719]: DEBUG cinder.image.image_utils [None req-5a71ccd8-74d1-4db8-bc92-f5059f05430f tempest-GroupsV314Test-254783784 None] Image conversion details: src /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-21077ff4-fa82-43a9-868b-3aab84c4f912, size 1024.00 MB, duration 8.35 sec, destination /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0dfffc13-3f7d-4ace-9853-eae16390bca0 {{(pid=88719) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 30 20:26:45 devstack cinder-volume[88719]: INFO cinder.image.image_utils [None req-5a71ccd8-74d1-4db8-bc92-f5059f05430f tempest-GroupsV314Test-254783784 None] Converted 1024.00 MB image at 122.66 MB/s
Jul 30 20:26:45 devstack cinder-volume[88719]: WARNING cinder.volume.drivers.remotefs [None req-5a71ccd8-74d1-4db8-bc92-f5059f05430f tempest-GroupsV314Test-254783784 None] /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0dfffc13-3f7d-4ace-9853-eae16390bca0 is being set with open permissions: ugo+rw: NotImplementedError
Jul 30 20:26:45 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-5a71ccd8-74d1-4db8-bc92-f5059f05430f tempest-GroupsV314Test-254783784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0dfffc13-3f7d-4ace-9853-eae16390bca0 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:26:45 devstack sudo[94978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0dfffc13-3f7d-4ace-9853-eae16390bca0
Jul 30 20:26:45 devstack sudo[94978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:26:45 devstack sudo[94978]: pam_unix(sudo:session): session closed for user root
Jul 30 20:26:45 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-5a71ccd8-74d1-4db8-bc92-f5059f05430f tempest-GroupsV314Test-254783784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0dfffc13-3f7d-4ace-9853-eae16390bca0" returned: 0 in 0.403s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:26:45 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-5a71ccd8-74d1-4db8-bc92-f5059f05430f tempest-GroupsV314Test-254783784 None] Lock "cinder-quobyte-0dfffc13-3f7d-4ace-9853-eae16390bca0" released by "_copy_volume_from_snapshot" :: held 10.315s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:26:45 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-5a71ccd8-74d1-4db8-bc92-f5059f05430f tempest-GroupsV314Test-254783784 None] Acquiring lock "cinder-quobyte-31d1019f-07a7-4153-95ad-3639e07e5412" by "_delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:26:45 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-5a71ccd8-74d1-4db8-bc92-f5059f05430f tempest-GroupsV314Test-254783784 None] Lock "cinder-quobyte-31d1019f-07a7-4153-95ad-3639e07e5412" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:26:45 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-5a71ccd8-74d1-4db8-bc92-f5059f05430f tempest-GroupsV314Test-254783784 None] Deleting offline snapshot 31d1019f-07a7-4153-95ad-3639e07e5412 of volume 21077ff4-fa82-43a9-868b-3aab84c4f912 {{(pid=88719) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 30 20:26:45 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-5a71ccd8-74d1-4db8-bc92-f5059f05430f tempest-GroupsV314Test-254783784 None] snapshot_file for this snap is: volume-21077ff4-fa82-43a9-868b-3aab84c4f912.31d1019f-07a7-4153-95ad-3639e07e5412 {{(pid=88719) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 30 20:26:45 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[f40f8863-12e8-40c5-8191-cdad7237334e]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:26:45 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-5a71ccd8-74d1-4db8-bc92-f5059f05430f tempest-GroupsV314Test-254783784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-21077ff4-fa82-43a9-868b-3aab84c4f912.31d1019f-07a7-4153-95ad-3639e07e5412 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:26:45 devstack sudo[94982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-21077ff4-fa82-43a9-868b-3aab84c4f912.31d1019f-07a7-4153-95ad-3639e07e5412
Jul 30 20:26:45 devstack sudo[94982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:26:46 devstack sudo[94982]: pam_unix(sudo:session): session closed for user root
Jul 30 20:26:46 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-5a71ccd8-74d1-4db8-bc92-f5059f05430f tempest-GroupsV314Test-254783784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-21077ff4-fa82-43a9-868b-3aab84c4f912.31d1019f-07a7-4153-95ad-3639e07e5412" returned: 0 in 0.877s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:26:46 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-5a71ccd8-74d1-4db8-bc92-f5059f05430f tempest-GroupsV314Test-254783784 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-21077ff4-fa82-43a9-868b-3aab84c4f912(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88719) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 30 20:26:46 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea47d718-0269-410b-a7aa-8cec62066dc1]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:26:46 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-5a71ccd8-74d1-4db8-bc92-f5059f05430f tempest-GroupsV314Test-254783784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-21077ff4-fa82-43a9-868b-3aab84c4f912 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:26:46 devstack sudo[95047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-21077ff4-fa82-43a9-868b-3aab84c4f912
Jul 30 20:26:46 devstack sudo[95047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:26:47 devstack cinder-volume[88719]: DEBUG dbcounter [-] [88719] Writing DB stats cinder:SELECT=70,cinder:UPDATE=74,cinder:INSERT=13,cinder:DELETE=7 {{(pid=88719) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 30 20:26:47 devstack sudo[95047]: pam_unix(sudo:session): session closed for user root
Jul 30 20:26:47 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-5a71ccd8-74d1-4db8-bc92-f5059f05430f tempest-GroupsV314Test-254783784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-21077ff4-fa82-43a9-868b-3aab84c4f912" returned: 0 in 0.949s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:26:47 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-5a71ccd8-74d1-4db8-bc92-f5059f05430f tempest-GroupsV314Test-254783784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-21077ff4-fa82-43a9-868b-3aab84c4f912.31d1019f-07a7-4153-95ad-3639e07e5412 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:26:47 devstack sudo[95097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-21077ff4-fa82-43a9-868b-3aab84c4f912.31d1019f-07a7-4153-95ad-3639e07e5412
Jul 30 20:26:47 devstack sudo[95097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:26:48 devstack sudo[95097]: pam_unix(sudo:session): session closed for user root
Jul 30 20:26:48 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-5a71ccd8-74d1-4db8-bc92-f5059f05430f tempest-GroupsV314Test-254783784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-21077ff4-fa82-43a9-868b-3aab84c4f912.31d1019f-07a7-4153-95ad-3639e07e5412" returned: 0 in 0.619s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:26:48 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-5a71ccd8-74d1-4db8-bc92-f5059f05430f tempest-GroupsV314Test-254783784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-21077ff4-fa82-43a9-868b-3aab84c4f912.31d1019f-07a7-4153-95ad-3639e07e5412 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:26:48 devstack sudo[95127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-21077ff4-fa82-43a9-868b-3aab84c4f912.31d1019f-07a7-4153-95ad-3639e07e5412
Jul 30 20:26:48 devstack sudo[95127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:26:48 devstack sudo[95127]: pam_unix(sudo:session): session closed for user root
Jul 30 20:26:48 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-5a71ccd8-74d1-4db8-bc92-f5059f05430f tempest-GroupsV314Test-254783784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-21077ff4-fa82-43a9-868b-3aab84c4f912.31d1019f-07a7-4153-95ad-3639e07e5412" returned: 0 in 0.351s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:26:48 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-5a71ccd8-74d1-4db8-bc92-f5059f05430f tempest-GroupsV314Test-254783784 None] Lock "cinder-quobyte-31d1019f-07a7-4153-95ad-3639e07e5412" released by "_delete_snapshot" :: held 2.953s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:26:48 devstack cinder-volume[88719]: DEBUG dbcounter [-] [88719] Writing DB stats cinder:SELECT=76,cinder:UPDATE=68,cinder:INSERT=18,cinder:DELETE=3 {{(pid=88719) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 30 20:26:48 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-5a71ccd8-74d1-4db8-bc92-f5059f05430f tempest-GroupsV314Test-254783784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.487s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:26:48 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-5a71ccd8-74d1-4db8-bc92-f5059f05430f tempest-GroupsV314Test-254783784 None] Create group from source-group-b63e7868-37f1-45c7-8dc1-3f99fd7857c6 completed successfully.
Jul 30 20:26:49 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-7f1fcda2-40a7-48ab-9da0-1287256121da tempest-GroupsV314Test-254783784 None] Acquiring lock "cinder-quobyte-0dfffc13-3f7d-4ace-9853-eae16390bca0" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:26:49 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-7f1fcda2-40a7-48ab-9da0-1287256121da tempest-GroupsV314Test-254783784 None] Lock "cinder-quobyte-0dfffc13-3f7d-4ace-9853-eae16390bca0" acquired by "delete_volume" :: waited 0.044s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:26:49 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[7af7db9a-9cce-4fcc-a3fe-1b5d9ebe5af1]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:26:49 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-7f1fcda2-40a7-48ab-9da0-1287256121da tempest-GroupsV314Test-254783784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0dfffc13-3f7d-4ace-9853-eae16390bca0 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:26:49 devstack sudo[95156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0dfffc13-3f7d-4ace-9853-eae16390bca0
Jul 30 20:26:49 devstack sudo[95156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:26:50 devstack sudo[95156]: pam_unix(sudo:session): session closed for user root
Jul 30 20:26:50 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-7f1fcda2-40a7-48ab-9da0-1287256121da tempest-GroupsV314Test-254783784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0dfffc13-3f7d-4ace-9853-eae16390bca0" returned: 0 in 0.664s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:26:50 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-7f1fcda2-40a7-48ab-9da0-1287256121da tempest-GroupsV314Test-254783784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0dfffc13-3f7d-4ace-9853-eae16390bca0 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:26:50 devstack sudo[95175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0dfffc13-3f7d-4ace-9853-eae16390bca0
Jul 30 20:26:50 devstack sudo[95175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:26:50 devstack sudo[95175]: pam_unix(sudo:session): session closed for user root
Jul 30 20:26:50 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-7f1fcda2-40a7-48ab-9da0-1287256121da tempest-GroupsV314Test-254783784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0dfffc13-3f7d-4ace-9853-eae16390bca0" returned: 0 in 0.606s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:26:50 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-7f1fcda2-40a7-48ab-9da0-1287256121da tempest-GroupsV314Test-254783784 None] Lock "cinder-quobyte-0dfffc13-3f7d-4ace-9853-eae16390bca0" released by "delete_volume" :: held 1.387s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:26:51 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-7f1fcda2-40a7-48ab-9da0-1287256121da tempest-GroupsV314Test-254783784 None] Created reservations ['f3cb76ab-efca-4898-9ec7-5270c5db5de7'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:26:51 devstack cinder-volume[88719]: WARNING cinder.quota [None req-7f1fcda2-40a7-48ab-9da0-1287256121da tempest-GroupsV314Test-254783784 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1108375201 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1108375201, it is now deprecated. Please use the default quota class for default quota.
Jul 30 20:26:51 devstack cinder-volume[88719]: WARNING cinder.quota [None req-7f1fcda2-40a7-48ab-9da0-1287256121da tempest-GroupsV314Test-254783784 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1108375201 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1108375201, it is now deprecated. Please use the default quota class for default quota.
Jul 30 20:26:51 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-7f1fcda2-40a7-48ab-9da0-1287256121da tempest-GroupsV314Test-254783784 None] Created reservations ['7aa2ec64-132a-4375-9331-6519f784038e', '67741f42-1365-4e47-86ec-8264797cc4ee', '0d8beea1-d463-40c2-942c-4528446c06c2', '71fc3f3d-e6de-4a4e-8367-7675c269890b'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:26:51 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-7f1fcda2-40a7-48ab-9da0-1287256121da tempest-GroupsV314Test-254783784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:26:51 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-7f1fcda2-40a7-48ab-9da0-1287256121da tempest-GroupsV314Test-254783784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:26:51 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-7f1fcda2-40a7-48ab-9da0-1287256121da tempest-GroupsV314Test-254783784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:26:51 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-7f1fcda2-40a7-48ab-9da0-1287256121da tempest-GroupsV314Test-254783784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:26:51 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-7f1fcda2-40a7-48ab-9da0-1287256121da tempest-GroupsV314Test-254783784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:26:51 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-7f1fcda2-40a7-48ab-9da0-1287256121da tempest-GroupsV314Test-254783784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:26:51 devstack sudo[95190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:26:51 devstack sudo[95190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:26:51 devstack sudo[95190]: pam_unix(sudo:session): session closed for user root
Jul 30 20:26:51 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-7f1fcda2-40a7-48ab-9da0-1287256121da tempest-GroupsV314Test-254783784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.326s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:26:51 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-7f1fcda2-40a7-48ab-9da0-1287256121da tempest-GroupsV314Test-254783784 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:26:51 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-7f1fcda2-40a7-48ab-9da0-1287256121da tempest-GroupsV314Test-254783784 None] Delete group completed successfully.
Jul 30 20:26:52 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-5a81390f-dda1-46e0-a599-20180d037f45 tempest-GroupsV314Test-254783784 None] Acquiring lock "cinder-quobyte-21077ff4-fa82-43a9-868b-3aab84c4f912" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:26:52 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-5a81390f-dda1-46e0-a599-20180d037f45 tempest-GroupsV314Test-254783784 None] Lock "cinder-quobyte-21077ff4-fa82-43a9-868b-3aab84c4f912" acquired by "delete_volume" :: waited 0.034s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:26:53 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a3ab08a-eabf-4de4-8786-2516b9d5de4d]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:26:53 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-5a81390f-dda1-46e0-a599-20180d037f45 tempest-GroupsV314Test-254783784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-21077ff4-fa82-43a9-868b-3aab84c4f912 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:26:53 devstack sudo[95246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-21077ff4-fa82-43a9-868b-3aab84c4f912
Jul 30 20:26:53 devstack sudo[95246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:26:53 devstack sudo[95246]: pam_unix(sudo:session): session closed for user root
Jul 30 20:26:53 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-5a81390f-dda1-46e0-a599-20180d037f45 tempest-GroupsV314Test-254783784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-21077ff4-fa82-43a9-868b-3aab84c4f912" returned: 0 in 0.799s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:26:53 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-5a81390f-dda1-46e0-a599-20180d037f45 tempest-GroupsV314Test-254783784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-21077ff4-fa82-43a9-868b-3aab84c4f912 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:26:53 devstack sudo[95282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-21077ff4-fa82-43a9-868b-3aab84c4f912
Jul 30 20:26:53 devstack sudo[95282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:26:54 devstack sudo[95282]: pam_unix(sudo:session): session closed for user root
Jul 30 20:26:54 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-5a81390f-dda1-46e0-a599-20180d037f45 tempest-GroupsV314Test-254783784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-21077ff4-fa82-43a9-868b-3aab84c4f912" returned: 0 in 0.902s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:26:54 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-5a81390f-dda1-46e0-a599-20180d037f45 tempest-GroupsV314Test-254783784 None] Lock "cinder-quobyte-21077ff4-fa82-43a9-868b-3aab84c4f912" released by "delete_volume" :: held 1.865s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:26:55 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-5a81390f-dda1-46e0-a599-20180d037f45 tempest-GroupsV314Test-254783784 None] Created reservations ['e5142819-5ae8-403d-9be7-b8e412c5b38d'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:26:55 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-5a81390f-dda1-46e0-a599-20180d037f45 tempest-GroupsV314Test-254783784 None] Created reservations ['502d5aa2-9d9b-4fdc-9c56-9fad5bac34cb', 'f27d1228-fbff-4201-ba5f-883bd2a23a04', '5924d90c-52e6-4119-b9a6-390a5b5c7f50', '6723e956-7356-4ba9-a727-75c10be0c0a3'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:26:55 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-5a81390f-dda1-46e0-a599-20180d037f45 tempest-GroupsV314Test-254783784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:26:55 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-5a81390f-dda1-46e0-a599-20180d037f45 tempest-GroupsV314Test-254783784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:26:55 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-5a81390f-dda1-46e0-a599-20180d037f45 tempest-GroupsV314Test-254783784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:26:55 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-5a81390f-dda1-46e0-a599-20180d037f45 tempest-GroupsV314Test-254783784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:26:55 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-5a81390f-dda1-46e0-a599-20180d037f45 tempest-GroupsV314Test-254783784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:26:55 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-5a81390f-dda1-46e0-a599-20180d037f45 tempest-GroupsV314Test-254783784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:26:55 devstack sudo[95326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:26:55 devstack sudo[95326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:26:55 devstack sudo[95326]: pam_unix(sudo:session): session closed for user root
Jul 30 20:26:55 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-5a81390f-dda1-46e0-a599-20180d037f45 tempest-GroupsV314Test-254783784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.424s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:26:55 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-5a81390f-dda1-46e0-a599-20180d037f45 tempest-GroupsV314Test-254783784 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:26:55 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-5a81390f-dda1-46e0-a599-20180d037f45 tempest-GroupsV314Test-254783784 None] Delete group completed successfully.
Jul 30 20:27:04 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-a9f867aa-a308-4b5c-b3c0-6508fc337453 tempest-GroupsV320Test-578250527 None] Group tempest-GroupsV320Test-Group-908826320: creating
Jul 30 20:27:04 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-a9f867aa-a308-4b5c-b3c0-6508fc337453 tempest-GroupsV320Test-578250527 None] Group tempest-GroupsV320Test-Group-908826320: created successfully
Jul 30 20:27:04 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-a9f867aa-a308-4b5c-b3c0-6508fc337453 tempest-GroupsV320Test-578250527 None] Create group completed successfully.
Jul 30 20:27:06 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-3f634340-6c02-404d-83d6-65e4199264f2 tempest-GroupsV320Test-578250527 None] Created reservations ['79ed5d0e-1608-4e6b-9cb5-547441d119a0'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:27:06 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-3f634340-6c02-404d-83d6-65e4199264f2 tempest-GroupsV320Test-578250527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:27:06 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-3f634340-6c02-404d-83d6-65e4199264f2 tempest-GroupsV320Test-578250527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:27:06 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-3f634340-6c02-404d-83d6-65e4199264f2 tempest-GroupsV320Test-578250527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:27:06 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-3f634340-6c02-404d-83d6-65e4199264f2 tempest-GroupsV320Test-578250527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:27:06 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-3f634340-6c02-404d-83d6-65e4199264f2 tempest-GroupsV320Test-578250527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:27:06 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3f634340-6c02-404d-83d6-65e4199264f2 tempest-GroupsV320Test-578250527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:27:06 devstack sudo[95392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:27:06 devstack sudo[95392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:27:06 devstack sudo[95392]: pam_unix(sudo:session): session closed for user root
Jul 30 20:27:06 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3f634340-6c02-404d-83d6-65e4199264f2 tempest-GroupsV320Test-578250527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.279s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:27:06 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-3f634340-6c02-404d-83d6-65e4199264f2 tempest-GroupsV320Test-578250527 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:27:06 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-3f634340-6c02-404d-83d6-65e4199264f2 tempest-GroupsV320Test-578250527 None] Delete group completed successfully.
Jul 30 20:27:07 devstack cinder-volume[88719]: INFO cinder.volume.manager [req-02177938-b171-4401-b02e-a3569001c25d req-12782c2f-f05c-446f-b39b-d2aa6538c217 tempest-AttachVolumeNegativeTest-1614371178 None] Terminate volume connection completed successfully.
Jul 30 20:27:07 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [req-02177938-b171-4401-b02e-a3569001c25d req-12782c2f-f05c-446f-b39b-d2aa6538c217 tempest-AttachVolumeNegativeTest-1614371178 None] Deleting attachment 4ed529ec-13b4-468e-bda6-951c853bcc81. {{(pid=88719) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 30 20:27:16 devstack cinder-volume[88719]: DEBUG oslo_service.periodic_task [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88719) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 30 20:27:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:27:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:27:16 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:27:16 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:27:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:27:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:27:16 devstack sudo[95482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:27:16 devstack sudo[95482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:27:16 devstack sudo[95482]: pam_unix(sudo:session): session closed for user root
Jul 30 20:27:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.308s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:27:16 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:27:16 devstack cinder-volume[88719]: DEBUG oslo_service.periodic_task [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Running periodic task VolumeManager._thread_info {{(pid=88719) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 30 20:27:16 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] thread count: 8 {{(pid=88719) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 30 20:27:16 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] thread info: [<_MainThread(MainThread, started 132390416908416)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132390306497536)>, <Thread(Thread-3 (stat_writer), started daemon 132390304471680)>, <Thread(Rabbit-heartbeat, started daemon 132390303393408)>, <Thread(Thread-5 (_runner), started daemon 132390303543168)>, <Thread(Thread-7 (_runner), started daemon 132390303563392)>, <Thread(fd_logger, started daemon 132390301344640)>, <Thread(privsep_reader, started daemon 132390301560640)>] {{(pid=88719) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 30 20:27:17 devstack cinder-volume[88719]: DEBUG dbcounter [-] [88719] Writing DB stats cinder:UPDATE=30,cinder:SELECT=27,cinder:INSERT=4 {{(pid=88719) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 30 20:27:17 devstack cinder-volume[88719]: DEBUG dbcounter [-] [88719] Writing DB stats cinder:UPDATE=24,cinder:SELECT=24,cinder:INSERT=7 {{(pid=88719) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 30 20:27:24 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-04ac1b70-71c5-4c88-abae-be5b0898bb4f tempest-AttachVolumeShelveTestJSON-1438165976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:27:24 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-04ac1b70-71c5-4c88-abae-be5b0898bb4f tempest-AttachVolumeShelveTestJSON-1438165976 None] Flow 'volume_create_manager' (b2405ab4-f3ce-4133-b680-ca589ffe0868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:27:24 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-04ac1b70-71c5-4c88-abae-be5b0898bb4f tempest-AttachVolumeShelveTestJSON-1438165976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa985675-838c-421f-8437-c73b00592bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:27:24 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-04ac1b70-71c5-4c88-abae-be5b0898bb4f tempest-AttachVolumeShelveTestJSON-1438165976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa985675-838c-421f-8437-c73b00592bd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:27:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-506538187',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3388843d-4847-4c36-b476-eaa743b9350f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87b06e8713304f1e960328df8f9caf7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:27:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:27:24Z,use_quota=True,user_id='9e74c68bbd7d4ae29bdf66402ca04824',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:27:24 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-04ac1b70-71c5-4c88-abae-be5b0898bb4f tempest-AttachVolumeShelveTestJSON-1438165976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80b9c9aa-4365-4b9d-9298-625ce81b4b96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:27:24 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-04ac1b70-71c5-4c88-abae-be5b0898bb4f tempest-AttachVolumeShelveTestJSON-1438165976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80b9c9aa-4365-4b9d-9298-625ce81b4b96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:27:24 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-04ac1b70-71c5-4c88-abae-be5b0898bb4f tempest-AttachVolumeShelveTestJSON-1438165976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e15c815-80c0-482f-90b8-bf2afc194877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:27:24 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-04ac1b70-71c5-4c88-abae-be5b0898bb4f tempest-AttachVolumeShelveTestJSON-1438165976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e15c815-80c0-482f-90b8-bf2afc194877) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3388843d-4847-4c36-b476-eaa743b9350f', 'volume_name': 'volume-3388843d-4847-4c36-b476-eaa743b9350f', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:27:24 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-04ac1b70-71c5-4c88-abae-be5b0898bb4f tempest-AttachVolumeShelveTestJSON-1438165976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e1d190e-2978-4ecf-bc15-bc0af2be8ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:27:24 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-04ac1b70-71c5-4c88-abae-be5b0898bb4f tempest-AttachVolumeShelveTestJSON-1438165976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e1d190e-2978-4ecf-bc15-bc0af2be8ab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:27:24 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-04ac1b70-71c5-4c88-abae-be5b0898bb4f tempest-AttachVolumeShelveTestJSON-1438165976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ebb5c5e-2c52-49fe-a1a4-bd7c36044b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:27:24 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-04ac1b70-71c5-4c88-abae-be5b0898bb4f tempest-AttachVolumeShelveTestJSON-1438165976 None] Volume 3388843d-4847-4c36-b476-eaa743b9350f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3388843d-4847-4c36-b476-eaa743b9350f', 'volume_size': 1}
Jul 30 20:27:24 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-04ac1b70-71c5-4c88-abae-be5b0898bb4f tempest-AttachVolumeShelveTestJSON-1438165976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:27:24 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-04ac1b70-71c5-4c88-abae-be5b0898bb4f tempest-AttachVolumeShelveTestJSON-1438165976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:27:24 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-04ac1b70-71c5-4c88-abae-be5b0898bb4f tempest-AttachVolumeShelveTestJSON-1438165976 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:27:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-506538187',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3388843d-4847-4c36-b476-eaa743b9350f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87b06e8713304f1e960328df8f9caf7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:27:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:27:24Z,use_quota=True,user_id='9e74c68bbd7d4ae29bdf66402ca04824',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:27:24 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-04ac1b70-71c5-4c88-abae-be5b0898bb4f tempest-AttachVolumeShelveTestJSON-1438165976 None] Creating volume 3388843d-4847-4c36-b476-eaa743b9350f {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:27:24 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-04ac1b70-71c5-4c88-abae-be5b0898bb4f tempest-AttachVolumeShelveTestJSON-1438165976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:27:24 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-04ac1b70-71c5-4c88-abae-be5b0898bb4f tempest-AttachVolumeShelveTestJSON-1438165976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:27:24 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-04ac1b70-71c5-4c88-abae-be5b0898bb4f tempest-AttachVolumeShelveTestJSON-1438165976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:27:24 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-04ac1b70-71c5-4c88-abae-be5b0898bb4f tempest-AttachVolumeShelveTestJSON-1438165976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:27:24 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-04ac1b70-71c5-4c88-abae-be5b0898bb4f tempest-AttachVolumeShelveTestJSON-1438165976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:27:24 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-04ac1b70-71c5-4c88-abae-be5b0898bb4f tempest-AttachVolumeShelveTestJSON-1438165976 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:27:24 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-04ac1b70-71c5-4c88-abae-be5b0898bb4f tempest-AttachVolumeShelveTestJSON-1438165976 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:27:24 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-04ac1b70-71c5-4c88-abae-be5b0898bb4f tempest-AttachVolumeShelveTestJSON-1438165976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3388843d-4847-4c36-b476-eaa743b9350f 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:27:24 devstack sudo[95580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3388843d-4847-4c36-b476-eaa743b9350f 1073741824
Jul 30 20:27:24 devstack sudo[95580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:27:25 devstack sudo[95580]: pam_unix(sudo:session): session closed for user root
Jul 30 20:27:25 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-04ac1b70-71c5-4c88-abae-be5b0898bb4f tempest-AttachVolumeShelveTestJSON-1438165976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3388843d-4847-4c36-b476-eaa743b9350f 1073741824" returned: 0 in 0.813s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:27:25 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-04ac1b70-71c5-4c88-abae-be5b0898bb4f tempest-AttachVolumeShelveTestJSON-1438165976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3388843d-4847-4c36-b476-eaa743b9350f {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:27:25 devstack sudo[95601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3388843d-4847-4c36-b476-eaa743b9350f
Jul 30 20:27:25 devstack sudo[95601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:27:25 devstack sudo[95601]: pam_unix(sudo:session): session closed for user root
Jul 30 20:27:25 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-04ac1b70-71c5-4c88-abae-be5b0898bb4f tempest-AttachVolumeShelveTestJSON-1438165976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3388843d-4847-4c36-b476-eaa743b9350f" returned: 0 in 0.343s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:27:25 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-04ac1b70-71c5-4c88-abae-be5b0898bb4f tempest-AttachVolumeShelveTestJSON-1438165976 None] <== create_volume: return (1234ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:27:25 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-04ac1b70-71c5-4c88-abae-be5b0898bb4f tempest-AttachVolumeShelveTestJSON-1438165976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.238s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:27:25 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-04ac1b70-71c5-4c88-abae-be5b0898bb4f tempest-AttachVolumeShelveTestJSON-1438165976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ebb5c5e-2c52-49fe-a1a4-bd7c36044b70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3388843d-4847-4c36-b476-eaa743b9350f', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:27:25 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-04ac1b70-71c5-4c88-abae-be5b0898bb4f tempest-AttachVolumeShelveTestJSON-1438165976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bd01623-c1c6-4064-87fe-a38ed15a7619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:27:25 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-04ac1b70-71c5-4c88-abae-be5b0898bb4f tempest-AttachVolumeShelveTestJSON-1438165976 None] Volume volume-3388843d-4847-4c36-b476-eaa743b9350f (3388843d-4847-4c36-b476-eaa743b9350f): created successfully
Jul 30 20:27:25 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-04ac1b70-71c5-4c88-abae-be5b0898bb4f tempest-AttachVolumeShelveTestJSON-1438165976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bd01623-c1c6-4064-87fe-a38ed15a7619) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:27:25 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-04ac1b70-71c5-4c88-abae-be5b0898bb4f tempest-AttachVolumeShelveTestJSON-1438165976 None] Flow 'volume_create_manager' (b2405ab4-f3ce-4133-b680-ca589ffe0868) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:27:25 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-04ac1b70-71c5-4c88-abae-be5b0898bb4f tempest-AttachVolumeShelveTestJSON-1438165976 None] Created volume successfully.
Jul 30 20:27:35 devstack cinder-volume[88719]: DEBUG dbcounter [-] [88719] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2,cinder:INSERT=1 {{(pid=88719) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 30 20:27:35 devstack cinder-volume[88719]: DEBUG dbcounter [-] [88719] Writing DB stats cinder:SELECT=1,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=88719) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 30 20:27:39 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a0953bc-351e-47ef-a21d-d3d6b61d786f tempest-VolumeQuotasNegativeTestJSON-551649527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:27:39 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5a0953bc-351e-47ef-a21d-d3d6b61d786f tempest-VolumeQuotasNegativeTestJSON-551649527 None] Flow 'volume_create_manager' (2c49d5a5-4b38-439f-a19e-01024870e1ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:27:39 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5a0953bc-351e-47ef-a21d-d3d6b61d786f tempest-VolumeQuotasNegativeTestJSON-551649527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (243f82ae-5517-4059-97de-3bf03b3a6065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:27:39 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5a0953bc-351e-47ef-a21d-d3d6b61d786f tempest-VolumeQuotasNegativeTestJSON-551649527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (243f82ae-5517-4059-97de-3bf03b3a6065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:27:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1429636941',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61b0a26a-a9ed-4cd1-81bd-587f74a526e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f56b7cad03a436cac9ab534abf94d8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:27:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:27:39Z,use_quota=True,user_id='f33b85e526b5466f9df31161caa266b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:27:39 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5a0953bc-351e-47ef-a21d-d3d6b61d786f tempest-VolumeQuotasNegativeTestJSON-551649527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dd9a727-731f-4e9b-894a-51dc37fa61ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:27:39 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5a0953bc-351e-47ef-a21d-d3d6b61d786f tempest-VolumeQuotasNegativeTestJSON-551649527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dd9a727-731f-4e9b-894a-51dc37fa61ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:27:39 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5a0953bc-351e-47ef-a21d-d3d6b61d786f tempest-VolumeQuotasNegativeTestJSON-551649527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c70845e-eb5a-4a89-99e3-041dcdf2c200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:27:39 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5a0953bc-351e-47ef-a21d-d3d6b61d786f tempest-VolumeQuotasNegativeTestJSON-551649527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c70845e-eb5a-4a89-99e3-041dcdf2c200) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61b0a26a-a9ed-4cd1-81bd-587f74a526e8', 'volume_name': 'volume-61b0a26a-a9ed-4cd1-81bd-587f74a526e8', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:27:39 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5a0953bc-351e-47ef-a21d-d3d6b61d786f tempest-VolumeQuotasNegativeTestJSON-551649527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc4374b3-1a06-4dc5-a53a-3384c0394e75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:27:39 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5a0953bc-351e-47ef-a21d-d3d6b61d786f tempest-VolumeQuotasNegativeTestJSON-551649527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc4374b3-1a06-4dc5-a53a-3384c0394e75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:27:39 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5a0953bc-351e-47ef-a21d-d3d6b61d786f tempest-VolumeQuotasNegativeTestJSON-551649527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (487e6ca9-5889-4d46-b7b1-87f68abe15c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:27:39 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-5a0953bc-351e-47ef-a21d-d3d6b61d786f tempest-VolumeQuotasNegativeTestJSON-551649527 None] Volume 61b0a26a-a9ed-4cd1-81bd-587f74a526e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61b0a26a-a9ed-4cd1-81bd-587f74a526e8', 'volume_size': 1}
Jul 30 20:27:39 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-5a0953bc-351e-47ef-a21d-d3d6b61d786f tempest-VolumeQuotasNegativeTestJSON-551649527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:27:39 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-5a0953bc-351e-47ef-a21d-d3d6b61d786f tempest-VolumeQuotasNegativeTestJSON-551649527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:27:39 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-5a0953bc-351e-47ef-a21d-d3d6b61d786f tempest-VolumeQuotasNegativeTestJSON-551649527 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:27:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1429636941',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61b0a26a-a9ed-4cd1-81bd-587f74a526e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f56b7cad03a436cac9ab534abf94d8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:27:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:27:39Z,use_quota=True,user_id='f33b85e526b5466f9df31161caa266b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:27:39 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-5a0953bc-351e-47ef-a21d-d3d6b61d786f tempest-VolumeQuotasNegativeTestJSON-551649527 None] Creating volume 61b0a26a-a9ed-4cd1-81bd-587f74a526e8 {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:27:39 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-5a0953bc-351e-47ef-a21d-d3d6b61d786f tempest-VolumeQuotasNegativeTestJSON-551649527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:27:39 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-5a0953bc-351e-47ef-a21d-d3d6b61d786f tempest-VolumeQuotasNegativeTestJSON-551649527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:27:39 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-5a0953bc-351e-47ef-a21d-d3d6b61d786f tempest-VolumeQuotasNegativeTestJSON-551649527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:27:39 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-5a0953bc-351e-47ef-a21d-d3d6b61d786f tempest-VolumeQuotasNegativeTestJSON-551649527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:27:39 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-5a0953bc-351e-47ef-a21d-d3d6b61d786f tempest-VolumeQuotasNegativeTestJSON-551649527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.051s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:27:39 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-5a0953bc-351e-47ef-a21d-d3d6b61d786f tempest-VolumeQuotasNegativeTestJSON-551649527 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:27:39 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-5a0953bc-351e-47ef-a21d-d3d6b61d786f tempest-VolumeQuotasNegativeTestJSON-551649527 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:27:39 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-5a0953bc-351e-47ef-a21d-d3d6b61d786f tempest-VolumeQuotasNegativeTestJSON-551649527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-61b0a26a-a9ed-4cd1-81bd-587f74a526e8 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:27:39 devstack sudo[95777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-61b0a26a-a9ed-4cd1-81bd-587f74a526e8 1073741824
Jul 30 20:27:39 devstack sudo[95777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:27:40 devstack sudo[95777]: pam_unix(sudo:session): session closed for user root
Jul 30 20:27:40 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-5a0953bc-351e-47ef-a21d-d3d6b61d786f tempest-VolumeQuotasNegativeTestJSON-551649527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-61b0a26a-a9ed-4cd1-81bd-587f74a526e8 1073741824" returned: 0 in 0.800s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:27:40 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-5a0953bc-351e-47ef-a21d-d3d6b61d786f tempest-VolumeQuotasNegativeTestJSON-551649527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-61b0a26a-a9ed-4cd1-81bd-587f74a526e8 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:27:40 devstack sudo[95798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-61b0a26a-a9ed-4cd1-81bd-587f74a526e8
Jul 30 20:27:40 devstack sudo[95798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:27:40 devstack sudo[95798]: pam_unix(sudo:session): session closed for user root
Jul 30 20:27:40 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-5a0953bc-351e-47ef-a21d-d3d6b61d786f tempest-VolumeQuotasNegativeTestJSON-551649527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-61b0a26a-a9ed-4cd1-81bd-587f74a526e8" returned: 0 in 0.339s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:27:40 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-5a0953bc-351e-47ef-a21d-d3d6b61d786f tempest-VolumeQuotasNegativeTestJSON-551649527 None] <== create_volume: return (1229ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:27:40 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-5a0953bc-351e-47ef-a21d-d3d6b61d786f tempest-VolumeQuotasNegativeTestJSON-551649527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.243s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:27:40 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5a0953bc-351e-47ef-a21d-d3d6b61d786f tempest-VolumeQuotasNegativeTestJSON-551649527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (487e6ca9-5889-4d46-b7b1-87f68abe15c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61b0a26a-a9ed-4cd1-81bd-587f74a526e8', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:27:40 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5a0953bc-351e-47ef-a21d-d3d6b61d786f tempest-VolumeQuotasNegativeTestJSON-551649527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ef3c1d6-922f-420e-95c2-0a52c130b452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:27:40 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-5a0953bc-351e-47ef-a21d-d3d6b61d786f tempest-VolumeQuotasNegativeTestJSON-551649527 None] Volume volume-61b0a26a-a9ed-4cd1-81bd-587f74a526e8 (61b0a26a-a9ed-4cd1-81bd-587f74a526e8): created successfully
Jul 30 20:27:40 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5a0953bc-351e-47ef-a21d-d3d6b61d786f tempest-VolumeQuotasNegativeTestJSON-551649527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ef3c1d6-922f-420e-95c2-0a52c130b452) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:27:40 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5a0953bc-351e-47ef-a21d-d3d6b61d786f tempest-VolumeQuotasNegativeTestJSON-551649527 None] Flow 'volume_create_manager' (2c49d5a5-4b38-439f-a19e-01024870e1ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:27:40 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-5a0953bc-351e-47ef-a21d-d3d6b61d786f tempest-VolumeQuotasNegativeTestJSON-551649527 None] Created volume successfully.
Jul 30 20:27:41 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [req-038ec69f-1562-491c-a2bc-5e3e5af1b978 req-9af3ab32-e25a-4e33-9487-3a7fe4e6d18a tempest-AttachVolumeShelveTestJSON-1438165976 None] No connector for attachment 3fe6cfb4-bb04-46a5-a72a-720e4bbef789; skipping storage backend terminate_connection call. {{(pid=88719) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}}
Jul 30 20:27:41 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [req-038ec69f-1562-491c-a2bc-5e3e5af1b978 req-9af3ab32-e25a-4e33-9487-3a7fe4e6d18a tempest-AttachVolumeShelveTestJSON-1438165976 None] Deleting attachment 3fe6cfb4-bb04-46a5-a72a-720e4bbef789. {{(pid=88719) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 30 20:27:42 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-3bb13021-2b56-4512-9d39-77ed9cdfee5d tempest-VolumeQuotasNegativeTestJSON-551649527 None] Acquiring lock "cinder-61b0a26a-a9ed-4cd1-81bd-587f74a526e8-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:27:42 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-3bb13021-2b56-4512-9d39-77ed9cdfee5d tempest-VolumeQuotasNegativeTestJSON-551649527 None] Lock "cinder-61b0a26a-a9ed-4cd1-81bd-587f74a526e8-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:27:42 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-3bb13021-2b56-4512-9d39-77ed9cdfee5d tempest-VolumeQuotasNegativeTestJSON-551649527 None] Acquiring lock "cinder-quobyte-61b0a26a-a9ed-4cd1-81bd-587f74a526e8" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:27:42 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-3bb13021-2b56-4512-9d39-77ed9cdfee5d tempest-VolumeQuotasNegativeTestJSON-551649527 None] Lock "cinder-quobyte-61b0a26a-a9ed-4cd1-81bd-587f74a526e8" acquired by "delete_volume" :: waited 0.031s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:27:42 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[90bf7372-648f-4e36-b8fa-d41fe7af92e4]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:27:42 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3bb13021-2b56-4512-9d39-77ed9cdfee5d tempest-VolumeQuotasNegativeTestJSON-551649527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-61b0a26a-a9ed-4cd1-81bd-587f74a526e8 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:27:42 devstack sudo[95804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-61b0a26a-a9ed-4cd1-81bd-587f74a526e8
Jul 30 20:27:42 devstack sudo[95804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:27:42 devstack sudo[95804]: pam_unix(sudo:session): session closed for user root
Jul 30 20:27:42 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3bb13021-2b56-4512-9d39-77ed9cdfee5d tempest-VolumeQuotasNegativeTestJSON-551649527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-61b0a26a-a9ed-4cd1-81bd-587f74a526e8" returned: 0 in 0.424s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:27:42 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3bb13021-2b56-4512-9d39-77ed9cdfee5d tempest-VolumeQuotasNegativeTestJSON-551649527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-61b0a26a-a9ed-4cd1-81bd-587f74a526e8 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:27:42 devstack sudo[95809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-61b0a26a-a9ed-4cd1-81bd-587f74a526e8
Jul 30 20:27:42 devstack sudo[95809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:27:43 devstack sudo[95809]: pam_unix(sudo:session): session closed for user root
Jul 30 20:27:43 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3bb13021-2b56-4512-9d39-77ed9cdfee5d tempest-VolumeQuotasNegativeTestJSON-551649527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-61b0a26a-a9ed-4cd1-81bd-587f74a526e8" returned: 0 in 0.323s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:27:43 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-3bb13021-2b56-4512-9d39-77ed9cdfee5d tempest-VolumeQuotasNegativeTestJSON-551649527 None] Lock "cinder-quobyte-61b0a26a-a9ed-4cd1-81bd-587f74a526e8" released by "delete_volume" :: held 0.799s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:27:43 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-3bb13021-2b56-4512-9d39-77ed9cdfee5d tempest-VolumeQuotasNegativeTestJSON-551649527 None] Created reservations ['526b14f5-f651-4aa1-afe8-92a5661fbd8e', '200d71ed-2457-497a-b2ad-08cd9c8a7c52', '7b7d7c9d-941a-4330-a19e-d11194c28fc4', '99ce8436-f099-4553-a0a7-2ed7c27945f4'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:27:43 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-3bb13021-2b56-4512-9d39-77ed9cdfee5d tempest-VolumeQuotasNegativeTestJSON-551649527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:27:43 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-3bb13021-2b56-4512-9d39-77ed9cdfee5d tempest-VolumeQuotasNegativeTestJSON-551649527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:27:43 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-3bb13021-2b56-4512-9d39-77ed9cdfee5d tempest-VolumeQuotasNegativeTestJSON-551649527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:27:43 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-3bb13021-2b56-4512-9d39-77ed9cdfee5d tempest-VolumeQuotasNegativeTestJSON-551649527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:27:43 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-3bb13021-2b56-4512-9d39-77ed9cdfee5d tempest-VolumeQuotasNegativeTestJSON-551649527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:27:43 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3bb13021-2b56-4512-9d39-77ed9cdfee5d tempest-VolumeQuotasNegativeTestJSON-551649527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:27:43 devstack sudo[95813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:27:43 devstack sudo[95813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:27:43 devstack sudo[95813]: pam_unix(sudo:session): session closed for user root
Jul 30 20:27:43 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3bb13021-2b56-4512-9d39-77ed9cdfee5d tempest-VolumeQuotasNegativeTestJSON-551649527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.333s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:27:43 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-3bb13021-2b56-4512-9d39-77ed9cdfee5d tempest-VolumeQuotasNegativeTestJSON-551649527 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:27:43 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-3bb13021-2b56-4512-9d39-77ed9cdfee5d tempest-VolumeQuotasNegativeTestJSON-551649527 None] Deleted volume successfully.
Jul 30 20:27:43 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-3bb13021-2b56-4512-9d39-77ed9cdfee5d tempest-VolumeQuotasNegativeTestJSON-551649527 None] Lock "cinder-61b0a26a-a9ed-4cd1-81bd-587f74a526e8-delete_volume" released by "delete_volume" :: held 1.428s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:27:50 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ebc26a9-bd07-4d4a-b89f-0b6f8592aba2 tempest-AttachVolumeNegativeTest-1614371178 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:27:50 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2ebc26a9-bd07-4d4a-b89f-0b6f8592aba2 tempest-AttachVolumeNegativeTest-1614371178 None] Flow 'volume_create_manager' (4cc717dd-11ab-429c-9a55-b777cef28300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:27:50 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2ebc26a9-bd07-4d4a-b89f-0b6f8592aba2 tempest-AttachVolumeNegativeTest-1614371178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (282282e0-8777-4ad3-9757-c319c9f8d10f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:27:50 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2ebc26a9-bd07-4d4a-b89f-0b6f8592aba2 tempest-AttachVolumeNegativeTest-1614371178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (282282e0-8777-4ad3-9757-c319c9f8d10f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:27:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1053533019',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5714824-e744-4e58-ae56-e3877b97e3ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94612bdf28ad4dcc8603985e17aaea85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:27:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:27:51Z,use_quota=True,user_id='b3458179c6164555a4b1c503e06fdef3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:27:50 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2ebc26a9-bd07-4d4a-b89f-0b6f8592aba2 tempest-AttachVolumeNegativeTest-1614371178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f7c5015-3af2-4b98-b5ed-e212aae16d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:27:50 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2ebc26a9-bd07-4d4a-b89f-0b6f8592aba2 tempest-AttachVolumeNegativeTest-1614371178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f7c5015-3af2-4b98-b5ed-e212aae16d76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:27:50 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2ebc26a9-bd07-4d4a-b89f-0b6f8592aba2 tempest-AttachVolumeNegativeTest-1614371178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5a849f6-88e0-443b-a1b1-44354c870f9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:27:50 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2ebc26a9-bd07-4d4a-b89f-0b6f8592aba2 tempest-AttachVolumeNegativeTest-1614371178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5a849f6-88e0-443b-a1b1-44354c870f9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5714824-e744-4e58-ae56-e3877b97e3ea', 'volume_name': 'volume-b5714824-e744-4e58-ae56-e3877b97e3ea', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:27:50 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2ebc26a9-bd07-4d4a-b89f-0b6f8592aba2 tempest-AttachVolumeNegativeTest-1614371178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ac865a8-b3cf-4fe9-9712-7c77d48255a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:27:50 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2ebc26a9-bd07-4d4a-b89f-0b6f8592aba2 tempest-AttachVolumeNegativeTest-1614371178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ac865a8-b3cf-4fe9-9712-7c77d48255a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:27:50 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2ebc26a9-bd07-4d4a-b89f-0b6f8592aba2 tempest-AttachVolumeNegativeTest-1614371178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16eccc0f-4e42-4a70-a302-40e07128dd82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:27:50 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-2ebc26a9-bd07-4d4a-b89f-0b6f8592aba2 tempest-AttachVolumeNegativeTest-1614371178 None] Volume b5714824-e744-4e58-ae56-e3877b97e3ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5714824-e744-4e58-ae56-e3877b97e3ea', 'volume_size': 1}
Jul 30 20:27:50 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-2ebc26a9-bd07-4d4a-b89f-0b6f8592aba2 tempest-AttachVolumeNegativeTest-1614371178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:27:50 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-2ebc26a9-bd07-4d4a-b89f-0b6f8592aba2 tempest-AttachVolumeNegativeTest-1614371178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:27:50 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-2ebc26a9-bd07-4d4a-b89f-0b6f8592aba2 tempest-AttachVolumeNegativeTest-1614371178 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:27:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1053533019',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5714824-e744-4e58-ae56-e3877b97e3ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94612bdf28ad4dcc8603985e17aaea85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:27:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:27:51Z,use_quota=True,user_id='b3458179c6164555a4b1c503e06fdef3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:27:50 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-2ebc26a9-bd07-4d4a-b89f-0b6f8592aba2 tempest-AttachVolumeNegativeTest-1614371178 None] Creating volume b5714824-e744-4e58-ae56-e3877b97e3ea {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:27:50 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-2ebc26a9-bd07-4d4a-b89f-0b6f8592aba2 tempest-AttachVolumeNegativeTest-1614371178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:27:50 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-2ebc26a9-bd07-4d4a-b89f-0b6f8592aba2 tempest-AttachVolumeNegativeTest-1614371178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:27:50 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-2ebc26a9-bd07-4d4a-b89f-0b6f8592aba2 tempest-AttachVolumeNegativeTest-1614371178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:27:50 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-2ebc26a9-bd07-4d4a-b89f-0b6f8592aba2 tempest-AttachVolumeNegativeTest-1614371178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:27:50 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-2ebc26a9-bd07-4d4a-b89f-0b6f8592aba2 tempest-AttachVolumeNegativeTest-1614371178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:27:50 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-2ebc26a9-bd07-4d4a-b89f-0b6f8592aba2 tempest-AttachVolumeNegativeTest-1614371178 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:27:50 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-2ebc26a9-bd07-4d4a-b89f-0b6f8592aba2 tempest-AttachVolumeNegativeTest-1614371178 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:27:50 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2ebc26a9-bd07-4d4a-b89f-0b6f8592aba2 tempest-AttachVolumeNegativeTest-1614371178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b5714824-e744-4e58-ae56-e3877b97e3ea 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:27:50 devstack sudo[95879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b5714824-e744-4e58-ae56-e3877b97e3ea 1073741824
Jul 30 20:27:50 devstack sudo[95879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:27:51 devstack sudo[95879]: pam_unix(sudo:session): session closed for user root
Jul 30 20:27:51 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2ebc26a9-bd07-4d4a-b89f-0b6f8592aba2 tempest-AttachVolumeNegativeTest-1614371178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b5714824-e744-4e58-ae56-e3877b97e3ea 1073741824" returned: 0 in 0.562s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:27:51 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2ebc26a9-bd07-4d4a-b89f-0b6f8592aba2 tempest-AttachVolumeNegativeTest-1614371178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b5714824-e744-4e58-ae56-e3877b97e3ea {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:27:51 devstack sudo[95886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b5714824-e744-4e58-ae56-e3877b97e3ea
Jul 30 20:27:51 devstack sudo[95886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:27:51 devstack sudo[95886]: pam_unix(sudo:session): session closed for user root
Jul 30 20:27:51 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2ebc26a9-bd07-4d4a-b89f-0b6f8592aba2 tempest-AttachVolumeNegativeTest-1614371178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b5714824-e744-4e58-ae56-e3877b97e3ea" returned: 0 in 0.291s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:27:51 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-2ebc26a9-bd07-4d4a-b89f-0b6f8592aba2 tempest-AttachVolumeNegativeTest-1614371178 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:27:51 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-2ebc26a9-bd07-4d4a-b89f-0b6f8592aba2 tempest-AttachVolumeNegativeTest-1614371178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:27:51 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2ebc26a9-bd07-4d4a-b89f-0b6f8592aba2 tempest-AttachVolumeNegativeTest-1614371178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16eccc0f-4e42-4a70-a302-40e07128dd82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5714824-e744-4e58-ae56-e3877b97e3ea', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:27:51 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2ebc26a9-bd07-4d4a-b89f-0b6f8592aba2 tempest-AttachVolumeNegativeTest-1614371178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa8003c6-2753-4f98-af62-d8c13cb61c90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:27:51 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-2ebc26a9-bd07-4d4a-b89f-0b6f8592aba2 tempest-AttachVolumeNegativeTest-1614371178 None] Volume volume-b5714824-e744-4e58-ae56-e3877b97e3ea (b5714824-e744-4e58-ae56-e3877b97e3ea): created successfully
Jul 30 20:27:51 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2ebc26a9-bd07-4d4a-b89f-0b6f8592aba2 tempest-AttachVolumeNegativeTest-1614371178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa8003c6-2753-4f98-af62-d8c13cb61c90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:27:51 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2ebc26a9-bd07-4d4a-b89f-0b6f8592aba2 tempest-AttachVolumeNegativeTest-1614371178 None] Flow 'volume_create_manager' (4cc717dd-11ab-429c-9a55-b777cef28300) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:27:51 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-2ebc26a9-bd07-4d4a-b89f-0b6f8592aba2 tempest-AttachVolumeNegativeTest-1614371178 None] Created volume successfully.
Jul 30 20:27:54 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [req-abb43025-11be-433b-8b8c-1d10bba727ca req-8b914d27-fe37-4c74-8087-1623b80186ca tempest-AttachVolumeNegativeTest-1614371178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:27:54 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [req-abb43025-11be-433b-8b8c-1d10bba727ca req-8b914d27-fe37-4c74-8087-1623b80186ca tempest-AttachVolumeNegativeTest-1614371178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:27:54 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [req-abb43025-11be-433b-8b8c-1d10bba727ca req-8b914d27-fe37-4c74-8087-1623b80186ca tempest-AttachVolumeNegativeTest-1614371178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.046s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:27:55 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [req-abb43025-11be-433b-8b8c-1d10bba727ca req-8b914d27-fe37-4c74-8087-1623b80186ca tempest-AttachVolumeNegativeTest-1614371178 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5', 'name': 'volume-b5714824-e744-4e58-ae56-e3877b97e3ea', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '738d4b34-34f9-4cfa-a496-ae404f523b54', 'enforce_multipath': True} {{(pid=88719) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 30 20:27:55 devstack cinder-volume[88719]: INFO cinder.volume.manager [req-abb43025-11be-433b-8b8c-1d10bba727ca req-8b914d27-fe37-4c74-8087-1623b80186ca tempest-AttachVolumeNegativeTest-1614371178 None] attachment_update completed successfully.
Jul 30 20:27:59 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-21a3e208-4a0c-4df0-ac1e-85f95c62ec18 tempest-AttachVolumeTestJSON-1478692577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:27:59 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-21a3e208-4a0c-4df0-ac1e-85f95c62ec18 tempest-AttachVolumeTestJSON-1478692577 None] Flow 'volume_create_manager' (c4c63785-2da9-4b8d-a387-f558d9aa3aaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:27:59 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-21a3e208-4a0c-4df0-ac1e-85f95c62ec18 tempest-AttachVolumeTestJSON-1478692577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97174e41-4f9e-407d-996b-4be041910da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:27:59 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-21a3e208-4a0c-4df0-ac1e-85f95c62ec18 tempest-AttachVolumeTestJSON-1478692577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97174e41-4f9e-407d-996b-4be041910da0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:27:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2076453253',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bfca9f5-21c7-4d92-8a94-89b9dbc5bfb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37bd84cc34c046a2ad58fd613c9cbc0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:27:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:27:59Z,use_quota=True,user_id='a81f9614803347f1b168a0a5b9c8cc61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:27:59 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-21a3e208-4a0c-4df0-ac1e-85f95c62ec18 tempest-AttachVolumeTestJSON-1478692577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ea824cf-868f-437a-a8c1-80a20279db0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:27:59 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-21a3e208-4a0c-4df0-ac1e-85f95c62ec18 tempest-AttachVolumeTestJSON-1478692577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ea824cf-868f-437a-a8c1-80a20279db0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:27:59 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-21a3e208-4a0c-4df0-ac1e-85f95c62ec18 tempest-AttachVolumeTestJSON-1478692577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d0c99da-0c97-4134-b6d5-1077351a0ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:27:59 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-21a3e208-4a0c-4df0-ac1e-85f95c62ec18 tempest-AttachVolumeTestJSON-1478692577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d0c99da-0c97-4134-b6d5-1077351a0ef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4bfca9f5-21c7-4d92-8a94-89b9dbc5bfb5', 'volume_name': 'volume-4bfca9f5-21c7-4d92-8a94-89b9dbc5bfb5', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:27:59 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-21a3e208-4a0c-4df0-ac1e-85f95c62ec18 tempest-AttachVolumeTestJSON-1478692577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4761dc9-fa33-4397-b01e-5b15547d2982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:27:59 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-21a3e208-4a0c-4df0-ac1e-85f95c62ec18 tempest-AttachVolumeTestJSON-1478692577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4761dc9-fa33-4397-b01e-5b15547d2982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:27:59 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-21a3e208-4a0c-4df0-ac1e-85f95c62ec18 tempest-AttachVolumeTestJSON-1478692577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8485095e-2f08-4653-9b30-52230970dae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:27:59 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-21a3e208-4a0c-4df0-ac1e-85f95c62ec18 tempest-AttachVolumeTestJSON-1478692577 None] Volume 4bfca9f5-21c7-4d92-8a94-89b9dbc5bfb5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4bfca9f5-21c7-4d92-8a94-89b9dbc5bfb5', 'volume_size': 1}
Jul 30 20:27:59 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-21a3e208-4a0c-4df0-ac1e-85f95c62ec18 tempest-AttachVolumeTestJSON-1478692577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:27:59 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-21a3e208-4a0c-4df0-ac1e-85f95c62ec18 tempest-AttachVolumeTestJSON-1478692577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:27:59 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-21a3e208-4a0c-4df0-ac1e-85f95c62ec18 tempest-AttachVolumeTestJSON-1478692577 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:27:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2076453253',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bfca9f5-21c7-4d92-8a94-89b9dbc5bfb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37bd84cc34c046a2ad58fd613c9cbc0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:27:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:27:59Z,use_quota=True,user_id='a81f9614803347f1b168a0a5b9c8cc61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:27:59 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-21a3e208-4a0c-4df0-ac1e-85f95c62ec18 tempest-AttachVolumeTestJSON-1478692577 None] Creating volume 4bfca9f5-21c7-4d92-8a94-89b9dbc5bfb5 {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:27:59 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-21a3e208-4a0c-4df0-ac1e-85f95c62ec18 tempest-AttachVolumeTestJSON-1478692577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:27:59 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-21a3e208-4a0c-4df0-ac1e-85f95c62ec18 tempest-AttachVolumeTestJSON-1478692577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:27:59 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-21a3e208-4a0c-4df0-ac1e-85f95c62ec18 tempest-AttachVolumeTestJSON-1478692577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:27:59 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-21a3e208-4a0c-4df0-ac1e-85f95c62ec18 tempest-AttachVolumeTestJSON-1478692577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:27:59 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-21a3e208-4a0c-4df0-ac1e-85f95c62ec18 tempest-AttachVolumeTestJSON-1478692577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:27:59 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-21a3e208-4a0c-4df0-ac1e-85f95c62ec18 tempest-AttachVolumeTestJSON-1478692577 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:27:59 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-21a3e208-4a0c-4df0-ac1e-85f95c62ec18 tempest-AttachVolumeTestJSON-1478692577 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:27:59 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-21a3e208-4a0c-4df0-ac1e-85f95c62ec18 tempest-AttachVolumeTestJSON-1478692577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-4bfca9f5-21c7-4d92-8a94-89b9dbc5bfb5 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:27:59 devstack sudo[96439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-4bfca9f5-21c7-4d92-8a94-89b9dbc5bfb5 1073741824
Jul 30 20:27:59 devstack sudo[96439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:27:59 devstack cinder-volume[88719]: INFO cinder.volume.manager [req-b64afd6d-6cab-460a-97ae-4238b36b0ad8 req-a724fe65-8b6f-4949-b8ae-60a7c781f2b3 tempest-AttachVolumeNegativeTest-1614371178 None] Terminate volume connection completed successfully.
Jul 30 20:27:59 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [req-b64afd6d-6cab-460a-97ae-4238b36b0ad8 req-a724fe65-8b6f-4949-b8ae-60a7c781f2b3 tempest-AttachVolumeNegativeTest-1614371178 None] Deleting attachment 738d4b34-34f9-4cfa-a496-ae404f523b54. {{(pid=88719) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 30 20:27:59 devstack sudo[96439]: pam_unix(sudo:session): session closed for user root
Jul 30 20:27:59 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-21a3e208-4a0c-4df0-ac1e-85f95c62ec18 tempest-AttachVolumeTestJSON-1478692577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-4bfca9f5-21c7-4d92-8a94-89b9dbc5bfb5 1073741824" returned: 0 in 0.654s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:28:00 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-21a3e208-4a0c-4df0-ac1e-85f95c62ec18 tempest-AttachVolumeTestJSON-1478692577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-4bfca9f5-21c7-4d92-8a94-89b9dbc5bfb5 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:28:00 devstack sudo[96473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-4bfca9f5-21c7-4d92-8a94-89b9dbc5bfb5
Jul 30 20:28:00 devstack sudo[96473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:28:00 devstack sudo[96473]: pam_unix(sudo:session): session closed for user root
Jul 30 20:28:00 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-21a3e208-4a0c-4df0-ac1e-85f95c62ec18 tempest-AttachVolumeTestJSON-1478692577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-4bfca9f5-21c7-4d92-8a94-89b9dbc5bfb5" returned: 0 in 0.345s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:28:00 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-21a3e208-4a0c-4df0-ac1e-85f95c62ec18 tempest-AttachVolumeTestJSON-1478692577 None] <== create_volume: return (1065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:28:00 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-21a3e208-4a0c-4df0-ac1e-85f95c62ec18 tempest-AttachVolumeTestJSON-1478692577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.068s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:28:00 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-21a3e208-4a0c-4df0-ac1e-85f95c62ec18 tempest-AttachVolumeTestJSON-1478692577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8485095e-2f08-4653-9b30-52230970dae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4bfca9f5-21c7-4d92-8a94-89b9dbc5bfb5', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:28:00 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-21a3e208-4a0c-4df0-ac1e-85f95c62ec18 tempest-AttachVolumeTestJSON-1478692577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2f95139-d51a-4cbb-bd2c-351f3447e3ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:28:00 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-21a3e208-4a0c-4df0-ac1e-85f95c62ec18 tempest-AttachVolumeTestJSON-1478692577 None] Volume volume-4bfca9f5-21c7-4d92-8a94-89b9dbc5bfb5 (4bfca9f5-21c7-4d92-8a94-89b9dbc5bfb5): created successfully
Jul 30 20:28:00 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-21a3e208-4a0c-4df0-ac1e-85f95c62ec18 tempest-AttachVolumeTestJSON-1478692577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2f95139-d51a-4cbb-bd2c-351f3447e3ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:28:00 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-21a3e208-4a0c-4df0-ac1e-85f95c62ec18 tempest-AttachVolumeTestJSON-1478692577 None] Flow 'volume_create_manager' (c4c63785-2da9-4b8d-a387-f558d9aa3aaf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:28:00 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-21a3e208-4a0c-4df0-ac1e-85f95c62ec18 tempest-AttachVolumeTestJSON-1478692577 None] Created volume successfully.
Jul 30 20:28:02 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [req-840cc0e1-35ee-4024-ba0f-bfe158096b12 req-ec7d23a0-3267-4804-8dce-6f864ab50150 tempest-AttachVolumeTestJSON-1478692577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:28:02 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [req-840cc0e1-35ee-4024-ba0f-bfe158096b12 req-ec7d23a0-3267-4804-8dce-6f864ab50150 tempest-AttachVolumeTestJSON-1478692577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:28:02 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [req-840cc0e1-35ee-4024-ba0f-bfe158096b12 req-ec7d23a0-3267-4804-8dce-6f864ab50150 tempest-AttachVolumeTestJSON-1478692577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.043s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:28:02 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [req-840cc0e1-35ee-4024-ba0f-bfe158096b12 req-ec7d23a0-3267-4804-8dce-6f864ab50150 tempest-AttachVolumeTestJSON-1478692577 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5', 'name': 'volume-4bfca9f5-21c7-4d92-8a94-89b9dbc5bfb5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '23a278bd-9b4d-4cd1-bcb8-194c63236943', 'enforce_multipath': True} {{(pid=88719) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 30 20:28:02 devstack cinder-volume[88719]: INFO cinder.volume.manager [req-840cc0e1-35ee-4024-ba0f-bfe158096b12 req-ec7d23a0-3267-4804-8dce-6f864ab50150 tempest-AttachVolumeTestJSON-1478692577 None] attachment_update completed successfully.
Jul 30 20:28:05 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2c89cda-97ae-49ad-a2cb-5b76b579991d tempest-AttachVolumeTestJSON-1478692577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:28:05 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-f2c89cda-97ae-49ad-a2cb-5b76b579991d tempest-AttachVolumeTestJSON-1478692577 None] Flow 'volume_create_manager' (ffe49991-670f-43b1-818d-f2085f29907c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:28:05 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-f2c89cda-97ae-49ad-a2cb-5b76b579991d tempest-AttachVolumeTestJSON-1478692577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8448eae2-0290-479c-a63d-b807bac096db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:28:05 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-f2c89cda-97ae-49ad-a2cb-5b76b579991d tempest-AttachVolumeTestJSON-1478692577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8448eae2-0290-479c-a63d-b807bac096db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:28:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2014255600',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cd24d0d-6370-4d18-a2b6-7019d835f6c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37bd84cc34c046a2ad58fd613c9cbc0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:28:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:28:06Z,use_quota=True,user_id='a81f9614803347f1b168a0a5b9c8cc61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:28:05 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-f2c89cda-97ae-49ad-a2cb-5b76b579991d tempest-AttachVolumeTestJSON-1478692577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdf9b2bd-276b-4321-9585-9a3e8ec1f562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:28:05 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-f2c89cda-97ae-49ad-a2cb-5b76b579991d tempest-AttachVolumeTestJSON-1478692577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdf9b2bd-276b-4321-9585-9a3e8ec1f562) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:28:05 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-f2c89cda-97ae-49ad-a2cb-5b76b579991d tempest-AttachVolumeTestJSON-1478692577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (872ada76-0820-4233-b66e-4bffdd5c4e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:28:05 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-f2c89cda-97ae-49ad-a2cb-5b76b579991d tempest-AttachVolumeTestJSON-1478692577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (872ada76-0820-4233-b66e-4bffdd5c4e70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1cd24d0d-6370-4d18-a2b6-7019d835f6c9', 'volume_name': 'volume-1cd24d0d-6370-4d18-a2b6-7019d835f6c9', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:28:05 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-f2c89cda-97ae-49ad-a2cb-5b76b579991d tempest-AttachVolumeTestJSON-1478692577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0528136-da67-4840-a4b4-1f2ac47a188c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:28:05 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-f2c89cda-97ae-49ad-a2cb-5b76b579991d tempest-AttachVolumeTestJSON-1478692577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0528136-da67-4840-a4b4-1f2ac47a188c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:28:05 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-f2c89cda-97ae-49ad-a2cb-5b76b579991d tempest-AttachVolumeTestJSON-1478692577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b4192c4-17df-463e-b6e8-9b670afef12b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:28:05 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-f2c89cda-97ae-49ad-a2cb-5b76b579991d tempest-AttachVolumeTestJSON-1478692577 None] Volume 1cd24d0d-6370-4d18-a2b6-7019d835f6c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1cd24d0d-6370-4d18-a2b6-7019d835f6c9', 'volume_size': 1}
Jul 30 20:28:05 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-f2c89cda-97ae-49ad-a2cb-5b76b579991d tempest-AttachVolumeTestJSON-1478692577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:28:05 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-f2c89cda-97ae-49ad-a2cb-5b76b579991d tempest-AttachVolumeTestJSON-1478692577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:28:05 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-f2c89cda-97ae-49ad-a2cb-5b76b579991d tempest-AttachVolumeTestJSON-1478692577 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:28:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2014255600',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cd24d0d-6370-4d18-a2b6-7019d835f6c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37bd84cc34c046a2ad58fd613c9cbc0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:28:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:28:06Z,use_quota=True,user_id='a81f9614803347f1b168a0a5b9c8cc61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:28:05 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-f2c89cda-97ae-49ad-a2cb-5b76b579991d tempest-AttachVolumeTestJSON-1478692577 None] Creating volume 1cd24d0d-6370-4d18-a2b6-7019d835f6c9 {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:28:05 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-f2c89cda-97ae-49ad-a2cb-5b76b579991d tempest-AttachVolumeTestJSON-1478692577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:28:05 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-f2c89cda-97ae-49ad-a2cb-5b76b579991d tempest-AttachVolumeTestJSON-1478692577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:28:05 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-f2c89cda-97ae-49ad-a2cb-5b76b579991d tempest-AttachVolumeTestJSON-1478692577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:28:05 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-f2c89cda-97ae-49ad-a2cb-5b76b579991d tempest-AttachVolumeTestJSON-1478692577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:28:05 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-f2c89cda-97ae-49ad-a2cb-5b76b579991d tempest-AttachVolumeTestJSON-1478692577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:28:05 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-f2c89cda-97ae-49ad-a2cb-5b76b579991d tempest-AttachVolumeTestJSON-1478692577 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:28:05 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-f2c89cda-97ae-49ad-a2cb-5b76b579991d tempest-AttachVolumeTestJSON-1478692577 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:28:05 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f2c89cda-97ae-49ad-a2cb-5b76b579991d tempest-AttachVolumeTestJSON-1478692577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1cd24d0d-6370-4d18-a2b6-7019d835f6c9 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:28:06 devstack sudo[96908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1cd24d0d-6370-4d18-a2b6-7019d835f6c9 1073741824
Jul 30 20:28:06 devstack sudo[96908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:28:06 devstack sudo[96908]: pam_unix(sudo:session): session closed for user root
Jul 30 20:28:06 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f2c89cda-97ae-49ad-a2cb-5b76b579991d tempest-AttachVolumeTestJSON-1478692577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1cd24d0d-6370-4d18-a2b6-7019d835f6c9 1073741824" returned: 0 in 0.867s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:28:06 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f2c89cda-97ae-49ad-a2cb-5b76b579991d tempest-AttachVolumeTestJSON-1478692577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1cd24d0d-6370-4d18-a2b6-7019d835f6c9 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:28:06 devstack sudo[96914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1cd24d0d-6370-4d18-a2b6-7019d835f6c9
Jul 30 20:28:06 devstack sudo[96914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:28:07 devstack sudo[96914]: pam_unix(sudo:session): session closed for user root
Jul 30 20:28:07 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f2c89cda-97ae-49ad-a2cb-5b76b579991d tempest-AttachVolumeTestJSON-1478692577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1cd24d0d-6370-4d18-a2b6-7019d835f6c9" returned: 0 in 0.360s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:28:07 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-f2c89cda-97ae-49ad-a2cb-5b76b579991d tempest-AttachVolumeTestJSON-1478692577 None] <== create_volume: return (1306ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:28:07 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-f2c89cda-97ae-49ad-a2cb-5b76b579991d tempest-AttachVolumeTestJSON-1478692577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.308s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:28:07 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-f2c89cda-97ae-49ad-a2cb-5b76b579991d tempest-AttachVolumeTestJSON-1478692577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b4192c4-17df-463e-b6e8-9b670afef12b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1cd24d0d-6370-4d18-a2b6-7019d835f6c9', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:28:07 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-f2c89cda-97ae-49ad-a2cb-5b76b579991d tempest-AttachVolumeTestJSON-1478692577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (944cbed4-2a21-47f9-9fe3-008cc77f58d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:28:07 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-f2c89cda-97ae-49ad-a2cb-5b76b579991d tempest-AttachVolumeTestJSON-1478692577 None] Volume volume-1cd24d0d-6370-4d18-a2b6-7019d835f6c9 (1cd24d0d-6370-4d18-a2b6-7019d835f6c9): created successfully
Jul 30 20:28:07 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-f2c89cda-97ae-49ad-a2cb-5b76b579991d tempest-AttachVolumeTestJSON-1478692577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (944cbed4-2a21-47f9-9fe3-008cc77f58d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:28:07 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-f2c89cda-97ae-49ad-a2cb-5b76b579991d tempest-AttachVolumeTestJSON-1478692577 None] Flow 'volume_create_manager' (ffe49991-670f-43b1-818d-f2085f29907c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:28:07 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-f2c89cda-97ae-49ad-a2cb-5b76b579991d tempest-AttachVolumeTestJSON-1478692577 None] Created volume successfully.
Jul 30 20:28:08 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [req-369568ca-4fba-4491-92c6-e0f7b4f83d13 req-37c23e4d-d3b8-41f5-8a98-1361db249e3c tempest-AttachVolumeTestJSON-1478692577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:28:08 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [req-369568ca-4fba-4491-92c6-e0f7b4f83d13 req-37c23e4d-d3b8-41f5-8a98-1361db249e3c tempest-AttachVolumeTestJSON-1478692577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:28:08 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [req-369568ca-4fba-4491-92c6-e0f7b4f83d13 req-37c23e4d-d3b8-41f5-8a98-1361db249e3c tempest-AttachVolumeTestJSON-1478692577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:28:08 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [req-369568ca-4fba-4491-92c6-e0f7b4f83d13 req-37c23e4d-d3b8-41f5-8a98-1361db249e3c tempest-AttachVolumeTestJSON-1478692577 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5', 'name': 'volume-1cd24d0d-6370-4d18-a2b6-7019d835f6c9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b6a6ca0f-1d07-4f84-b847-5f45f6de60d0', 'enforce_multipath': True} {{(pid=88719) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 30 20:28:08 devstack cinder-volume[88719]: INFO cinder.volume.manager [req-369568ca-4fba-4491-92c6-e0f7b4f83d13 req-37c23e4d-d3b8-41f5-8a98-1361db249e3c tempest-AttachVolumeTestJSON-1478692577 None] attachment_update completed successfully.
Jul 30 20:28:12 devstack cinder-volume[88719]: INFO cinder.volume.manager [req-b0c9a860-e6c6-4384-83d2-f46785c67260 req-b4b78d40-8c2e-4c51-a38c-88ebc4b99874 tempest-AttachVolumeTestJSON-1478692577 None] Terminate volume connection completed successfully.
Jul 30 20:28:12 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [req-b0c9a860-e6c6-4384-83d2-f46785c67260 req-b4b78d40-8c2e-4c51-a38c-88ebc4b99874 tempest-AttachVolumeTestJSON-1478692577 None] Deleting attachment 23a278bd-9b4d-4cd1-bcb8-194c63236943. {{(pid=88719) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 30 20:28:13 devstack cinder-volume[88719]: INFO cinder.volume.manager [req-21a9326b-0f62-4490-b374-58f970dbd5a8 req-e0ec9803-eaee-45bc-9cec-ee985c75609a tempest-AttachVolumeTestJSON-1478692577 None] Terminate volume connection completed successfully.
Jul 30 20:28:13 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [req-21a9326b-0f62-4490-b374-58f970dbd5a8 req-e0ec9803-eaee-45bc-9cec-ee985c75609a tempest-AttachVolumeTestJSON-1478692577 None] Deleting attachment b6a6ca0f-1d07-4f84-b847-5f45f6de60d0. {{(pid=88719) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 30 20:28:16 devstack cinder-volume[88719]: DEBUG oslo_service.periodic_task [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88719) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 30 20:28:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:28:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:28:16 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:28:16 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:28:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:28:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:28:16 devstack sudo[97100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:28:16 devstack sudo[97100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:28:16 devstack sudo[97100]: pam_unix(sudo:session): session closed for user root
Jul 30 20:28:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.428s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:28:16 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:28:16 devstack cinder-volume[88719]: DEBUG oslo_service.periodic_task [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Running periodic task VolumeManager._thread_info {{(pid=88719) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 30 20:28:16 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] thread count: 8 {{(pid=88719) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 30 20:28:16 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] thread info: [<_MainThread(MainThread, started 132390416908416)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132390306497536)>, <Thread(Thread-3 (stat_writer), started daemon 132390304471680)>, <Thread(Rabbit-heartbeat, started daemon 132390303393408)>, <Thread(Thread-5 (_runner), started daemon 132390303543168)>, <Thread(Thread-7 (_runner), started daemon 132390303563392)>, <Thread(fd_logger, started daemon 132390301344640)>, <Thread(privsep_reader, started daemon 132390301560640)>] {{(pid=88719) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 30 20:28:22 devstack cinder-volume[88719]: DEBUG dbcounter [-] [88719] Writing DB stats cinder:SELECT=33,cinder:INSERT=7,cinder:UPDATE=20,cinder:DELETE=5 {{(pid=88719) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 30 20:28:22 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-a9aaabfb-be64-49e4-baee-62d4db82e6ac tempest-AttachVolumeTestJSON-1478692577 None] Acquiring lock "cinder-1cd24d0d-6370-4d18-a2b6-7019d835f6c9-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:28:22 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-a9aaabfb-be64-49e4-baee-62d4db82e6ac tempest-AttachVolumeTestJSON-1478692577 None] Lock "cinder-1cd24d0d-6370-4d18-a2b6-7019d835f6c9-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:28:23 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-a9aaabfb-be64-49e4-baee-62d4db82e6ac tempest-AttachVolumeTestJSON-1478692577 None] Acquiring lock "cinder-quobyte-1cd24d0d-6370-4d18-a2b6-7019d835f6c9" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:28:23 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-a9aaabfb-be64-49e4-baee-62d4db82e6ac tempest-AttachVolumeTestJSON-1478692577 None] Lock "cinder-quobyte-1cd24d0d-6370-4d18-a2b6-7019d835f6c9" acquired by "delete_volume" :: waited 0.017s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:28:23 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[556698fd-25e8-4aad-aa72-64aa0d7ce187]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:28:23 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-a9aaabfb-be64-49e4-baee-62d4db82e6ac tempest-AttachVolumeTestJSON-1478692577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1cd24d0d-6370-4d18-a2b6-7019d835f6c9 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:28:23 devstack sudo[97138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1cd24d0d-6370-4d18-a2b6-7019d835f6c9
Jul 30 20:28:23 devstack sudo[97138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:28:23 devstack sudo[97138]: pam_unix(sudo:session): session closed for user root
Jul 30 20:28:23 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-a9aaabfb-be64-49e4-baee-62d4db82e6ac tempest-AttachVolumeTestJSON-1478692577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1cd24d0d-6370-4d18-a2b6-7019d835f6c9" returned: 0 in 0.523s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:28:23 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-a9aaabfb-be64-49e4-baee-62d4db82e6ac tempest-AttachVolumeTestJSON-1478692577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1cd24d0d-6370-4d18-a2b6-7019d835f6c9 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:28:23 devstack sudo[97143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1cd24d0d-6370-4d18-a2b6-7019d835f6c9
Jul 30 20:28:23 devstack sudo[97143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:28:24 devstack sudo[97143]: pam_unix(sudo:session): session closed for user root
Jul 30 20:28:24 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-a9aaabfb-be64-49e4-baee-62d4db82e6ac tempest-AttachVolumeTestJSON-1478692577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1cd24d0d-6370-4d18-a2b6-7019d835f6c9" returned: 0 in 0.442s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:28:24 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-a9aaabfb-be64-49e4-baee-62d4db82e6ac tempest-AttachVolumeTestJSON-1478692577 None] Lock "cinder-quobyte-1cd24d0d-6370-4d18-a2b6-7019d835f6c9" released by "delete_volume" :: held 1.049s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:28:24 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-a9aaabfb-be64-49e4-baee-62d4db82e6ac tempest-AttachVolumeTestJSON-1478692577 None] Created reservations ['e18f6ed0-a586-4061-b75e-efa0ac6c56cd', 'd0aff0cd-4349-45ae-9c19-bf56a5f16009', 'be9fe230-c5cc-4b60-8a49-3981ca202f15', '474e087f-dc50-4c3e-9577-82afe549755c'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:28:24 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-a9aaabfb-be64-49e4-baee-62d4db82e6ac tempest-AttachVolumeTestJSON-1478692577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:28:24 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-a9aaabfb-be64-49e4-baee-62d4db82e6ac tempest-AttachVolumeTestJSON-1478692577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:28:24 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-a9aaabfb-be64-49e4-baee-62d4db82e6ac tempest-AttachVolumeTestJSON-1478692577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:28:24 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-a9aaabfb-be64-49e4-baee-62d4db82e6ac tempest-AttachVolumeTestJSON-1478692577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:28:24 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-a9aaabfb-be64-49e4-baee-62d4db82e6ac tempest-AttachVolumeTestJSON-1478692577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:28:24 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-a9aaabfb-be64-49e4-baee-62d4db82e6ac tempest-AttachVolumeTestJSON-1478692577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:28:24 devstack sudo[97147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:28:24 devstack sudo[97147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:28:24 devstack sudo[97147]: pam_unix(sudo:session): session closed for user root
Jul 30 20:28:24 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-a9aaabfb-be64-49e4-baee-62d4db82e6ac tempest-AttachVolumeTestJSON-1478692577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.432s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:28:24 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-a9aaabfb-be64-49e4-baee-62d4db82e6ac tempest-AttachVolumeTestJSON-1478692577 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:28:24 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-a9aaabfb-be64-49e4-baee-62d4db82e6ac tempest-AttachVolumeTestJSON-1478692577 None] Deleted volume successfully.
Jul 30 20:28:24 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-a9aaabfb-be64-49e4-baee-62d4db82e6ac tempest-AttachVolumeTestJSON-1478692577 None] Lock "cinder-1cd24d0d-6370-4d18-a2b6-7019d835f6c9-delete_volume" released by "delete_volume" :: held 1.789s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:28:25 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-b38c48a4-defa-4c54-a5d7-f387b252e87f tempest-AttachVolumeTestJSON-1478692577 None] Acquiring lock "cinder-4bfca9f5-21c7-4d92-8a94-89b9dbc5bfb5-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:28:25 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-b38c48a4-defa-4c54-a5d7-f387b252e87f tempest-AttachVolumeTestJSON-1478692577 None] Lock "cinder-4bfca9f5-21c7-4d92-8a94-89b9dbc5bfb5-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:28:25 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-b38c48a4-defa-4c54-a5d7-f387b252e87f tempest-AttachVolumeTestJSON-1478692577 None] Acquiring lock "cinder-quobyte-4bfca9f5-21c7-4d92-8a94-89b9dbc5bfb5" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:28:25 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-b38c48a4-defa-4c54-a5d7-f387b252e87f tempest-AttachVolumeTestJSON-1478692577 None] Lock "cinder-quobyte-4bfca9f5-21c7-4d92-8a94-89b9dbc5bfb5" acquired by "delete_volume" :: waited 0.031s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:28:25 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[995c5eb7-6ba5-46f9-8415-824e0bd341bc]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:28:25 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-b38c48a4-defa-4c54-a5d7-f387b252e87f tempest-AttachVolumeTestJSON-1478692577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-4bfca9f5-21c7-4d92-8a94-89b9dbc5bfb5 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:28:25 devstack sudo[97151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-4bfca9f5-21c7-4d92-8a94-89b9dbc5bfb5
Jul 30 20:28:25 devstack sudo[97151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:28:25 devstack sudo[97151]: pam_unix(sudo:session): session closed for user root
Jul 30 20:28:25 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-b38c48a4-defa-4c54-a5d7-f387b252e87f tempest-AttachVolumeTestJSON-1478692577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-4bfca9f5-21c7-4d92-8a94-89b9dbc5bfb5" returned: 0 in 0.515s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:28:25 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-b38c48a4-defa-4c54-a5d7-f387b252e87f tempest-AttachVolumeTestJSON-1478692577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-4bfca9f5-21c7-4d92-8a94-89b9dbc5bfb5 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:28:26 devstack sudo[97156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-4bfca9f5-21c7-4d92-8a94-89b9dbc5bfb5
Jul 30 20:28:26 devstack sudo[97156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:28:26 devstack sudo[97156]: pam_unix(sudo:session): session closed for user root
Jul 30 20:28:26 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-b38c48a4-defa-4c54-a5d7-f387b252e87f tempest-AttachVolumeTestJSON-1478692577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-4bfca9f5-21c7-4d92-8a94-89b9dbc5bfb5" returned: 0 in 0.507s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:28:26 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-b38c48a4-defa-4c54-a5d7-f387b252e87f tempest-AttachVolumeTestJSON-1478692577 None] Lock "cinder-quobyte-4bfca9f5-21c7-4d92-8a94-89b9dbc5bfb5" released by "delete_volume" :: held 1.083s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:28:26 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-b38c48a4-defa-4c54-a5d7-f387b252e87f tempest-AttachVolumeTestJSON-1478692577 None] Created reservations ['5a7dbb24-8e0e-4c18-bded-790764a3b514', '5a5702ca-b1e9-4c89-8e9e-3de7993aa216', '94148f40-d5d4-412b-800a-699e02bf1489', '953d6b67-171f-429a-bc54-900ede3d0ce7'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:28:26 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-25499f73-56f0-4275-b0e3-f07060cc8c50 tempest-AttachVolumeShelveTestJSON-1438165976 None] Acquiring lock "cinder-3388843d-4847-4c36-b476-eaa743b9350f-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:28:26 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-25499f73-56f0-4275-b0e3-f07060cc8c50 tempest-AttachVolumeShelveTestJSON-1438165976 None] Lock "cinder-3388843d-4847-4c36-b476-eaa743b9350f-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:28:26 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-b38c48a4-defa-4c54-a5d7-f387b252e87f tempest-AttachVolumeTestJSON-1478692577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:28:26 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-b38c48a4-defa-4c54-a5d7-f387b252e87f tempest-AttachVolumeTestJSON-1478692577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:28:26 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-b38c48a4-defa-4c54-a5d7-f387b252e87f tempest-AttachVolumeTestJSON-1478692577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:28:26 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-b38c48a4-defa-4c54-a5d7-f387b252e87f tempest-AttachVolumeTestJSON-1478692577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:28:26 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-b38c48a4-defa-4c54-a5d7-f387b252e87f tempest-AttachVolumeTestJSON-1478692577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:28:26 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-b38c48a4-defa-4c54-a5d7-f387b252e87f tempest-AttachVolumeTestJSON-1478692577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:28:26 devstack sudo[97159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:28:26 devstack sudo[97159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:28:26 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-25499f73-56f0-4275-b0e3-f07060cc8c50 tempest-AttachVolumeShelveTestJSON-1438165976 None] Acquiring lock "cinder-quobyte-3388843d-4847-4c36-b476-eaa743b9350f" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:28:26 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-25499f73-56f0-4275-b0e3-f07060cc8c50 tempest-AttachVolumeShelveTestJSON-1438165976 None] Lock "cinder-quobyte-3388843d-4847-4c36-b476-eaa743b9350f" acquired by "delete_volume" :: waited 0.033s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:28:26 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[39d1c0ce-d0a7-4051-b474-64bb0e8fd9d9]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:28:27 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-25499f73-56f0-4275-b0e3-f07060cc8c50 tempest-AttachVolumeShelveTestJSON-1438165976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3388843d-4847-4c36-b476-eaa743b9350f {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:28:27 devstack sudo[97161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3388843d-4847-4c36-b476-eaa743b9350f
Jul 30 20:28:27 devstack sudo[97161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:28:27 devstack sudo[97159]: pam_unix(sudo:session): session closed for user root
Jul 30 20:28:27 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-b38c48a4-defa-4c54-a5d7-f387b252e87f tempest-AttachVolumeTestJSON-1478692577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.371s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:28:27 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-b38c48a4-defa-4c54-a5d7-f387b252e87f tempest-AttachVolumeTestJSON-1478692577 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:28:27 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-b38c48a4-defa-4c54-a5d7-f387b252e87f tempest-AttachVolumeTestJSON-1478692577 None] Deleted volume successfully.
Jul 30 20:28:27 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-b38c48a4-defa-4c54-a5d7-f387b252e87f tempest-AttachVolumeTestJSON-1478692577 None] Lock "cinder-4bfca9f5-21c7-4d92-8a94-89b9dbc5bfb5-delete_volume" released by "delete_volume" :: held 1.958s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:28:27 devstack sudo[97161]: pam_unix(sudo:session): session closed for user root
Jul 30 20:28:27 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-25499f73-56f0-4275-b0e3-f07060cc8c50 tempest-AttachVolumeShelveTestJSON-1438165976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3388843d-4847-4c36-b476-eaa743b9350f" returned: 0 in 0.663s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:28:27 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-25499f73-56f0-4275-b0e3-f07060cc8c50 tempest-AttachVolumeShelveTestJSON-1438165976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3388843d-4847-4c36-b476-eaa743b9350f {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:28:27 devstack sudo[97168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3388843d-4847-4c36-b476-eaa743b9350f
Jul 30 20:28:27 devstack sudo[97168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:28:28 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-4a9b68e1-f620-4aea-b015-5d029d9de818 tempest-AttachVolumeTestJSON-1478692577 None] Acquiring lock "cinder-5acd4330-bcb0-4b07-96cd-e73f620b65c5-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:28:28 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-4a9b68e1-f620-4aea-b015-5d029d9de818 tempest-AttachVolumeTestJSON-1478692577 None] Lock "cinder-5acd4330-bcb0-4b07-96cd-e73f620b65c5-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:28:28 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-4a9b68e1-f620-4aea-b015-5d029d9de818 tempest-AttachVolumeTestJSON-1478692577 None] Acquiring lock "cinder-quobyte-5acd4330-bcb0-4b07-96cd-e73f620b65c5" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:28:28 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-4a9b68e1-f620-4aea-b015-5d029d9de818 tempest-AttachVolumeTestJSON-1478692577 None] Lock "cinder-quobyte-5acd4330-bcb0-4b07-96cd-e73f620b65c5" acquired by "delete_volume" :: waited 0.030s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:28:28 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[38eb36f0-a9fc-4bdf-988b-f810fe0c297a]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:28:28 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-4a9b68e1-f620-4aea-b015-5d029d9de818 tempest-AttachVolumeTestJSON-1478692577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5acd4330-bcb0-4b07-96cd-e73f620b65c5 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:28:28 devstack sudo[97168]: pam_unix(sudo:session): session closed for user root
Jul 30 20:28:28 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-25499f73-56f0-4275-b0e3-f07060cc8c50 tempest-AttachVolumeShelveTestJSON-1438165976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3388843d-4847-4c36-b476-eaa743b9350f" returned: 0 in 0.583s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:28:28 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-25499f73-56f0-4275-b0e3-f07060cc8c50 tempest-AttachVolumeShelveTestJSON-1438165976 None] Lock "cinder-quobyte-3388843d-4847-4c36-b476-eaa743b9350f" released by "delete_volume" :: held 1.349s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:28:28 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-25499f73-56f0-4275-b0e3-f07060cc8c50 tempest-AttachVolumeShelveTestJSON-1438165976 None] Created reservations ['1d369101-e248-45dd-bdb5-75f9c3e0cb4b', 'cca2260c-1811-4dd1-a4e9-f039be530eef', '692c0c65-3707-4175-97a8-9ca132066376', '15d7b3b5-9393-41c7-8ec8-ff87bd3bf52a'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:28:28 devstack sudo[97171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5acd4330-bcb0-4b07-96cd-e73f620b65c5
Jul 30 20:28:28 devstack sudo[97171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:28:28 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-25499f73-56f0-4275-b0e3-f07060cc8c50 tempest-AttachVolumeShelveTestJSON-1438165976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:28:28 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-25499f73-56f0-4275-b0e3-f07060cc8c50 tempest-AttachVolumeShelveTestJSON-1438165976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:28:28 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-25499f73-56f0-4275-b0e3-f07060cc8c50 tempest-AttachVolumeShelveTestJSON-1438165976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:28:28 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-25499f73-56f0-4275-b0e3-f07060cc8c50 tempest-AttachVolumeShelveTestJSON-1438165976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:28:28 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-25499f73-56f0-4275-b0e3-f07060cc8c50 tempest-AttachVolumeShelveTestJSON-1438165976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:28:28 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-25499f73-56f0-4275-b0e3-f07060cc8c50 tempest-AttachVolumeShelveTestJSON-1438165976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:28:28 devstack sudo[97173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:28:28 devstack sudo[97173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:28:29 devstack sudo[97171]: pam_unix(sudo:session): session closed for user root
Jul 30 20:28:29 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-4a9b68e1-f620-4aea-b015-5d029d9de818 tempest-AttachVolumeTestJSON-1478692577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5acd4330-bcb0-4b07-96cd-e73f620b65c5" returned: 0 in 0.854s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:28:29 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-4a9b68e1-f620-4aea-b015-5d029d9de818 tempest-AttachVolumeTestJSON-1478692577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5acd4330-bcb0-4b07-96cd-e73f620b65c5 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:28:29 devstack sudo[97173]: pam_unix(sudo:session): session closed for user root
Jul 30 20:28:29 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-25499f73-56f0-4275-b0e3-f07060cc8c50 tempest-AttachVolumeShelveTestJSON-1438165976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.607s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:28:29 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-25499f73-56f0-4275-b0e3-f07060cc8c50 tempest-AttachVolumeShelveTestJSON-1438165976 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:28:29 devstack sudo[97179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5acd4330-bcb0-4b07-96cd-e73f620b65c5
Jul 30 20:28:29 devstack sudo[97179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:28:29 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-25499f73-56f0-4275-b0e3-f07060cc8c50 tempest-AttachVolumeShelveTestJSON-1438165976 None] Deleted volume successfully.
Jul 30 20:28:29 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-25499f73-56f0-4275-b0e3-f07060cc8c50 tempest-AttachVolumeShelveTestJSON-1438165976 None] Lock "cinder-3388843d-4847-4c36-b476-eaa743b9350f-delete_volume" released by "delete_volume" :: held 2.387s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:28:29 devstack sudo[97179]: pam_unix(sudo:session): session closed for user root
Jul 30 20:28:29 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-4a9b68e1-f620-4aea-b015-5d029d9de818 tempest-AttachVolumeTestJSON-1478692577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5acd4330-bcb0-4b07-96cd-e73f620b65c5" returned: 0 in 0.416s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:28:29 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-4a9b68e1-f620-4aea-b015-5d029d9de818 tempest-AttachVolumeTestJSON-1478692577 None] Lock "cinder-quobyte-5acd4330-bcb0-4b07-96cd-e73f620b65c5" released by "delete_volume" :: held 1.327s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:28:29 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-4a9b68e1-f620-4aea-b015-5d029d9de818 tempest-AttachVolumeTestJSON-1478692577 None] Created reservations ['5bc7ca2b-6145-4e74-ad80-8c8273a919b3', 'daaac7ed-bd9d-4334-9f4f-d9b976d807bb', '04c419ab-8ba5-4a35-b7d4-375afc3d87eb', '999618f1-175c-48eb-a780-66f7c285b095'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:28:29 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-4a9b68e1-f620-4aea-b015-5d029d9de818 tempest-AttachVolumeTestJSON-1478692577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:28:29 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-4a9b68e1-f620-4aea-b015-5d029d9de818 tempest-AttachVolumeTestJSON-1478692577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:28:29 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-4a9b68e1-f620-4aea-b015-5d029d9de818 tempest-AttachVolumeTestJSON-1478692577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:28:29 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-4a9b68e1-f620-4aea-b015-5d029d9de818 tempest-AttachVolumeTestJSON-1478692577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:28:29 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-4a9b68e1-f620-4aea-b015-5d029d9de818 tempest-AttachVolumeTestJSON-1478692577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:28:29 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-4a9b68e1-f620-4aea-b015-5d029d9de818 tempest-AttachVolumeTestJSON-1478692577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:28:29 devstack sudo[97182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:28:29 devstack sudo[97182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:28:29 devstack sudo[97182]: pam_unix(sudo:session): session closed for user root
Jul 30 20:28:29 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-4a9b68e1-f620-4aea-b015-5d029d9de818 tempest-AttachVolumeTestJSON-1478692577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.302s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:28:29 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-4a9b68e1-f620-4aea-b015-5d029d9de818 tempest-AttachVolumeTestJSON-1478692577 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:28:29 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-4a9b68e1-f620-4aea-b015-5d029d9de818 tempest-AttachVolumeTestJSON-1478692577 None] Deleted volume successfully.
Jul 30 20:28:30 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-4a9b68e1-f620-4aea-b015-5d029d9de818 tempest-AttachVolumeTestJSON-1478692577 None] Lock "cinder-5acd4330-bcb0-4b07-96cd-e73f620b65c5-delete_volume" released by "delete_volume" :: held 1.946s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:28:39 devstack cinder-volume[88719]: DEBUG dbcounter [-] [88719] Writing DB stats cinder:UPDATE=64,cinder:SELECT=59,cinder:INSERT=11,cinder:DELETE=3 {{(pid=88719) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 30 20:28:39 devstack cinder-volume[88719]: DEBUG dbcounter [-] [88719] Writing DB stats cinder:SELECT=22,cinder:UPDATE=30,cinder:INSERT=6,cinder:DELETE=1 {{(pid=88719) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 30 20:28:45 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-36da81a5-8e72-4a36-aeef-83aa6899d09a tempest-VolumesActionsTest-135968371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:28:45 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-36da81a5-8e72-4a36-aeef-83aa6899d09a tempest-VolumesActionsTest-135968371 None] Flow 'volume_create_manager' (cc955eb6-5cc2-41e3-b3bd-c6ea4024b373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:28:45 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-36da81a5-8e72-4a36-aeef-83aa6899d09a tempest-VolumesActionsTest-135968371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df1d4fb7-cb38-431a-a024-6ad84e5d95de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:28:45 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-36da81a5-8e72-4a36-aeef-83aa6899d09a tempest-VolumesActionsTest-135968371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df1d4fb7-cb38-431a-a024-6ad84e5d95de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:28:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2141876699',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd820e96-669e-487a-bd5a-226dec8a43fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d5498700a384a6db5a774609f5b251a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:28:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:28:45Z,use_quota=True,user_id='785d5df48e1340b185bfa9fa0913e1a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:28:45 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-36da81a5-8e72-4a36-aeef-83aa6899d09a tempest-VolumesActionsTest-135968371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ac3a071-149e-4ae5-a6de-aca69c98edf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:28:45 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-36da81a5-8e72-4a36-aeef-83aa6899d09a tempest-VolumesActionsTest-135968371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ac3a071-149e-4ae5-a6de-aca69c98edf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:28:45 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-36da81a5-8e72-4a36-aeef-83aa6899d09a tempest-VolumesActionsTest-135968371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8c95a72-ca8d-4788-84fd-889653be3d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:28:45 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-36da81a5-8e72-4a36-aeef-83aa6899d09a tempest-VolumesActionsTest-135968371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8c95a72-ca8d-4788-84fd-889653be3d5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd820e96-669e-487a-bd5a-226dec8a43fa', 'volume_name': 'volume-dd820e96-669e-487a-bd5a-226dec8a43fa', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:28:45 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-36da81a5-8e72-4a36-aeef-83aa6899d09a tempest-VolumesActionsTest-135968371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54506653-d7b9-4313-b2b5-cca5d550cc81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:28:45 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-36da81a5-8e72-4a36-aeef-83aa6899d09a tempest-VolumesActionsTest-135968371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54506653-d7b9-4313-b2b5-cca5d550cc81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:28:45 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-36da81a5-8e72-4a36-aeef-83aa6899d09a tempest-VolumesActionsTest-135968371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33ff25ff-1b35-4fee-a094-4473cf5144c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:28:45 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-36da81a5-8e72-4a36-aeef-83aa6899d09a tempest-VolumesActionsTest-135968371 None] Volume dd820e96-669e-487a-bd5a-226dec8a43fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd820e96-669e-487a-bd5a-226dec8a43fa', 'volume_size': 1}
Jul 30 20:28:45 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-36da81a5-8e72-4a36-aeef-83aa6899d09a tempest-VolumesActionsTest-135968371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:28:45 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-36da81a5-8e72-4a36-aeef-83aa6899d09a tempest-VolumesActionsTest-135968371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:28:45 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-36da81a5-8e72-4a36-aeef-83aa6899d09a tempest-VolumesActionsTest-135968371 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:28:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2141876699',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd820e96-669e-487a-bd5a-226dec8a43fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d5498700a384a6db5a774609f5b251a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:28:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:28:45Z,use_quota=True,user_id='785d5df48e1340b185bfa9fa0913e1a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:28:45 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-36da81a5-8e72-4a36-aeef-83aa6899d09a tempest-VolumesActionsTest-135968371 None] Creating volume dd820e96-669e-487a-bd5a-226dec8a43fa {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:28:45 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-36da81a5-8e72-4a36-aeef-83aa6899d09a tempest-VolumesActionsTest-135968371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:28:45 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-36da81a5-8e72-4a36-aeef-83aa6899d09a tempest-VolumesActionsTest-135968371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:28:45 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-36da81a5-8e72-4a36-aeef-83aa6899d09a tempest-VolumesActionsTest-135968371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:28:45 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-36da81a5-8e72-4a36-aeef-83aa6899d09a tempest-VolumesActionsTest-135968371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:28:45 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-36da81a5-8e72-4a36-aeef-83aa6899d09a tempest-VolumesActionsTest-135968371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:28:45 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-36da81a5-8e72-4a36-aeef-83aa6899d09a tempest-VolumesActionsTest-135968371 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:28:45 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-36da81a5-8e72-4a36-aeef-83aa6899d09a tempest-VolumesActionsTest-135968371 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:28:45 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-36da81a5-8e72-4a36-aeef-83aa6899d09a tempest-VolumesActionsTest-135968371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-dd820e96-669e-487a-bd5a-226dec8a43fa 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:28:45 devstack sudo[97319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-dd820e96-669e-487a-bd5a-226dec8a43fa 1073741824
Jul 30 20:28:45 devstack sudo[97319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:28:45 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5e97542-c40e-45c2-bb32-1a12056b2a01 tempest-AttachVolumeNegativeTest-1614371178 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:28:45 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-f5e97542-c40e-45c2-bb32-1a12056b2a01 tempest-AttachVolumeNegativeTest-1614371178 None] Flow 'volume_create_manager' (8adf9bf9-bde1-4239-b857-f01904ea0505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:28:45 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-f5e97542-c40e-45c2-bb32-1a12056b2a01 tempest-AttachVolumeNegativeTest-1614371178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c6cd72c-ab16-474b-add1-d447700a97f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:28:45 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-f5e97542-c40e-45c2-bb32-1a12056b2a01 tempest-AttachVolumeNegativeTest-1614371178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c6cd72c-ab16-474b-add1-d447700a97f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:28:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-467822419',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48ab7920-5882-4929-b14c-5531b1ea8d27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94612bdf28ad4dcc8603985e17aaea85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:28:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:28:45Z,use_quota=True,user_id='b3458179c6164555a4b1c503e06fdef3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:28:45 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-f5e97542-c40e-45c2-bb32-1a12056b2a01 tempest-AttachVolumeNegativeTest-1614371178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b22baa57-1a88-4c5c-87dc-d6e5a0f1c675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:28:45 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-f5e97542-c40e-45c2-bb32-1a12056b2a01 tempest-AttachVolumeNegativeTest-1614371178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b22baa57-1a88-4c5c-87dc-d6e5a0f1c675) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:28:45 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-f5e97542-c40e-45c2-bb32-1a12056b2a01 tempest-AttachVolumeNegativeTest-1614371178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b283cdac-0bc9-435d-8baa-e3ae40e9c224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:28:45 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-f5e97542-c40e-45c2-bb32-1a12056b2a01 tempest-AttachVolumeNegativeTest-1614371178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b283cdac-0bc9-435d-8baa-e3ae40e9c224) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48ab7920-5882-4929-b14c-5531b1ea8d27', 'volume_name': 'volume-48ab7920-5882-4929-b14c-5531b1ea8d27', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:28:45 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-f5e97542-c40e-45c2-bb32-1a12056b2a01 tempest-AttachVolumeNegativeTest-1614371178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9849b59-3d98-4ad2-9adf-8c0b2c061790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:28:45 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-f5e97542-c40e-45c2-bb32-1a12056b2a01 tempest-AttachVolumeNegativeTest-1614371178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9849b59-3d98-4ad2-9adf-8c0b2c061790) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:28:45 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-f5e97542-c40e-45c2-bb32-1a12056b2a01 tempest-AttachVolumeNegativeTest-1614371178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad1257fa-06d8-4468-b53d-21d1d8990df1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:28:45 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-f5e97542-c40e-45c2-bb32-1a12056b2a01 tempest-AttachVolumeNegativeTest-1614371178 None] Volume 48ab7920-5882-4929-b14c-5531b1ea8d27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48ab7920-5882-4929-b14c-5531b1ea8d27', 'volume_size': 1}
Jul 30 20:28:45 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-f5e97542-c40e-45c2-bb32-1a12056b2a01 tempest-AttachVolumeNegativeTest-1614371178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:28:46 devstack sudo[97319]: pam_unix(sudo:session): session closed for user root
Jul 30 20:28:46 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-36da81a5-8e72-4a36-aeef-83aa6899d09a tempest-VolumesActionsTest-135968371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-dd820e96-669e-487a-bd5a-226dec8a43fa 1073741824" returned: 0 in 0.656s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:28:46 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-36da81a5-8e72-4a36-aeef-83aa6899d09a tempest-VolumesActionsTest-135968371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-dd820e96-669e-487a-bd5a-226dec8a43fa {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:28:46 devstack sudo[97325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-dd820e96-669e-487a-bd5a-226dec8a43fa
Jul 30 20:28:46 devstack sudo[97325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:28:46 devstack sudo[97325]: pam_unix(sudo:session): session closed for user root
Jul 30 20:28:46 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-36da81a5-8e72-4a36-aeef-83aa6899d09a tempest-VolumesActionsTest-135968371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-dd820e96-669e-487a-bd5a-226dec8a43fa" returned: 0 in 0.337s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:28:46 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-36da81a5-8e72-4a36-aeef-83aa6899d09a tempest-VolumesActionsTest-135968371 None] <== create_volume: return (1048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:28:46 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-36da81a5-8e72-4a36-aeef-83aa6899d09a tempest-VolumesActionsTest-135968371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.055s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:28:46 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-f5e97542-c40e-45c2-bb32-1a12056b2a01 tempest-AttachVolumeNegativeTest-1614371178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.823s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:28:46 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-f5e97542-c40e-45c2-bb32-1a12056b2a01 tempest-AttachVolumeNegativeTest-1614371178 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:28:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-467822419',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48ab7920-5882-4929-b14c-5531b1ea8d27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94612bdf28ad4dcc8603985e17aaea85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:28:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:28:45Z,use_quota=True,user_id='b3458179c6164555a4b1c503e06fdef3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:28:46 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-f5e97542-c40e-45c2-bb32-1a12056b2a01 tempest-AttachVolumeNegativeTest-1614371178 None] Creating volume 48ab7920-5882-4929-b14c-5531b1ea8d27 {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:28:46 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-f5e97542-c40e-45c2-bb32-1a12056b2a01 tempest-AttachVolumeNegativeTest-1614371178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:28:46 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-f5e97542-c40e-45c2-bb32-1a12056b2a01 tempest-AttachVolumeNegativeTest-1614371178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:28:46 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-f5e97542-c40e-45c2-bb32-1a12056b2a01 tempest-AttachVolumeNegativeTest-1614371178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:28:46 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-f5e97542-c40e-45c2-bb32-1a12056b2a01 tempest-AttachVolumeNegativeTest-1614371178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:28:46 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-f5e97542-c40e-45c2-bb32-1a12056b2a01 tempest-AttachVolumeNegativeTest-1614371178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:28:46 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-f5e97542-c40e-45c2-bb32-1a12056b2a01 tempest-AttachVolumeNegativeTest-1614371178 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:28:46 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-f5e97542-c40e-45c2-bb32-1a12056b2a01 tempest-AttachVolumeNegativeTest-1614371178 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:28:46 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f5e97542-c40e-45c2-bb32-1a12056b2a01 tempest-AttachVolumeNegativeTest-1614371178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-48ab7920-5882-4929-b14c-5531b1ea8d27 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:28:46 devstack sudo[97328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-48ab7920-5882-4929-b14c-5531b1ea8d27 1073741824
Jul 30 20:28:46 devstack sudo[97328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:28:46 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-36da81a5-8e72-4a36-aeef-83aa6899d09a tempest-VolumesActionsTest-135968371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33ff25ff-1b35-4fee-a094-4473cf5144c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd820e96-669e-487a-bd5a-226dec8a43fa', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:28:46 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-36da81a5-8e72-4a36-aeef-83aa6899d09a tempest-VolumesActionsTest-135968371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (870fb916-dde1-4685-82d1-00c4dec5ac36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:28:46 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-36da81a5-8e72-4a36-aeef-83aa6899d09a tempest-VolumesActionsTest-135968371 None] Volume volume-dd820e96-669e-487a-bd5a-226dec8a43fa (dd820e96-669e-487a-bd5a-226dec8a43fa): created successfully
Jul 30 20:28:46 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-36da81a5-8e72-4a36-aeef-83aa6899d09a tempest-VolumesActionsTest-135968371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (870fb916-dde1-4685-82d1-00c4dec5ac36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:28:46 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-36da81a5-8e72-4a36-aeef-83aa6899d09a tempest-VolumesActionsTest-135968371 None] Flow 'volume_create_manager' (cc955eb6-5cc2-41e3-b3bd-c6ea4024b373) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:28:46 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-36da81a5-8e72-4a36-aeef-83aa6899d09a tempest-VolumesActionsTest-135968371 None] Created volume successfully.
Jul 30 20:28:47 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-6871d27b-5a0a-40dc-bcb3-9e11f0ec5bcc tempest-VolumesActionsTest-135968371 None] Acquiring lock "cinder-dd820e96-669e-487a-bd5a-226dec8a43fa" by "attach_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:28:47 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-6871d27b-5a0a-40dc-bcb3-9e11f0ec5bcc tempest-VolumesActionsTest-135968371 None] Lock "cinder-dd820e96-669e-487a-bd5a-226dec8a43fa" acquired by "attach_volume" :: waited 0.025s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:28:47 devstack sudo[97328]: pam_unix(sudo:session): session closed for user root
Jul 30 20:28:47 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f5e97542-c40e-45c2-bb32-1a12056b2a01 tempest-AttachVolumeNegativeTest-1614371178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-48ab7920-5882-4929-b14c-5531b1ea8d27 1073741824" returned: 0 in 0.713s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:28:47 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f5e97542-c40e-45c2-bb32-1a12056b2a01 tempest-AttachVolumeNegativeTest-1614371178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-48ab7920-5882-4929-b14c-5531b1ea8d27 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:28:47 devstack sudo[97335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-48ab7920-5882-4929-b14c-5531b1ea8d27
Jul 30 20:28:47 devstack sudo[97335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:28:47 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-6871d27b-5a0a-40dc-bcb3-9e11f0ec5bcc tempest-VolumesActionsTest-135968371 None] Attaching volume dd820e96-669e-487a-bd5a-226dec8a43fa to instance 7f47100f-122f-4072-ada2-039bfbfa10ef at mountpoint /dev/vdb on host None.
Jul 30 20:28:47 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-6871d27b-5a0a-40dc-bcb3-9e11f0ec5bcc tempest-VolumesActionsTest-135968371 None] Attach volume completed successfully.
Jul 30 20:28:47 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-6871d27b-5a0a-40dc-bcb3-9e11f0ec5bcc tempest-VolumesActionsTest-135968371 None] Lock "cinder-dd820e96-669e-487a-bd5a-226dec8a43fa" released by "attach_volume" :: held 0.264s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:28:47 devstack sudo[97335]: pam_unix(sudo:session): session closed for user root
Jul 30 20:28:47 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f5e97542-c40e-45c2-bb32-1a12056b2a01 tempest-AttachVolumeNegativeTest-1614371178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-48ab7920-5882-4929-b14c-5531b1ea8d27" returned: 0 in 0.436s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:28:47 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-f5e97542-c40e-45c2-bb32-1a12056b2a01 tempest-AttachVolumeNegativeTest-1614371178 None] <== create_volume: return (1209ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:28:47 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-f5e97542-c40e-45c2-bb32-1a12056b2a01 tempest-AttachVolumeNegativeTest-1614371178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.214s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:28:47 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-f5e97542-c40e-45c2-bb32-1a12056b2a01 tempest-AttachVolumeNegativeTest-1614371178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad1257fa-06d8-4468-b53d-21d1d8990df1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48ab7920-5882-4929-b14c-5531b1ea8d27', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:28:47 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-f5e97542-c40e-45c2-bb32-1a12056b2a01 tempest-AttachVolumeNegativeTest-1614371178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3b5bab7-6c8f-4cd1-a288-e0d9afcd90ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:28:47 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-f5e97542-c40e-45c2-bb32-1a12056b2a01 tempest-AttachVolumeNegativeTest-1614371178 None] Volume volume-48ab7920-5882-4929-b14c-5531b1ea8d27 (48ab7920-5882-4929-b14c-5531b1ea8d27): created successfully
Jul 30 20:28:47 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-f5e97542-c40e-45c2-bb32-1a12056b2a01 tempest-AttachVolumeNegativeTest-1614371178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3b5bab7-6c8f-4cd1-a288-e0d9afcd90ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:28:47 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-f5e97542-c40e-45c2-bb32-1a12056b2a01 tempest-AttachVolumeNegativeTest-1614371178 None] Flow 'volume_create_manager' (8adf9bf9-bde1-4239-b857-f01904ea0505) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:28:47 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-f5e97542-c40e-45c2-bb32-1a12056b2a01 tempest-AttachVolumeNegativeTest-1614371178 None] Created volume successfully.
Jul 30 20:28:48 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-93493e93-04c7-4673-bfe5-d222748ccf8e tempest-VolumesActionsTest-2145718135 None] Terminate volume connection completed successfully.
Jul 30 20:28:48 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-93493e93-04c7-4673-bfe5-d222748ccf8e tempest-VolumesActionsTest-2145718135 None] Acquiring lock "cinder-dd820e96-669e-487a-bd5a-226dec8a43fa-detach_volume" by "detach_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:28:48 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-93493e93-04c7-4673-bfe5-d222748ccf8e tempest-VolumesActionsTest-2145718135 None] Lock "cinder-dd820e96-669e-487a-bd5a-226dec8a43fa-detach_volume" acquired by "detach_volume" :: waited 0.044s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:28:48 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-93493e93-04c7-4673-bfe5-d222748ccf8e tempest-VolumesActionsTest-2145718135 None] Detaching volume dd820e96-669e-487a-bd5a-226dec8a43fa from instance 7f47100f-122f-4072-ada2-039bfbfa10ef.
Jul 30 20:28:48 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-93493e93-04c7-4673-bfe5-d222748ccf8e tempest-VolumesActionsTest-2145718135 None] Detach volume completed successfully.
Jul 30 20:28:48 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-93493e93-04c7-4673-bfe5-d222748ccf8e tempest-VolumesActionsTest-2145718135 None] Lock "cinder-dd820e96-669e-487a-bd5a-226dec8a43fa-detach_volume" released by "detach_volume" :: held 0.106s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:28:48 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-a71df1df-8d71-40af-a083-6e9d6914bffa tempest-VolumesActionsTest-135968371 None] Acquiring lock "cinder-dd820e96-669e-487a-bd5a-226dec8a43fa-detach_volume" by "detach_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:28:48 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-a71df1df-8d71-40af-a083-6e9d6914bffa tempest-VolumesActionsTest-135968371 None] Lock "cinder-dd820e96-669e-487a-bd5a-226dec8a43fa-detach_volume" acquired by "detach_volume" :: waited 0.042s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:28:48 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-a71df1df-8d71-40af-a083-6e9d6914bffa tempest-VolumesActionsTest-135968371 None] Volume detach called, but volume not attached.
Jul 30 20:28:48 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-a71df1df-8d71-40af-a083-6e9d6914bffa tempest-VolumesActionsTest-135968371 None] Lock "cinder-dd820e96-669e-487a-bd5a-226dec8a43fa-detach_volume" released by "detach_volume" :: held 0.042s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:28:49 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-282f2e4d-bc72-4727-9be3-1d26905f007f tempest-VolumesActionsTest-135968371 None] Acquiring lock "cinder-dd820e96-669e-487a-bd5a-226dec8a43fa-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:28:49 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-282f2e4d-bc72-4727-9be3-1d26905f007f tempest-VolumesActionsTest-135968371 None] Lock "cinder-dd820e96-669e-487a-bd5a-226dec8a43fa-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:28:49 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-282f2e4d-bc72-4727-9be3-1d26905f007f tempest-VolumesActionsTest-135968371 None] Acquiring lock "cinder-quobyte-dd820e96-669e-487a-bd5a-226dec8a43fa" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:28:49 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-282f2e4d-bc72-4727-9be3-1d26905f007f tempest-VolumesActionsTest-135968371 None] Lock "cinder-quobyte-dd820e96-669e-487a-bd5a-226dec8a43fa" acquired by "delete_volume" :: waited 0.024s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:28:49 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[65d3b350-99f6-4387-b2d2-633c31bf153f]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:28:49 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-282f2e4d-bc72-4727-9be3-1d26905f007f tempest-VolumesActionsTest-135968371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-dd820e96-669e-487a-bd5a-226dec8a43fa {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:28:49 devstack sudo[97341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-dd820e96-669e-487a-bd5a-226dec8a43fa
Jul 30 20:28:49 devstack sudo[97341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:28:50 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [req-09fe4a4e-a622-4fe8-991a-3132d17ed34a req-10ef1152-1690-410c-a510-e679756c7825 tempest-AttachVolumeNegativeTest-1614371178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:28:50 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [req-09fe4a4e-a622-4fe8-991a-3132d17ed34a req-10ef1152-1690-410c-a510-e679756c7825 tempest-AttachVolumeNegativeTest-1614371178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:28:50 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [req-09fe4a4e-a622-4fe8-991a-3132d17ed34a req-10ef1152-1690-410c-a510-e679756c7825 tempest-AttachVolumeNegativeTest-1614371178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:28:50 devstack sudo[97341]: pam_unix(sudo:session): session closed for user root
Jul 30 20:28:50 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-282f2e4d-bc72-4727-9be3-1d26905f007f tempest-VolumesActionsTest-135968371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-dd820e96-669e-487a-bd5a-226dec8a43fa" returned: 0 in 0.733s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:28:50 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-282f2e4d-bc72-4727-9be3-1d26905f007f tempest-VolumesActionsTest-135968371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-dd820e96-669e-487a-bd5a-226dec8a43fa {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:28:50 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [req-09fe4a4e-a622-4fe8-991a-3132d17ed34a req-10ef1152-1690-410c-a510-e679756c7825 tempest-AttachVolumeNegativeTest-1614371178 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5', 'name': 'volume-48ab7920-5882-4929-b14c-5531b1ea8d27', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '22efc316-369a-41fc-a6d8-40067b669e78', 'enforce_multipath': True} {{(pid=88719) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 30 20:28:50 devstack sudo[97354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-dd820e96-669e-487a-bd5a-226dec8a43fa
Jul 30 20:28:50 devstack sudo[97354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:28:50 devstack cinder-volume[88719]: INFO cinder.volume.manager [req-09fe4a4e-a622-4fe8-991a-3132d17ed34a req-10ef1152-1690-410c-a510-e679756c7825 tempest-AttachVolumeNegativeTest-1614371178 None] attachment_update completed successfully.
Jul 30 20:28:50 devstack sudo[97354]: pam_unix(sudo:session): session closed for user root
Jul 30 20:28:50 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-282f2e4d-bc72-4727-9be3-1d26905f007f tempest-VolumesActionsTest-135968371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-dd820e96-669e-487a-bd5a-226dec8a43fa" returned: 0 in 0.582s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:28:50 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-282f2e4d-bc72-4727-9be3-1d26905f007f tempest-VolumesActionsTest-135968371 None] Lock "cinder-quobyte-dd820e96-669e-487a-bd5a-226dec8a43fa" released by "delete_volume" :: held 1.385s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:28:51 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-282f2e4d-bc72-4727-9be3-1d26905f007f tempest-VolumesActionsTest-135968371 None] Created reservations ['f98c8300-9547-4828-9ff2-ea2c6e310f0a', '26f0e177-6282-4819-b57d-00a491de18f3', '350ee752-ff3c-4615-8cf1-7de6eb1ca4d3', '55d27e2d-80c9-43bc-9cdf-cd93b55ba281'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:28:51 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-282f2e4d-bc72-4727-9be3-1d26905f007f tempest-VolumesActionsTest-135968371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:28:51 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-282f2e4d-bc72-4727-9be3-1d26905f007f tempest-VolumesActionsTest-135968371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:28:51 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-282f2e4d-bc72-4727-9be3-1d26905f007f tempest-VolumesActionsTest-135968371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:28:51 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-282f2e4d-bc72-4727-9be3-1d26905f007f tempest-VolumesActionsTest-135968371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:28:51 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-282f2e4d-bc72-4727-9be3-1d26905f007f tempest-VolumesActionsTest-135968371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:28:51 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-282f2e4d-bc72-4727-9be3-1d26905f007f tempest-VolumesActionsTest-135968371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:28:51 devstack sudo[97739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:28:51 devstack sudo[97739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:28:51 devstack sudo[97739]: pam_unix(sudo:session): session closed for user root
Jul 30 20:28:51 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-282f2e4d-bc72-4727-9be3-1d26905f007f tempest-VolumesActionsTest-135968371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.353s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:28:51 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-282f2e4d-bc72-4727-9be3-1d26905f007f tempest-VolumesActionsTest-135968371 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:28:51 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-282f2e4d-bc72-4727-9be3-1d26905f007f tempest-VolumesActionsTest-135968371 None] Deleted volume successfully.
Jul 30 20:28:51 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-282f2e4d-bc72-4727-9be3-1d26905f007f tempest-VolumesActionsTest-135968371 None] Lock "cinder-dd820e96-669e-487a-bd5a-226dec8a43fa-delete_volume" released by "delete_volume" :: held 2.181s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:28:54 devstack cinder-volume[88719]: INFO cinder.volume.manager [req-463befc9-2bb1-4ca3-8933-a12cf1196826 req-3e4973db-f4b5-4147-8caa-e2cc22a3a691 tempest-AttachVolumeNegativeTest-1614371178 None] Terminate volume connection completed successfully.
Jul 30 20:28:54 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [req-463befc9-2bb1-4ca3-8933-a12cf1196826 req-3e4973db-f4b5-4147-8caa-e2cc22a3a691 tempest-AttachVolumeNegativeTest-1614371178 None] Deleting attachment 22efc316-369a-41fc-a6d8-40067b669e78. {{(pid=88719) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 30 20:28:56 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-d16773ad-3a06-40cb-b457-4a342c765d24 tempest-VolumesActionsTest-135968371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:28:57 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-d16773ad-3a06-40cb-b457-4a342c765d24 tempest-VolumesActionsTest-135968371 None] Flow 'volume_create_manager' (ff9d66aa-a8ed-4b4d-8132-88b9a621c5f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:28:57 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-d16773ad-3a06-40cb-b457-4a342c765d24 tempest-VolumesActionsTest-135968371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a9e776c-c5be-4f3d-aa08-42322e9d1cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:28:57 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-d16773ad-3a06-40cb-b457-4a342c765d24 tempest-VolumesActionsTest-135968371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a9e776c-c5be-4f3d-aa08-42322e9d1cc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:28:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-23462486',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d08d64a-40aa-44b6-a78a-d510d2894f24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d5498700a384a6db5a774609f5b251a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:28:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:28:57Z,use_quota=True,user_id='785d5df48e1340b185bfa9fa0913e1a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:28:57 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-d16773ad-3a06-40cb-b457-4a342c765d24 tempest-VolumesActionsTest-135968371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb12aeac-9b19-453a-9407-69a7456d8026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:28:57 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-d16773ad-3a06-40cb-b457-4a342c765d24 tempest-VolumesActionsTest-135968371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb12aeac-9b19-453a-9407-69a7456d8026) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:28:57 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-d16773ad-3a06-40cb-b457-4a342c765d24 tempest-VolumesActionsTest-135968371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2861bc48-471a-4202-aa1a-0270098a5dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:28:57 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-d16773ad-3a06-40cb-b457-4a342c765d24 tempest-VolumesActionsTest-135968371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2861bc48-471a-4202-aa1a-0270098a5dec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d08d64a-40aa-44b6-a78a-d510d2894f24', 'volume_name': 'volume-7d08d64a-40aa-44b6-a78a-d510d2894f24', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:28:57 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-d16773ad-3a06-40cb-b457-4a342c765d24 tempest-VolumesActionsTest-135968371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23919566-ca20-41cf-abb2-6fe020b04c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:28:57 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-d16773ad-3a06-40cb-b457-4a342c765d24 tempest-VolumesActionsTest-135968371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23919566-ca20-41cf-abb2-6fe020b04c75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:28:57 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-d16773ad-3a06-40cb-b457-4a342c765d24 tempest-VolumesActionsTest-135968371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2d1aea1-d121-427b-aa08-0e25da03b87d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:28:57 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-d16773ad-3a06-40cb-b457-4a342c765d24 tempest-VolumesActionsTest-135968371 None] Volume 7d08d64a-40aa-44b6-a78a-d510d2894f24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d08d64a-40aa-44b6-a78a-d510d2894f24', 'volume_size': 1}
Jul 30 20:28:57 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-d16773ad-3a06-40cb-b457-4a342c765d24 tempest-VolumesActionsTest-135968371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:28:57 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-d16773ad-3a06-40cb-b457-4a342c765d24 tempest-VolumesActionsTest-135968371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:28:57 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-d16773ad-3a06-40cb-b457-4a342c765d24 tempest-VolumesActionsTest-135968371 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:28:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-23462486',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d08d64a-40aa-44b6-a78a-d510d2894f24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d5498700a384a6db5a774609f5b251a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:28:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:28:57Z,use_quota=True,user_id='785d5df48e1340b185bfa9fa0913e1a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:28:57 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-d16773ad-3a06-40cb-b457-4a342c765d24 tempest-VolumesActionsTest-135968371 None] Creating volume 7d08d64a-40aa-44b6-a78a-d510d2894f24 {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:28:57 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-d16773ad-3a06-40cb-b457-4a342c765d24 tempest-VolumesActionsTest-135968371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:28:57 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-d16773ad-3a06-40cb-b457-4a342c765d24 tempest-VolumesActionsTest-135968371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:28:57 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-d16773ad-3a06-40cb-b457-4a342c765d24 tempest-VolumesActionsTest-135968371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:28:57 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-d16773ad-3a06-40cb-b457-4a342c765d24 tempest-VolumesActionsTest-135968371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:28:57 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-d16773ad-3a06-40cb-b457-4a342c765d24 tempest-VolumesActionsTest-135968371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:28:57 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-d16773ad-3a06-40cb-b457-4a342c765d24 tempest-VolumesActionsTest-135968371 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:28:57 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-d16773ad-3a06-40cb-b457-4a342c765d24 tempest-VolumesActionsTest-135968371 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:28:57 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-d16773ad-3a06-40cb-b457-4a342c765d24 tempest-VolumesActionsTest-135968371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-7d08d64a-40aa-44b6-a78a-d510d2894f24 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:28:57 devstack sudo[97867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-7d08d64a-40aa-44b6-a78a-d510d2894f24 1073741824
Jul 30 20:28:57 devstack sudo[97867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:28:57 devstack sudo[97867]: pam_unix(sudo:session): session closed for user root
Jul 30 20:28:57 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-d16773ad-3a06-40cb-b457-4a342c765d24 tempest-VolumesActionsTest-135968371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-7d08d64a-40aa-44b6-a78a-d510d2894f24 1073741824" returned: 0 in 0.723s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:28:57 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-d16773ad-3a06-40cb-b457-4a342c765d24 tempest-VolumesActionsTest-135968371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-7d08d64a-40aa-44b6-a78a-d510d2894f24 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:28:57 devstack sudo[97875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-7d08d64a-40aa-44b6-a78a-d510d2894f24
Jul 30 20:28:57 devstack sudo[97875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:28:57 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d785049-3a21-499c-bc42-86841780a689 tempest-VolumeSnapshotQuotasNegativeTestJSON-1200704640 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:28:58 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5d785049-3a21-499c-bc42-86841780a689 tempest-VolumeSnapshotQuotasNegativeTestJSON-1200704640 None] Flow 'volume_create_manager' (ae3ef8db-b14c-4038-ad03-10bf7fd758ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:28:58 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5d785049-3a21-499c-bc42-86841780a689 tempest-VolumeSnapshotQuotasNegativeTestJSON-1200704640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87a73e3b-e6c8-43d5-8013-b0e90cf7705e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:28:58 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5d785049-3a21-499c-bc42-86841780a689 tempest-VolumeSnapshotQuotasNegativeTestJSON-1200704640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87a73e3b-e6c8-43d5-8013-b0e90cf7705e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:28:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-273412095',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=732fc9e8-f3a4-47fe-9839-af85a5e55262,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57e5d41d23fb44758965144b96a2ed05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:28:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:28:58Z,use_quota=True,user_id='1c4f302a1365421fbc235564d3b39aff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:28:58 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5d785049-3a21-499c-bc42-86841780a689 tempest-VolumeSnapshotQuotasNegativeTestJSON-1200704640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8d98b53-585a-4f6a-ae4c-8e76f334c8b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:28:58 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5d785049-3a21-499c-bc42-86841780a689 tempest-VolumeSnapshotQuotasNegativeTestJSON-1200704640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8d98b53-585a-4f6a-ae4c-8e76f334c8b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:28:58 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5d785049-3a21-499c-bc42-86841780a689 tempest-VolumeSnapshotQuotasNegativeTestJSON-1200704640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17dbfa20-b52f-4e06-878f-ca4cf1a42c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:28:58 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5d785049-3a21-499c-bc42-86841780a689 tempest-VolumeSnapshotQuotasNegativeTestJSON-1200704640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17dbfa20-b52f-4e06-878f-ca4cf1a42c3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '732fc9e8-f3a4-47fe-9839-af85a5e55262', 'volume_name': 'volume-732fc9e8-f3a4-47fe-9839-af85a5e55262', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:28:58 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5d785049-3a21-499c-bc42-86841780a689 tempest-VolumeSnapshotQuotasNegativeTestJSON-1200704640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0aeda41b-fd22-447d-a880-71f033a97c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:28:58 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5d785049-3a21-499c-bc42-86841780a689 tempest-VolumeSnapshotQuotasNegativeTestJSON-1200704640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0aeda41b-fd22-447d-a880-71f033a97c9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:28:58 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5d785049-3a21-499c-bc42-86841780a689 tempest-VolumeSnapshotQuotasNegativeTestJSON-1200704640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efbab572-80a0-4b32-bd7f-7bd38715a09e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:28:58 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-5d785049-3a21-499c-bc42-86841780a689 tempest-VolumeSnapshotQuotasNegativeTestJSON-1200704640 None] Volume 732fc9e8-f3a4-47fe-9839-af85a5e55262: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-732fc9e8-f3a4-47fe-9839-af85a5e55262', 'volume_size': 1}
Jul 30 20:28:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-5d785049-3a21-499c-bc42-86841780a689 tempest-VolumeSnapshotQuotasNegativeTestJSON-1200704640 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:28:58 devstack sudo[97875]: pam_unix(sudo:session): session closed for user root
Jul 30 20:28:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-d16773ad-3a06-40cb-b457-4a342c765d24 tempest-VolumesActionsTest-135968371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-7d08d64a-40aa-44b6-a78a-d510d2894f24" returned: 0 in 0.326s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:28:58 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-d16773ad-3a06-40cb-b457-4a342c765d24 tempest-VolumesActionsTest-135968371 None] <== create_volume: return (1103ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:28:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-d16773ad-3a06-40cb-b457-4a342c765d24 tempest-VolumesActionsTest-135968371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.105s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:28:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-5d785049-3a21-499c-bc42-86841780a689 tempest-VolumeSnapshotQuotasNegativeTestJSON-1200704640 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.064s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:28:58 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-5d785049-3a21-499c-bc42-86841780a689 tempest-VolumeSnapshotQuotasNegativeTestJSON-1200704640 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:28:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-273412095',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=732fc9e8-f3a4-47fe-9839-af85a5e55262,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57e5d41d23fb44758965144b96a2ed05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:28:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:28:58Z,use_quota=True,user_id='1c4f302a1365421fbc235564d3b39aff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:28:58 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-5d785049-3a21-499c-bc42-86841780a689 tempest-VolumeSnapshotQuotasNegativeTestJSON-1200704640 None] Creating volume 732fc9e8-f3a4-47fe-9839-af85a5e55262 {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:28:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-5d785049-3a21-499c-bc42-86841780a689 tempest-VolumeSnapshotQuotasNegativeTestJSON-1200704640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:28:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-5d785049-3a21-499c-bc42-86841780a689 tempest-VolumeSnapshotQuotasNegativeTestJSON-1200704640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:28:58 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-5d785049-3a21-499c-bc42-86841780a689 tempest-VolumeSnapshotQuotasNegativeTestJSON-1200704640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:28:58 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-5d785049-3a21-499c-bc42-86841780a689 tempest-VolumeSnapshotQuotasNegativeTestJSON-1200704640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:28:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-5d785049-3a21-499c-bc42-86841780a689 tempest-VolumeSnapshotQuotasNegativeTestJSON-1200704640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:28:58 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-5d785049-3a21-499c-bc42-86841780a689 tempest-VolumeSnapshotQuotasNegativeTestJSON-1200704640 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:28:58 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-5d785049-3a21-499c-bc42-86841780a689 tempest-VolumeSnapshotQuotasNegativeTestJSON-1200704640 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:28:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-5d785049-3a21-499c-bc42-86841780a689 tempest-VolumeSnapshotQuotasNegativeTestJSON-1200704640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-732fc9e8-f3a4-47fe-9839-af85a5e55262 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:28:58 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-d16773ad-3a06-40cb-b457-4a342c765d24 tempest-VolumesActionsTest-135968371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2d1aea1-d121-427b-aa08-0e25da03b87d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d08d64a-40aa-44b6-a78a-d510d2894f24', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:28:58 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-d16773ad-3a06-40cb-b457-4a342c765d24 tempest-VolumesActionsTest-135968371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b90024cb-575e-42ce-9ba9-687725a427d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:28:58 devstack sudo[97879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-732fc9e8-f3a4-47fe-9839-af85a5e55262 1073741824
Jul 30 20:28:58 devstack sudo[97879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:28:58 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-d16773ad-3a06-40cb-b457-4a342c765d24 tempest-VolumesActionsTest-135968371 None] Volume volume-7d08d64a-40aa-44b6-a78a-d510d2894f24 (7d08d64a-40aa-44b6-a78a-d510d2894f24): created successfully
Jul 30 20:28:58 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-d16773ad-3a06-40cb-b457-4a342c765d24 tempest-VolumesActionsTest-135968371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b90024cb-575e-42ce-9ba9-687725a427d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:28:58 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-d16773ad-3a06-40cb-b457-4a342c765d24 tempest-VolumesActionsTest-135968371 None] Flow 'volume_create_manager' (ff9d66aa-a8ed-4b4d-8132-88b9a621c5f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:28:58 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-d16773ad-3a06-40cb-b457-4a342c765d24 tempest-VolumesActionsTest-135968371 None] Created volume successfully.
Jul 30 20:28:58 devstack sudo[97879]: pam_unix(sudo:session): session closed for user root
Jul 30 20:28:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-5d785049-3a21-499c-bc42-86841780a689 tempest-VolumeSnapshotQuotasNegativeTestJSON-1200704640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-732fc9e8-f3a4-47fe-9839-af85a5e55262 1073741824" returned: 0 in 0.598s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:28:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-5d785049-3a21-499c-bc42-86841780a689 tempest-VolumeSnapshotQuotasNegativeTestJSON-1200704640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-732fc9e8-f3a4-47fe-9839-af85a5e55262 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:28:58 devstack sudo[97885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-732fc9e8-f3a4-47fe-9839-af85a5e55262
Jul 30 20:28:58 devstack sudo[97885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:28:59 devstack sudo[97885]: pam_unix(sudo:session): session closed for user root
Jul 30 20:28:59 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-5d785049-3a21-499c-bc42-86841780a689 tempest-VolumeSnapshotQuotasNegativeTestJSON-1200704640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-732fc9e8-f3a4-47fe-9839-af85a5e55262" returned: 0 in 0.271s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:28:59 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-5d785049-3a21-499c-bc42-86841780a689 tempest-VolumeSnapshotQuotasNegativeTestJSON-1200704640 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:28:59 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-5d785049-3a21-499c-bc42-86841780a689 tempest-VolumeSnapshotQuotasNegativeTestJSON-1200704640 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:28:59 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5d785049-3a21-499c-bc42-86841780a689 tempest-VolumeSnapshotQuotasNegativeTestJSON-1200704640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efbab572-80a0-4b32-bd7f-7bd38715a09e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-732fc9e8-f3a4-47fe-9839-af85a5e55262', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:28:59 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5d785049-3a21-499c-bc42-86841780a689 tempest-VolumeSnapshotQuotasNegativeTestJSON-1200704640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2060920e-28ab-4d44-badc-fc69dd906b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:28:59 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-5d785049-3a21-499c-bc42-86841780a689 tempest-VolumeSnapshotQuotasNegativeTestJSON-1200704640 None] Volume volume-732fc9e8-f3a4-47fe-9839-af85a5e55262 (732fc9e8-f3a4-47fe-9839-af85a5e55262): created successfully
Jul 30 20:28:59 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5d785049-3a21-499c-bc42-86841780a689 tempest-VolumeSnapshotQuotasNegativeTestJSON-1200704640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2060920e-28ab-4d44-badc-fc69dd906b3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:28:59 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5d785049-3a21-499c-bc42-86841780a689 tempest-VolumeSnapshotQuotasNegativeTestJSON-1200704640 None] Flow 'volume_create_manager' (ae3ef8db-b14c-4038-ad03-10bf7fd758ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:28:59 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-5d785049-3a21-499c-bc42-86841780a689 tempest-VolumeSnapshotQuotasNegativeTestJSON-1200704640 None] Created volume successfully.
Jul 30 20:28:59 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-0a2502b0-a6b7-4024-b0b2-7572d1e70fb6 tempest-VolumesActionsTest-2145718135 None] Acquiring lock "cinder-7d08d64a-40aa-44b6-a78a-d510d2894f24-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:28:59 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-0a2502b0-a6b7-4024-b0b2-7572d1e70fb6 tempest-VolumesActionsTest-2145718135 None] Lock "cinder-7d08d64a-40aa-44b6-a78a-d510d2894f24-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:28:59 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-0a2502b0-a6b7-4024-b0b2-7572d1e70fb6 tempest-VolumesActionsTest-2145718135 None] Acquiring lock "cinder-quobyte-7d08d64a-40aa-44b6-a78a-d510d2894f24" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:28:59 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-0a2502b0-a6b7-4024-b0b2-7572d1e70fb6 tempest-VolumesActionsTest-2145718135 None] Lock "cinder-quobyte-7d08d64a-40aa-44b6-a78a-d510d2894f24" acquired by "delete_volume" :: waited 0.016s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:28:59 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[982ad0ee-eec9-4799-a29f-d7aaff22f781]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:28:59 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-0a2502b0-a6b7-4024-b0b2-7572d1e70fb6 tempest-VolumesActionsTest-2145718135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-7d08d64a-40aa-44b6-a78a-d510d2894f24 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:28:59 devstack sudo[97888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-7d08d64a-40aa-44b6-a78a-d510d2894f24
Jul 30 20:28:59 devstack sudo[97888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:28:59 devstack sudo[97888]: pam_unix(sudo:session): session closed for user root
Jul 30 20:28:59 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-0a2502b0-a6b7-4024-b0b2-7572d1e70fb6 tempest-VolumesActionsTest-2145718135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-7d08d64a-40aa-44b6-a78a-d510d2894f24" returned: 0 in 0.437s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:28:59 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-0a2502b0-a6b7-4024-b0b2-7572d1e70fb6 tempest-VolumesActionsTest-2145718135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-7d08d64a-40aa-44b6-a78a-d510d2894f24 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:28:59 devstack sudo[97893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-7d08d64a-40aa-44b6-a78a-d510d2894f24
Jul 30 20:28:59 devstack sudo[97893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:00 devstack sudo[97893]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:00 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-0a2502b0-a6b7-4024-b0b2-7572d1e70fb6 tempest-VolumesActionsTest-2145718135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-7d08d64a-40aa-44b6-a78a-d510d2894f24" returned: 0 in 0.337s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:00 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-0a2502b0-a6b7-4024-b0b2-7572d1e70fb6 tempest-VolumesActionsTest-2145718135 None] Lock "cinder-quobyte-7d08d64a-40aa-44b6-a78a-d510d2894f24" released by "delete_volume" :: held 0.826s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:29:00 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-0a2502b0-a6b7-4024-b0b2-7572d1e70fb6 tempest-VolumesActionsTest-2145718135 None] Created reservations ['845ea9fa-1226-424b-af42-56a1f3a737bf', '01a906d7-0d7c-4f41-bf6d-69326937b297', '536c567f-90be-4e25-ab88-2bb6f23043da', '8b245e45-2c66-48a0-a55d-85c55c2c3c07'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:29:00 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-b40bd12e-4ca6-4c9d-9ecc-e3ae1a9c25c7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1200704640 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:29:00 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-b40bd12e-4ca6-4c9d-9ecc-e3ae1a9c25c7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1200704640 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:29:00 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-b40bd12e-4ca6-4c9d-9ecc-e3ae1a9c25c7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1200704640 None] Creating offline snapshot 2273ac08-6274-4541-aa82-4683a2a1ea70 of volume 732fc9e8-f3a4-47fe-9839-af85a5e55262 {{(pid=88719) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 30 20:29:00 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[345eefa0-7540-4b64-888b-84f084b519e3]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:29:00 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-b40bd12e-4ca6-4c9d-9ecc-e3ae1a9c25c7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1200704640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-732fc9e8-f3a4-47fe-9839-af85a5e55262 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:00 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-0a2502b0-a6b7-4024-b0b2-7572d1e70fb6 tempest-VolumesActionsTest-2145718135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:29:00 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-0a2502b0-a6b7-4024-b0b2-7572d1e70fb6 tempest-VolumesActionsTest-2145718135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:29:00 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-0a2502b0-a6b7-4024-b0b2-7572d1e70fb6 tempest-VolumesActionsTest-2145718135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:29:00 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-0a2502b0-a6b7-4024-b0b2-7572d1e70fb6 tempest-VolumesActionsTest-2145718135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:29:00 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-0a2502b0-a6b7-4024-b0b2-7572d1e70fb6 tempest-VolumesActionsTest-2145718135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:29:00 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-0a2502b0-a6b7-4024-b0b2-7572d1e70fb6 tempest-VolumesActionsTest-2145718135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:00 devstack sudo[97897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:29:00 devstack sudo[97897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:00 devstack sudo[97896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-732fc9e8-f3a4-47fe-9839-af85a5e55262
Jul 30 20:29:00 devstack sudo[97896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:00 devstack sudo[97897]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:00 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-0a2502b0-a6b7-4024-b0b2-7572d1e70fb6 tempest-VolumesActionsTest-2145718135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.360s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:00 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-0a2502b0-a6b7-4024-b0b2-7572d1e70fb6 tempest-VolumesActionsTest-2145718135 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:29:00 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-0a2502b0-a6b7-4024-b0b2-7572d1e70fb6 tempest-VolumesActionsTest-2145718135 None] Deleted volume successfully.
Jul 30 20:29:00 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-0a2502b0-a6b7-4024-b0b2-7572d1e70fb6 tempest-VolumesActionsTest-2145718135 None] Lock "cinder-7d08d64a-40aa-44b6-a78a-d510d2894f24-delete_volume" released by "delete_volume" :: held 1.507s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:29:00 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-11d267f8-3f4c-4bed-82dd-fe8a4290c629 tempest-AttachVolumeNegativeTest-1614371178 None] Acquiring lock "cinder-48ab7920-5882-4929-b14c-5531b1ea8d27-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:29:00 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-11d267f8-3f4c-4bed-82dd-fe8a4290c629 tempest-AttachVolumeNegativeTest-1614371178 None] Lock "cinder-48ab7920-5882-4929-b14c-5531b1ea8d27-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:29:00 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-11d267f8-3f4c-4bed-82dd-fe8a4290c629 tempest-AttachVolumeNegativeTest-1614371178 None] Acquiring lock "cinder-quobyte-48ab7920-5882-4929-b14c-5531b1ea8d27" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:29:00 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-11d267f8-3f4c-4bed-82dd-fe8a4290c629 tempest-AttachVolumeNegativeTest-1614371178 None] Lock "cinder-quobyte-48ab7920-5882-4929-b14c-5531b1ea8d27" acquired by "delete_volume" :: waited 0.032s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:29:00 devstack sudo[97896]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:00 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-b40bd12e-4ca6-4c9d-9ecc-e3ae1a9c25c7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1200704640 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-732fc9e8-f3a4-47fe-9839-af85a5e55262" returned: 0 in 0.641s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:00 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-b40bd12e-4ca6-4c9d-9ecc-e3ae1a9c25c7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1200704640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-732fc9e8-f3a4-47fe-9839-af85a5e55262,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-732fc9e8-f3a4-47fe-9839-af85a5e55262.2273ac08-6274-4541-aa82-4683a2a1ea70 1G {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:00 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a299af7-7b17-4f7d-84fb-684b8e3d523c]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:29:00 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-11d267f8-3f4c-4bed-82dd-fe8a4290c629 tempest-AttachVolumeNegativeTest-1614371178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-48ab7920-5882-4929-b14c-5531b1ea8d27 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:01 devstack sudo[97904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-732fc9e8-f3a4-47fe-9839-af85a5e55262,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-732fc9e8-f3a4-47fe-9839-af85a5e55262.2273ac08-6274-4541-aa82-4683a2a1ea70 1G
Jul 30 20:29:01 devstack sudo[97904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:01 devstack sudo[97905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-48ab7920-5882-4929-b14c-5531b1ea8d27
Jul 30 20:29:01 devstack sudo[97905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:01 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-10aeebce-1e66-4673-9c11-81ac92645aba tempest-VolumesActionsTest-135968371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:29:01 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-10aeebce-1e66-4673-9c11-81ac92645aba tempest-VolumesActionsTest-135968371 None] Flow 'volume_create_manager' (846ec789-6ab2-40a2-9802-093e594c4bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:29:01 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-10aeebce-1e66-4673-9c11-81ac92645aba tempest-VolumesActionsTest-135968371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f61b0819-84fa-4883-af2f-46ff9169aa20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:01 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-10aeebce-1e66-4673-9c11-81ac92645aba tempest-VolumesActionsTest-135968371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f61b0819-84fa-4883-af2f-46ff9169aa20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:29:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1678636643',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de206dcf-69b2-45f8-a32e-656828a04183,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d5498700a384a6db5a774609f5b251a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:29:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:29:01Z,use_quota=True,user_id='785d5df48e1340b185bfa9fa0913e1a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:01 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-10aeebce-1e66-4673-9c11-81ac92645aba tempest-VolumesActionsTest-135968371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (825e2a63-9142-4628-87eb-d4ef45257a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:01 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-10aeebce-1e66-4673-9c11-81ac92645aba tempest-VolumesActionsTest-135968371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (825e2a63-9142-4628-87eb-d4ef45257a6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:01 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-10aeebce-1e66-4673-9c11-81ac92645aba tempest-VolumesActionsTest-135968371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c85c62a3-42b7-4628-b54c-524a520a0340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:01 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-10aeebce-1e66-4673-9c11-81ac92645aba tempest-VolumesActionsTest-135968371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c85c62a3-42b7-4628-b54c-524a520a0340) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de206dcf-69b2-45f8-a32e-656828a04183', 'volume_name': 'volume-de206dcf-69b2-45f8-a32e-656828a04183', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:01 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-10aeebce-1e66-4673-9c11-81ac92645aba tempest-VolumesActionsTest-135968371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d3a4d0d-0d1b-4ce9-984a-1242958a57a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:01 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-10aeebce-1e66-4673-9c11-81ac92645aba tempest-VolumesActionsTest-135968371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d3a4d0d-0d1b-4ce9-984a-1242958a57a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:01 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-10aeebce-1e66-4673-9c11-81ac92645aba tempest-VolumesActionsTest-135968371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5982b6a8-6d92-460e-8de6-75961660fe71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:01 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-10aeebce-1e66-4673-9c11-81ac92645aba tempest-VolumesActionsTest-135968371 None] Volume de206dcf-69b2-45f8-a32e-656828a04183: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de206dcf-69b2-45f8-a32e-656828a04183', 'volume_size': 1}
Jul 30 20:29:01 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-10aeebce-1e66-4673-9c11-81ac92645aba tempest-VolumesActionsTest-135968371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:29:01 devstack sudo[97905]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:01 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-11d267f8-3f4c-4bed-82dd-fe8a4290c629 tempest-AttachVolumeNegativeTest-1614371178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-48ab7920-5882-4929-b14c-5531b1ea8d27" returned: 0 in 0.538s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:01 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-11d267f8-3f4c-4bed-82dd-fe8a4290c629 tempest-AttachVolumeNegativeTest-1614371178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-48ab7920-5882-4929-b14c-5531b1ea8d27 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:01 devstack sudo[97904]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:01 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-b40bd12e-4ca6-4c9d-9ecc-e3ae1a9c25c7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1200704640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-732fc9e8-f3a4-47fe-9839-af85a5e55262,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-732fc9e8-f3a4-47fe-9839-af85a5e55262.2273ac08-6274-4541-aa82-4683a2a1ea70 1G" returned: 0 in 0.566s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:01 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-b40bd12e-4ca6-4c9d-9ecc-e3ae1a9c25c7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1200704640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-732fc9e8-f3a4-47fe-9839-af85a5e55262 -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-732fc9e8-f3a4-47fe-9839-af85a5e55262.2273ac08-6274-4541-aa82-4683a2a1ea70 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:01 devstack sudo[97915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-48ab7920-5882-4929-b14c-5531b1ea8d27
Jul 30 20:29:01 devstack sudo[97915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:01 devstack sudo[97916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-732fc9e8-f3a4-47fe-9839-af85a5e55262 -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-732fc9e8-f3a4-47fe-9839-af85a5e55262.2273ac08-6274-4541-aa82-4683a2a1ea70
Jul 30 20:29:01 devstack sudo[97916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:01 devstack sudo[97915]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:01 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-11d267f8-3f4c-4bed-82dd-fe8a4290c629 tempest-AttachVolumeNegativeTest-1614371178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-48ab7920-5882-4929-b14c-5531b1ea8d27" returned: 0 in 0.296s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:01 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-11d267f8-3f4c-4bed-82dd-fe8a4290c629 tempest-AttachVolumeNegativeTest-1614371178 None] Lock "cinder-quobyte-48ab7920-5882-4929-b14c-5531b1ea8d27" released by "delete_volume" :: held 0.880s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:29:01 devstack sudo[97916]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:01 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-b40bd12e-4ca6-4c9d-9ecc-e3ae1a9c25c7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1200704640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-732fc9e8-f3a4-47fe-9839-af85a5e55262 -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-732fc9e8-f3a4-47fe-9839-af85a5e55262.2273ac08-6274-4541-aa82-4683a2a1ea70" returned: 0 in 0.310s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:01 devstack cinder-volume[88719]: WARNING cinder.volume.drivers.remotefs [None req-b40bd12e-4ca6-4c9d-9ecc-e3ae1a9c25c7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1200704640 None] /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-732fc9e8-f3a4-47fe-9839-af85a5e55262.2273ac08-6274-4541-aa82-4683a2a1ea70 is being set with open permissions: ugo+rw
Jul 30 20:29:01 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-b40bd12e-4ca6-4c9d-9ecc-e3ae1a9c25c7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1200704640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-732fc9e8-f3a4-47fe-9839-af85a5e55262.2273ac08-6274-4541-aa82-4683a2a1ea70 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:01 devstack sudo[97923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-732fc9e8-f3a4-47fe-9839-af85a5e55262.2273ac08-6274-4541-aa82-4683a2a1ea70
Jul 30 20:29:01 devstack sudo[97923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:01 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-11d267f8-3f4c-4bed-82dd-fe8a4290c629 tempest-AttachVolumeNegativeTest-1614371178 None] Created reservations ['df183909-26a2-4b79-9a7a-f79d5e237941', '26f51902-417f-4b7f-8c23-7c627efdffe5', 'cc47bb17-24e7-4c64-93e3-4dde347c29e9', '876675df-a2dd-43b2-9d0d-1f76f71a08dd'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:29:01 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-11d267f8-3f4c-4bed-82dd-fe8a4290c629 tempest-AttachVolumeNegativeTest-1614371178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:29:01 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-11d267f8-3f4c-4bed-82dd-fe8a4290c629 tempest-AttachVolumeNegativeTest-1614371178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:29:01 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-11d267f8-3f4c-4bed-82dd-fe8a4290c629 tempest-AttachVolumeNegativeTest-1614371178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:29:01 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-11d267f8-3f4c-4bed-82dd-fe8a4290c629 tempest-AttachVolumeNegativeTest-1614371178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:29:01 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-11d267f8-3f4c-4bed-82dd-fe8a4290c629 tempest-AttachVolumeNegativeTest-1614371178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:29:01 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-11d267f8-3f4c-4bed-82dd-fe8a4290c629 tempest-AttachVolumeNegativeTest-1614371178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:02 devstack sudo[97925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:29:02 devstack sudo[97925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:02 devstack sudo[97923]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:02 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-b40bd12e-4ca6-4c9d-9ecc-e3ae1a9c25c7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1200704640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-732fc9e8-f3a4-47fe-9839-af85a5e55262.2273ac08-6274-4541-aa82-4683a2a1ea70" returned: 0 in 0.319s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:02 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-a6d3e326-7f12-4734-907a-a17222ba7c57 tempest-AttachVolumeNegativeTest-1614371178 None] Acquiring lock "cinder-b5714824-e744-4e58-ae56-e3877b97e3ea-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:29:02 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-b40bd12e-4ca6-4c9d-9ecc-e3ae1a9c25c7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1200704640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-732fc9e8-f3a4-47fe-9839-af85a5e55262.info {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:02 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-a6d3e326-7f12-4734-907a-a17222ba7c57 tempest-AttachVolumeNegativeTest-1614371178 None] Lock "cinder-b5714824-e744-4e58-ae56-e3877b97e3ea-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:29:02 devstack sudo[97928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-732fc9e8-f3a4-47fe-9839-af85a5e55262.info
Jul 30 20:29:02 devstack sudo[97928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:02 devstack sudo[97925]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:02 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-11d267f8-3f4c-4bed-82dd-fe8a4290c629 tempest-AttachVolumeNegativeTest-1614371178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.348s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:02 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-11d267f8-3f4c-4bed-82dd-fe8a4290c629 tempest-AttachVolumeNegativeTest-1614371178 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:29:02 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-a6d3e326-7f12-4734-907a-a17222ba7c57 tempest-AttachVolumeNegativeTest-1614371178 None] Acquiring lock "cinder-quobyte-b5714824-e744-4e58-ae56-e3877b97e3ea" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:29:02 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-11d267f8-3f4c-4bed-82dd-fe8a4290c629 tempest-AttachVolumeNegativeTest-1614371178 None] Deleted volume successfully.
Jul 30 20:29:02 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-a6d3e326-7f12-4734-907a-a17222ba7c57 tempest-AttachVolumeNegativeTest-1614371178 None] Lock "cinder-quobyte-b5714824-e744-4e58-ae56-e3877b97e3ea" acquired by "delete_volume" :: waited 0.038s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:29:02 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-11d267f8-3f4c-4bed-82dd-fe8a4290c629 tempest-AttachVolumeNegativeTest-1614371178 None] Lock "cinder-48ab7920-5882-4929-b14c-5531b1ea8d27-delete_volume" released by "delete_volume" :: held 1.544s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:29:02 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e72d22f-4702-4212-8a59-bb10d7e2539b]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:29:02 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-a6d3e326-7f12-4734-907a-a17222ba7c57 tempest-AttachVolumeNegativeTest-1614371178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b5714824-e744-4e58-ae56-e3877b97e3ea {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:02 devstack sudo[97928]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:02 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-b40bd12e-4ca6-4c9d-9ecc-e3ae1a9c25c7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1200704640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-732fc9e8-f3a4-47fe-9839-af85a5e55262.info" returned: 0 in 0.299s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:02 devstack cinder-volume[88719]: WARNING cinder.volume.drivers.remotefs [None req-b40bd12e-4ca6-4c9d-9ecc-e3ae1a9c25c7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1200704640 None] /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-732fc9e8-f3a4-47fe-9839-af85a5e55262.info is being set with open permissions: ugo+rw
Jul 30 20:29:02 devstack sudo[97931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b5714824-e744-4e58-ae56-e3877b97e3ea
Jul 30 20:29:02 devstack sudo[97931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:02 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-b40bd12e-4ca6-4c9d-9ecc-e3ae1a9c25c7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1200704640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-732fc9e8-f3a4-47fe-9839-af85a5e55262.info {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:02 devstack sudo[97934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-732fc9e8-f3a4-47fe-9839-af85a5e55262.info
Jul 30 20:29:02 devstack sudo[97934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:02 devstack sudo[97934]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:02 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-b40bd12e-4ca6-4c9d-9ecc-e3ae1a9c25c7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1200704640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-732fc9e8-f3a4-47fe-9839-af85a5e55262.info" returned: 0 in 0.288s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:02 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-b40bd12e-4ca6-4c9d-9ecc-e3ae1a9c25c7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1200704640 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.599s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:29:02 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-10aeebce-1e66-4673-9c11-81ac92645aba tempest-VolumesActionsTest-135968371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.451s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:29:02 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-10aeebce-1e66-4673-9c11-81ac92645aba tempest-VolumesActionsTest-135968371 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:29:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1678636643',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de206dcf-69b2-45f8-a32e-656828a04183,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d5498700a384a6db5a774609f5b251a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:29:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:29:01Z,use_quota=True,user_id='785d5df48e1340b185bfa9fa0913e1a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:29:02 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-10aeebce-1e66-4673-9c11-81ac92645aba tempest-VolumesActionsTest-135968371 None] Creating volume de206dcf-69b2-45f8-a32e-656828a04183 {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:29:02 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-10aeebce-1e66-4673-9c11-81ac92645aba tempest-VolumesActionsTest-135968371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:29:02 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-10aeebce-1e66-4673-9c11-81ac92645aba tempest-VolumesActionsTest-135968371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:29:02 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-10aeebce-1e66-4673-9c11-81ac92645aba tempest-VolumesActionsTest-135968371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:29:02 devstack sudo[97931]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:02 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-10aeebce-1e66-4673-9c11-81ac92645aba tempest-VolumesActionsTest-135968371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:29:02 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-10aeebce-1e66-4673-9c11-81ac92645aba tempest-VolumesActionsTest-135968371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:29:02 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-10aeebce-1e66-4673-9c11-81ac92645aba tempest-VolumesActionsTest-135968371 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:29:02 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-10aeebce-1e66-4673-9c11-81ac92645aba tempest-VolumesActionsTest-135968371 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:29:02 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-10aeebce-1e66-4673-9c11-81ac92645aba tempest-VolumesActionsTest-135968371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-de206dcf-69b2-45f8-a32e-656828a04183 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:02 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-a6d3e326-7f12-4734-907a-a17222ba7c57 tempest-AttachVolumeNegativeTest-1614371178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b5714824-e744-4e58-ae56-e3877b97e3ea" returned: 0 in 0.469s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:02 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-a6d3e326-7f12-4734-907a-a17222ba7c57 tempest-AttachVolumeNegativeTest-1614371178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b5714824-e744-4e58-ae56-e3877b97e3ea {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:02 devstack sudo[97942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-de206dcf-69b2-45f8-a32e-656828a04183 1073741824
Jul 30 20:29:02 devstack sudo[97942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:02 devstack sudo[97943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b5714824-e744-4e58-ae56-e3877b97e3ea
Jul 30 20:29:02 devstack sudo[97943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:02 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-b40bd12e-4ca6-4c9d-9ecc-e3ae1a9c25c7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1200704640 None] Create snapshot completed successfully
Jul 30 20:29:03 devstack sudo[97943]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:03 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-a6d3e326-7f12-4734-907a-a17222ba7c57 tempest-AttachVolumeNegativeTest-1614371178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b5714824-e744-4e58-ae56-e3877b97e3ea" returned: 0 in 0.315s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:03 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-a6d3e326-7f12-4734-907a-a17222ba7c57 tempest-AttachVolumeNegativeTest-1614371178 None] Lock "cinder-quobyte-b5714824-e744-4e58-ae56-e3877b97e3ea" released by "delete_volume" :: held 0.833s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:29:03 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-a6d3e326-7f12-4734-907a-a17222ba7c57 tempest-AttachVolumeNegativeTest-1614371178 None] Created reservations ['45fd4868-7a9f-4bd4-a100-e71f8f14c939', 'e8c3fa42-bee6-4baa-a599-d24fe6ec734d', 'e8a353a6-b142-449a-8c59-32fffde9d52e', '49ec92ea-e08d-47d3-aa26-d625176056d2'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:29:03 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-a6d3e326-7f12-4734-907a-a17222ba7c57 tempest-AttachVolumeNegativeTest-1614371178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:29:03 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-a6d3e326-7f12-4734-907a-a17222ba7c57 tempest-AttachVolumeNegativeTest-1614371178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:29:03 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-a6d3e326-7f12-4734-907a-a17222ba7c57 tempest-AttachVolumeNegativeTest-1614371178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:29:03 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-a6d3e326-7f12-4734-907a-a17222ba7c57 tempest-AttachVolumeNegativeTest-1614371178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:29:03 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-a6d3e326-7f12-4734-907a-a17222ba7c57 tempest-AttachVolumeNegativeTest-1614371178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:29:03 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-a6d3e326-7f12-4734-907a-a17222ba7c57 tempest-AttachVolumeNegativeTest-1614371178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:03 devstack sudo[97942]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:03 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-10aeebce-1e66-4673-9c11-81ac92645aba tempest-VolumesActionsTest-135968371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-de206dcf-69b2-45f8-a32e-656828a04183 1073741824" returned: 0 in 0.571s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:03 devstack sudo[97951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:29:03 devstack sudo[97951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:03 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-10aeebce-1e66-4673-9c11-81ac92645aba tempest-VolumesActionsTest-135968371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-de206dcf-69b2-45f8-a32e-656828a04183 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:03 devstack sudo[97953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-de206dcf-69b2-45f8-a32e-656828a04183
Jul 30 20:29:03 devstack sudo[97953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:03 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-71c846ca-fa1c-45c5-bf62-27e5d76bfb7b tempest-AttachVolumeNegativeTest-1614371178 None] Acquiring lock "cinder-f52881f2-8a6e-47dd-b6a1-ee4679a5629a-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:29:03 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-71c846ca-fa1c-45c5-bf62-27e5d76bfb7b tempest-AttachVolumeNegativeTest-1614371178 None] Lock "cinder-f52881f2-8a6e-47dd-b6a1-ee4679a5629a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:29:03 devstack sudo[97951]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:03 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-a6d3e326-7f12-4734-907a-a17222ba7c57 tempest-AttachVolumeNegativeTest-1614371178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.407s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:03 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-a6d3e326-7f12-4734-907a-a17222ba7c57 tempest-AttachVolumeNegativeTest-1614371178 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:29:03 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-a6d3e326-7f12-4734-907a-a17222ba7c57 tempest-AttachVolumeNegativeTest-1614371178 None] Deleted volume successfully.
Jul 30 20:29:03 devstack sudo[97953]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:03 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-71c846ca-fa1c-45c5-bf62-27e5d76bfb7b tempest-AttachVolumeNegativeTest-1614371178 None] Acquiring lock "cinder-quobyte-f52881f2-8a6e-47dd-b6a1-ee4679a5629a" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:29:03 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-10aeebce-1e66-4673-9c11-81ac92645aba tempest-VolumesActionsTest-135968371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-de206dcf-69b2-45f8-a32e-656828a04183" returned: 0 in 0.357s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:03 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-10aeebce-1e66-4673-9c11-81ac92645aba tempest-VolumesActionsTest-135968371 None] <== create_volume: return (1002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:29:03 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-10aeebce-1e66-4673-9c11-81ac92645aba tempest-VolumesActionsTest-135968371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.005s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:29:03 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-a6d3e326-7f12-4734-907a-a17222ba7c57 tempest-AttachVolumeNegativeTest-1614371178 None] Lock "cinder-b5714824-e744-4e58-ae56-e3877b97e3ea-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:29:03 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-71c846ca-fa1c-45c5-bf62-27e5d76bfb7b tempest-AttachVolumeNegativeTest-1614371178 None] Lock "cinder-quobyte-f52881f2-8a6e-47dd-b6a1-ee4679a5629a" acquired by "delete_volume" :: waited 0.033s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:29:03 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-10aeebce-1e66-4673-9c11-81ac92645aba tempest-VolumesActionsTest-135968371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5982b6a8-6d92-460e-8de6-75961660fe71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de206dcf-69b2-45f8-a32e-656828a04183', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:03 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-10aeebce-1e66-4673-9c11-81ac92645aba tempest-VolumesActionsTest-135968371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (146c8aea-3cc1-414e-bd47-1b92c44d4dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:03 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbb4e32b-7e7e-4393-b4f7-fa6c846d52d5]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:29:03 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-71c846ca-fa1c-45c5-bf62-27e5d76bfb7b tempest-AttachVolumeNegativeTest-1614371178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f52881f2-8a6e-47dd-b6a1-ee4679a5629a {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:03 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-10aeebce-1e66-4673-9c11-81ac92645aba tempest-VolumesActionsTest-135968371 None] Volume volume-de206dcf-69b2-45f8-a32e-656828a04183 (de206dcf-69b2-45f8-a32e-656828a04183): created successfully
Jul 30 20:29:03 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-10aeebce-1e66-4673-9c11-81ac92645aba tempest-VolumesActionsTest-135968371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (146c8aea-3cc1-414e-bd47-1b92c44d4dec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:03 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-10aeebce-1e66-4673-9c11-81ac92645aba tempest-VolumesActionsTest-135968371 None] Flow 'volume_create_manager' (846ec789-6ab2-40a2-9802-093e594c4bec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:29:03 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-10aeebce-1e66-4673-9c11-81ac92645aba tempest-VolumesActionsTest-135968371 None] Created volume successfully.
Jul 30 20:29:04 devstack sudo[97957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f52881f2-8a6e-47dd-b6a1-ee4679a5629a
Jul 30 20:29:04 devstack sudo[97957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:04 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-8e37a61a-eed4-43d0-a151-365d8be37d03 tempest-VolumeSnapshotQuotasNegativeTestJSON-1200704640 None] Acquiring lock "cinder-2273ac08-6274-4541-aa82-4683a2a1ea70-delete_snapshot" by "delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:29:04 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-8e37a61a-eed4-43d0-a151-365d8be37d03 tempest-VolumeSnapshotQuotasNegativeTestJSON-1200704640 None] Lock "cinder-2273ac08-6274-4541-aa82-4683a2a1ea70-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:29:04 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-8e37a61a-eed4-43d0-a151-365d8be37d03 tempest-VolumeSnapshotQuotasNegativeTestJSON-1200704640 None] Acquiring lock "cinder-quobyte-732fc9e8-f3a4-47fe-9839-af85a5e55262" by "delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:29:04 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-8e37a61a-eed4-43d0-a151-365d8be37d03 tempest-VolumeSnapshotQuotasNegativeTestJSON-1200704640 None] Lock "cinder-quobyte-732fc9e8-f3a4-47fe-9839-af85a5e55262" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:29:04 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-8e37a61a-eed4-43d0-a151-365d8be37d03 tempest-VolumeSnapshotQuotasNegativeTestJSON-1200704640 None] Acquiring lock "cinder-quobyte-2273ac08-6274-4541-aa82-4683a2a1ea70" by "_delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:29:04 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-8e37a61a-eed4-43d0-a151-365d8be37d03 tempest-VolumeSnapshotQuotasNegativeTestJSON-1200704640 None] Lock "cinder-quobyte-2273ac08-6274-4541-aa82-4683a2a1ea70" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:29:04 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-8e37a61a-eed4-43d0-a151-365d8be37d03 tempest-VolumeSnapshotQuotasNegativeTestJSON-1200704640 None] Deleting offline snapshot 2273ac08-6274-4541-aa82-4683a2a1ea70 of volume 732fc9e8-f3a4-47fe-9839-af85a5e55262 {{(pid=88719) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 30 20:29:04 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-8e37a61a-eed4-43d0-a151-365d8be37d03 tempest-VolumeSnapshotQuotasNegativeTestJSON-1200704640 None] snapshot_file for this snap is: volume-732fc9e8-f3a4-47fe-9839-af85a5e55262.2273ac08-6274-4541-aa82-4683a2a1ea70 {{(pid=88719) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 30 20:29:04 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6e50284-4529-40c9-9d43-d0b4172ab80c]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:29:04 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8e37a61a-eed4-43d0-a151-365d8be37d03 tempest-VolumeSnapshotQuotasNegativeTestJSON-1200704640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-732fc9e8-f3a4-47fe-9839-af85a5e55262.2273ac08-6274-4541-aa82-4683a2a1ea70 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:04 devstack sudo[97959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-732fc9e8-f3a4-47fe-9839-af85a5e55262.2273ac08-6274-4541-aa82-4683a2a1ea70
Jul 30 20:29:04 devstack sudo[97959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:04 devstack sudo[97957]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:04 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-71c846ca-fa1c-45c5-bf62-27e5d76bfb7b tempest-AttachVolumeNegativeTest-1614371178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f52881f2-8a6e-47dd-b6a1-ee4679a5629a" returned: 0 in 0.447s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:04 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-71c846ca-fa1c-45c5-bf62-27e5d76bfb7b tempest-AttachVolumeNegativeTest-1614371178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f52881f2-8a6e-47dd-b6a1-ee4679a5629a {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:04 devstack sudo[97966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f52881f2-8a6e-47dd-b6a1-ee4679a5629a
Jul 30 20:29:04 devstack sudo[97966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:04 devstack sudo[97966]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:04 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-71c846ca-fa1c-45c5-bf62-27e5d76bfb7b tempest-AttachVolumeNegativeTest-1614371178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f52881f2-8a6e-47dd-b6a1-ee4679a5629a" returned: 0 in 0.255s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:04 devstack sudo[97959]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:04 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-dd0f0cd4-7c98-45c6-92ae-1a1a738e4bcc tempest-VolumesActionsTest-2145718135 None] Acquiring lock "cinder-de206dcf-69b2-45f8-a32e-656828a04183-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:29:04 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8e37a61a-eed4-43d0-a151-365d8be37d03 tempest-VolumeSnapshotQuotasNegativeTestJSON-1200704640 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-732fc9e8-f3a4-47fe-9839-af85a5e55262.2273ac08-6274-4541-aa82-4683a2a1ea70" returned: 0 in 0.461s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:04 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-8e37a61a-eed4-43d0-a151-365d8be37d03 tempest-VolumeSnapshotQuotasNegativeTestJSON-1200704640 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-732fc9e8-f3a4-47fe-9839-af85a5e55262(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88719) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 30 20:29:04 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-71c846ca-fa1c-45c5-bf62-27e5d76bfb7b tempest-AttachVolumeNegativeTest-1614371178 None] Lock "cinder-quobyte-f52881f2-8a6e-47dd-b6a1-ee4679a5629a" released by "delete_volume" :: held 0.814s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:29:04 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[659513ec-aad4-4fb7-a484-d2fc61e3f12d]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:29:04 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8e37a61a-eed4-43d0-a151-365d8be37d03 tempest-VolumeSnapshotQuotasNegativeTestJSON-1200704640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-732fc9e8-f3a4-47fe-9839-af85a5e55262 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:04 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-dd0f0cd4-7c98-45c6-92ae-1a1a738e4bcc tempest-VolumesActionsTest-2145718135 None] Lock "cinder-de206dcf-69b2-45f8-a32e-656828a04183-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:29:04 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-dd0f0cd4-7c98-45c6-92ae-1a1a738e4bcc tempest-VolumesActionsTest-2145718135 None] Acquiring lock "cinder-quobyte-de206dcf-69b2-45f8-a32e-656828a04183" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:29:04 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-71c846ca-fa1c-45c5-bf62-27e5d76bfb7b tempest-AttachVolumeNegativeTest-1614371178 None] Created reservations ['9191f1b9-09bf-4063-9af7-9af95a1afb45', '9c47266a-a500-4bef-8a43-60d22569f91a', '1f78b436-55d5-406c-b652-25a85d0a9257', '3c9b4d94-2089-4837-9e78-db189a9072be'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:29:04 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-dd0f0cd4-7c98-45c6-92ae-1a1a738e4bcc tempest-VolumesActionsTest-2145718135 None] Lock "cinder-quobyte-de206dcf-69b2-45f8-a32e-656828a04183" acquired by "delete_volume" :: waited 0.037s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:29:04 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[51547a82-5748-4734-8fe5-47fb26fd9a91]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:29:04 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-dd0f0cd4-7c98-45c6-92ae-1a1a738e4bcc tempest-VolumesActionsTest-2145718135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-de206dcf-69b2-45f8-a32e-656828a04183 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:04 devstack sudo[97973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-732fc9e8-f3a4-47fe-9839-af85a5e55262
Jul 30 20:29:04 devstack sudo[97973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:04 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-71c846ca-fa1c-45c5-bf62-27e5d76bfb7b tempest-AttachVolumeNegativeTest-1614371178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:29:04 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-71c846ca-fa1c-45c5-bf62-27e5d76bfb7b tempest-AttachVolumeNegativeTest-1614371178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:29:04 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-71c846ca-fa1c-45c5-bf62-27e5d76bfb7b tempest-AttachVolumeNegativeTest-1614371178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:29:04 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-71c846ca-fa1c-45c5-bf62-27e5d76bfb7b tempest-AttachVolumeNegativeTest-1614371178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:29:04 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-71c846ca-fa1c-45c5-bf62-27e5d76bfb7b tempest-AttachVolumeNegativeTest-1614371178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:29:04 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-71c846ca-fa1c-45c5-bf62-27e5d76bfb7b tempest-AttachVolumeNegativeTest-1614371178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:05 devstack sudo[97976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:29:05 devstack sudo[97976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:05 devstack sudo[97975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-de206dcf-69b2-45f8-a32e-656828a04183
Jul 30 20:29:05 devstack sudo[97975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:05 devstack sudo[97973]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:05 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8e37a61a-eed4-43d0-a151-365d8be37d03 tempest-VolumeSnapshotQuotasNegativeTestJSON-1200704640 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-732fc9e8-f3a4-47fe-9839-af85a5e55262" returned: 0 in 0.481s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:05 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8e37a61a-eed4-43d0-a151-365d8be37d03 tempest-VolumeSnapshotQuotasNegativeTestJSON-1200704640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-732fc9e8-f3a4-47fe-9839-af85a5e55262.2273ac08-6274-4541-aa82-4683a2a1ea70 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:05 devstack sudo[97982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-732fc9e8-f3a4-47fe-9839-af85a5e55262.2273ac08-6274-4541-aa82-4683a2a1ea70
Jul 30 20:29:05 devstack sudo[97982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:05 devstack sudo[97976]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:05 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-71c846ca-fa1c-45c5-bf62-27e5d76bfb7b tempest-AttachVolumeNegativeTest-1614371178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.292s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:05 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-71c846ca-fa1c-45c5-bf62-27e5d76bfb7b tempest-AttachVolumeNegativeTest-1614371178 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:29:05 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-71c846ca-fa1c-45c5-bf62-27e5d76bfb7b tempest-AttachVolumeNegativeTest-1614371178 None] Deleted volume successfully.
Jul 30 20:29:05 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-71c846ca-fa1c-45c5-bf62-27e5d76bfb7b tempest-AttachVolumeNegativeTest-1614371178 None] Lock "cinder-f52881f2-8a6e-47dd-b6a1-ee4679a5629a-delete_volume" released by "delete_volume" :: held 1.530s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:29:05 devstack sudo[97975]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:05 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-dd0f0cd4-7c98-45c6-92ae-1a1a738e4bcc tempest-VolumesActionsTest-2145718135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-de206dcf-69b2-45f8-a32e-656828a04183" returned: 0 in 0.480s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:05 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-dd0f0cd4-7c98-45c6-92ae-1a1a738e4bcc tempest-VolumesActionsTest-2145718135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-de206dcf-69b2-45f8-a32e-656828a04183 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:05 devstack sudo[97988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-de206dcf-69b2-45f8-a32e-656828a04183
Jul 30 20:29:05 devstack sudo[97988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:05 devstack sudo[97982]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:05 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8e37a61a-eed4-43d0-a151-365d8be37d03 tempest-VolumeSnapshotQuotasNegativeTestJSON-1200704640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-732fc9e8-f3a4-47fe-9839-af85a5e55262.2273ac08-6274-4541-aa82-4683a2a1ea70" returned: 0 in 0.382s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:05 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8e37a61a-eed4-43d0-a151-365d8be37d03 tempest-VolumeSnapshotQuotasNegativeTestJSON-1200704640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-732fc9e8-f3a4-47fe-9839-af85a5e55262.2273ac08-6274-4541-aa82-4683a2a1ea70 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:05 devstack sudo[97994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-732fc9e8-f3a4-47fe-9839-af85a5e55262.2273ac08-6274-4541-aa82-4683a2a1ea70
Jul 30 20:29:05 devstack sudo[97994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:05 devstack sudo[97988]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:05 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-dd0f0cd4-7c98-45c6-92ae-1a1a738e4bcc tempest-VolumesActionsTest-2145718135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-de206dcf-69b2-45f8-a32e-656828a04183" returned: 0 in 0.288s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:05 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-dd0f0cd4-7c98-45c6-92ae-1a1a738e4bcc tempest-VolumesActionsTest-2145718135 None] Lock "cinder-quobyte-de206dcf-69b2-45f8-a32e-656828a04183" released by "delete_volume" :: held 0.831s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:29:05 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-dd0f0cd4-7c98-45c6-92ae-1a1a738e4bcc tempest-VolumesActionsTest-2145718135 None] Created reservations ['348eb3f2-516a-4a9e-92ff-d7884678a8e2', 'a44bfc46-28ec-45d5-8d63-4fce51b4c454', '7ff857f4-6ad0-431e-8b98-2ef733ffa4db', 'd379022d-83bb-4cb5-8ca6-fbe96af70b6f'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:29:05 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-dd0f0cd4-7c98-45c6-92ae-1a1a738e4bcc tempest-VolumesActionsTest-2145718135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:29:05 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-dd0f0cd4-7c98-45c6-92ae-1a1a738e4bcc tempest-VolumesActionsTest-2145718135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:29:05 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-dd0f0cd4-7c98-45c6-92ae-1a1a738e4bcc tempest-VolumesActionsTest-2145718135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:29:05 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-dd0f0cd4-7c98-45c6-92ae-1a1a738e4bcc tempest-VolumesActionsTest-2145718135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:29:05 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-dd0f0cd4-7c98-45c6-92ae-1a1a738e4bcc tempest-VolumesActionsTest-2145718135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:29:05 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-dd0f0cd4-7c98-45c6-92ae-1a1a738e4bcc tempest-VolumesActionsTest-2145718135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:05 devstack sudo[98004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:29:05 devstack sudo[98004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:05 devstack sudo[97994]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:05 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8e37a61a-eed4-43d0-a151-365d8be37d03 tempest-VolumeSnapshotQuotasNegativeTestJSON-1200704640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-732fc9e8-f3a4-47fe-9839-af85a5e55262.2273ac08-6274-4541-aa82-4683a2a1ea70" returned: 0 in 0.310s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:05 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-8e37a61a-eed4-43d0-a151-365d8be37d03 tempest-VolumeSnapshotQuotasNegativeTestJSON-1200704640 None] Lock "cinder-quobyte-2273ac08-6274-4541-aa82-4683a2a1ea70" released by "_delete_snapshot" :: held 1.803s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:29:05 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-8e37a61a-eed4-43d0-a151-365d8be37d03 tempest-VolumeSnapshotQuotasNegativeTestJSON-1200704640 None] Lock "cinder-quobyte-732fc9e8-f3a4-47fe-9839-af85a5e55262" released by "delete_snapshot" :: held 1.841s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:29:06 devstack cinder-volume[88719]: WARNING cinder.quota [None req-8e37a61a-eed4-43d0-a151-365d8be37d03 tempest-VolumeSnapshotQuotasNegativeTestJSON-1200704640 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Jul 30 20:29:06 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-8e37a61a-eed4-43d0-a151-365d8be37d03 tempest-VolumeSnapshotQuotasNegativeTestJSON-1200704640 None] Created reservations ['0d1a939c-7d8a-4172-bcfa-e0daa89fde46', '1c0ce30a-1a99-4002-bc08-3fccdc04c3a6', '0d4e29a2-e43c-49ed-bc0b-794fa4158f29', '753511d8-8ea7-4fa6-940e-cefd04b44b96'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:29:06 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-8e37a61a-eed4-43d0-a151-365d8be37d03 tempest-VolumeSnapshotQuotasNegativeTestJSON-1200704640 None] Delete snapshot completed successfully.
Jul 30 20:29:06 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-8e37a61a-eed4-43d0-a151-365d8be37d03 tempest-VolumeSnapshotQuotasNegativeTestJSON-1200704640 None] Lock "cinder-2273ac08-6274-4541-aa82-4683a2a1ea70-delete_snapshot" released by "delete_snapshot" :: held 2.104s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:29:06 devstack sudo[98004]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:06 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-dd0f0cd4-7c98-45c6-92ae-1a1a738e4bcc tempest-VolumesActionsTest-2145718135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.403s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:06 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-dd0f0cd4-7c98-45c6-92ae-1a1a738e4bcc tempest-VolumesActionsTest-2145718135 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:29:06 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-dd0f0cd4-7c98-45c6-92ae-1a1a738e4bcc tempest-VolumesActionsTest-2145718135 None] Deleted volume successfully.
Jul 30 20:29:06 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-dd0f0cd4-7c98-45c6-92ae-1a1a738e4bcc tempest-VolumesActionsTest-2145718135 None] Lock "cinder-de206dcf-69b2-45f8-a32e-656828a04183-delete_volume" released by "delete_volume" :: held 1.563s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:29:06 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-e9e7514c-b226-4823-a0fa-a78d0facba59 tempest-VolumeSnapshotQuotasNegativeTestJSON-1200704640 None] Acquiring lock "cinder-732fc9e8-f3a4-47fe-9839-af85a5e55262-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:29:06 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-e9e7514c-b226-4823-a0fa-a78d0facba59 tempest-VolumeSnapshotQuotasNegativeTestJSON-1200704640 None] Lock "cinder-732fc9e8-f3a4-47fe-9839-af85a5e55262-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:29:06 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a44b18b-32fe-4449-94a3-d1e6c12e46c2 tempest-VolumesActionsTest-135968371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:29:06 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-7a44b18b-32fe-4449-94a3-d1e6c12e46c2 tempest-VolumesActionsTest-135968371 None] Flow 'volume_create_manager' (a67aab65-44c1-4cf8-8fd0-657d59c550df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:29:06 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-7a44b18b-32fe-4449-94a3-d1e6c12e46c2 tempest-VolumesActionsTest-135968371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50ea7efa-ba56-4a45-9f06-7b4e11a9005f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:06 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-e9e7514c-b226-4823-a0fa-a78d0facba59 tempest-VolumeSnapshotQuotasNegativeTestJSON-1200704640 None] Acquiring lock "cinder-quobyte-732fc9e8-f3a4-47fe-9839-af85a5e55262" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:29:06 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-7a44b18b-32fe-4449-94a3-d1e6c12e46c2 tempest-VolumesActionsTest-135968371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50ea7efa-ba56-4a45-9f06-7b4e11a9005f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:29:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1040611455',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54410390-9276-4d90-ae41-9fa5caf0a7bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d5498700a384a6db5a774609f5b251a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:29:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:29:06Z,use_quota=True,user_id='785d5df48e1340b185bfa9fa0913e1a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:06 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-7a44b18b-32fe-4449-94a3-d1e6c12e46c2 tempest-VolumesActionsTest-135968371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02cbfb70-29c0-4932-a061-578382ed3df6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:06 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-7a44b18b-32fe-4449-94a3-d1e6c12e46c2 tempest-VolumesActionsTest-135968371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02cbfb70-29c0-4932-a061-578382ed3df6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:06 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-7a44b18b-32fe-4449-94a3-d1e6c12e46c2 tempest-VolumesActionsTest-135968371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8b089cc-b48f-416a-ad4c-91a4678babc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:06 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-7a44b18b-32fe-4449-94a3-d1e6c12e46c2 tempest-VolumesActionsTest-135968371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8b089cc-b48f-416a-ad4c-91a4678babc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54410390-9276-4d90-ae41-9fa5caf0a7bb', 'volume_name': 'volume-54410390-9276-4d90-ae41-9fa5caf0a7bb', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:06 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-7a44b18b-32fe-4449-94a3-d1e6c12e46c2 tempest-VolumesActionsTest-135968371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abd7e33a-4c82-4147-9506-e096c6ea5d98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:06 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-7a44b18b-32fe-4449-94a3-d1e6c12e46c2 tempest-VolumesActionsTest-135968371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abd7e33a-4c82-4147-9506-e096c6ea5d98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:06 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-7a44b18b-32fe-4449-94a3-d1e6c12e46c2 tempest-VolumesActionsTest-135968371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (550f36d4-6f43-4df6-bc82-b6456ac9f485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:06 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-7a44b18b-32fe-4449-94a3-d1e6c12e46c2 tempest-VolumesActionsTest-135968371 None] Volume 54410390-9276-4d90-ae41-9fa5caf0a7bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54410390-9276-4d90-ae41-9fa5caf0a7bb', 'volume_size': 1}
Jul 30 20:29:06 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-7a44b18b-32fe-4449-94a3-d1e6c12e46c2 tempest-VolumesActionsTest-135968371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:29:06 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-7a44b18b-32fe-4449-94a3-d1e6c12e46c2 tempest-VolumesActionsTest-135968371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:29:06 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-7a44b18b-32fe-4449-94a3-d1e6c12e46c2 tempest-VolumesActionsTest-135968371 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:29:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1040611455',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54410390-9276-4d90-ae41-9fa5caf0a7bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d5498700a384a6db5a774609f5b251a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:29:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:29:06Z,use_quota=True,user_id='785d5df48e1340b185bfa9fa0913e1a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:29:06 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-7a44b18b-32fe-4449-94a3-d1e6c12e46c2 tempest-VolumesActionsTest-135968371 None] Creating volume 54410390-9276-4d90-ae41-9fa5caf0a7bb {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:29:06 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-7a44b18b-32fe-4449-94a3-d1e6c12e46c2 tempest-VolumesActionsTest-135968371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:29:06 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-7a44b18b-32fe-4449-94a3-d1e6c12e46c2 tempest-VolumesActionsTest-135968371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:29:06 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-7a44b18b-32fe-4449-94a3-d1e6c12e46c2 tempest-VolumesActionsTest-135968371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:29:06 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-7a44b18b-32fe-4449-94a3-d1e6c12e46c2 tempest-VolumesActionsTest-135968371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:29:06 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-7a44b18b-32fe-4449-94a3-d1e6c12e46c2 tempest-VolumesActionsTest-135968371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:29:06 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-7a44b18b-32fe-4449-94a3-d1e6c12e46c2 tempest-VolumesActionsTest-135968371 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:29:06 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-7a44b18b-32fe-4449-94a3-d1e6c12e46c2 tempest-VolumesActionsTest-135968371 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:29:06 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-7a44b18b-32fe-4449-94a3-d1e6c12e46c2 tempest-VolumesActionsTest-135968371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-54410390-9276-4d90-ae41-9fa5caf0a7bb 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:06 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-e9e7514c-b226-4823-a0fa-a78d0facba59 tempest-VolumeSnapshotQuotasNegativeTestJSON-1200704640 None] Lock "cinder-quobyte-732fc9e8-f3a4-47fe-9839-af85a5e55262" acquired by "delete_volume" :: waited 0.089s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:29:06 devstack sudo[98007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-54410390-9276-4d90-ae41-9fa5caf0a7bb 1073741824
Jul 30 20:29:06 devstack sudo[98007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:06 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b700e53-7be0-4baa-b2db-601f7f6b3e67]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:29:06 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-e9e7514c-b226-4823-a0fa-a78d0facba59 tempest-VolumeSnapshotQuotasNegativeTestJSON-1200704640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-732fc9e8-f3a4-47fe-9839-af85a5e55262 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:06 devstack sudo[98009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-732fc9e8-f3a4-47fe-9839-af85a5e55262
Jul 30 20:29:06 devstack sudo[98009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:07 devstack sudo[98007]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:07 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-7a44b18b-32fe-4449-94a3-d1e6c12e46c2 tempest-VolumesActionsTest-135968371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-54410390-9276-4d90-ae41-9fa5caf0a7bb 1073741824" returned: 0 in 0.564s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:07 devstack sudo[98009]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:07 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-e9e7514c-b226-4823-a0fa-a78d0facba59 tempest-VolumeSnapshotQuotasNegativeTestJSON-1200704640 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-732fc9e8-f3a4-47fe-9839-af85a5e55262" returned: 0 in 0.485s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:07 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-e9e7514c-b226-4823-a0fa-a78d0facba59 tempest-VolumeSnapshotQuotasNegativeTestJSON-1200704640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-732fc9e8-f3a4-47fe-9839-af85a5e55262 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:07 devstack sudo[98018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-732fc9e8-f3a4-47fe-9839-af85a5e55262
Jul 30 20:29:07 devstack sudo[98018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:07 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-7a44b18b-32fe-4449-94a3-d1e6c12e46c2 tempest-VolumesActionsTest-135968371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-54410390-9276-4d90-ae41-9fa5caf0a7bb {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:07 devstack sudo[98020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-54410390-9276-4d90-ae41-9fa5caf0a7bb
Jul 30 20:29:07 devstack sudo[98020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:07 devstack sudo[98020]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:07 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-7a44b18b-32fe-4449-94a3-d1e6c12e46c2 tempest-VolumesActionsTest-135968371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-54410390-9276-4d90-ae41-9fa5caf0a7bb" returned: 0 in 0.304s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:07 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-7a44b18b-32fe-4449-94a3-d1e6c12e46c2 tempest-VolumesActionsTest-135968371 None] <== create_volume: return (937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:29:07 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-7a44b18b-32fe-4449-94a3-d1e6c12e46c2 tempest-VolumesActionsTest-135968371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:29:07 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-7a44b18b-32fe-4449-94a3-d1e6c12e46c2 tempest-VolumesActionsTest-135968371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (550f36d4-6f43-4df6-bc82-b6456ac9f485) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54410390-9276-4d90-ae41-9fa5caf0a7bb', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:07 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-7a44b18b-32fe-4449-94a3-d1e6c12e46c2 tempest-VolumesActionsTest-135968371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9ffd4ce-f9e6-4a03-b71a-a3cbf7621d5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:07 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-7a44b18b-32fe-4449-94a3-d1e6c12e46c2 tempest-VolumesActionsTest-135968371 None] Volume volume-54410390-9276-4d90-ae41-9fa5caf0a7bb (54410390-9276-4d90-ae41-9fa5caf0a7bb): created successfully
Jul 30 20:29:07 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-7a44b18b-32fe-4449-94a3-d1e6c12e46c2 tempest-VolumesActionsTest-135968371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9ffd4ce-f9e6-4a03-b71a-a3cbf7621d5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:07 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-7a44b18b-32fe-4449-94a3-d1e6c12e46c2 tempest-VolumesActionsTest-135968371 None] Flow 'volume_create_manager' (a67aab65-44c1-4cf8-8fd0-657d59c550df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:29:07 devstack sudo[98018]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:07 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-e9e7514c-b226-4823-a0fa-a78d0facba59 tempest-VolumeSnapshotQuotasNegativeTestJSON-1200704640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-732fc9e8-f3a4-47fe-9839-af85a5e55262" returned: 0 in 0.414s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:07 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-7a44b18b-32fe-4449-94a3-d1e6c12e46c2 tempest-VolumesActionsTest-135968371 None] Created volume successfully.
Jul 30 20:29:07 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-e9e7514c-b226-4823-a0fa-a78d0facba59 tempest-VolumeSnapshotQuotasNegativeTestJSON-1200704640 None] Lock "cinder-quobyte-732fc9e8-f3a4-47fe-9839-af85a5e55262" released by "delete_volume" :: held 1.001s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:29:07 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-e9e7514c-b226-4823-a0fa-a78d0facba59 tempest-VolumeSnapshotQuotasNegativeTestJSON-1200704640 None] Created reservations ['7903150f-ccde-443f-a2d4-538732f9e92e', 'ea0986db-6e9f-4a9c-9d06-d9f1905190b1', 'bb5a46b8-68e0-4aca-b5d2-00d6764c37ac', '85276b9e-9be5-4ef8-a543-adab84777718'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:29:07 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-e9e7514c-b226-4823-a0fa-a78d0facba59 tempest-VolumeSnapshotQuotasNegativeTestJSON-1200704640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:29:07 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-e9e7514c-b226-4823-a0fa-a78d0facba59 tempest-VolumeSnapshotQuotasNegativeTestJSON-1200704640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:29:07 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-e9e7514c-b226-4823-a0fa-a78d0facba59 tempest-VolumeSnapshotQuotasNegativeTestJSON-1200704640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:29:07 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-e9e7514c-b226-4823-a0fa-a78d0facba59 tempest-VolumeSnapshotQuotasNegativeTestJSON-1200704640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:29:07 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-e9e7514c-b226-4823-a0fa-a78d0facba59 tempest-VolumeSnapshotQuotasNegativeTestJSON-1200704640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:29:07 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-e9e7514c-b226-4823-a0fa-a78d0facba59 tempest-VolumeSnapshotQuotasNegativeTestJSON-1200704640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:07 devstack sudo[98025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:29:07 devstack sudo[98025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:08 devstack sudo[98025]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:08 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-e9e7514c-b226-4823-a0fa-a78d0facba59 tempest-VolumeSnapshotQuotasNegativeTestJSON-1200704640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.312s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:08 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-e9e7514c-b226-4823-a0fa-a78d0facba59 tempest-VolumeSnapshotQuotasNegativeTestJSON-1200704640 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:29:08 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-e9e7514c-b226-4823-a0fa-a78d0facba59 tempest-VolumeSnapshotQuotasNegativeTestJSON-1200704640 None] Deleted volume successfully.
Jul 30 20:29:08 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-e9e7514c-b226-4823-a0fa-a78d0facba59 tempest-VolumeSnapshotQuotasNegativeTestJSON-1200704640 None] Lock "cinder-732fc9e8-f3a4-47fe-9839-af85a5e55262-delete_volume" released by "delete_volume" :: held 1.671s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:29:08 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-88ea154f-652c-4396-8b0e-df5970b12c7c tempest-VolumeQuotasAdminTestJSON-1889720093 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:29:08 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-88ea154f-652c-4396-8b0e-df5970b12c7c tempest-VolumeQuotasAdminTestJSON-1889720093 None] Flow 'volume_create_manager' (e048b6cf-b735-44ff-8ec2-a851c75ee8a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:29:08 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-88ea154f-652c-4396-8b0e-df5970b12c7c tempest-VolumeQuotasAdminTestJSON-1889720093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a0f94e0-db66-471c-9784-018047c91c90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:08 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-88ea154f-652c-4396-8b0e-df5970b12c7c tempest-VolumeQuotasAdminTestJSON-1889720093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a0f94e0-db66-471c-9784-018047c91c90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:29:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-649951703',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c55c6d0-979a-4a35-9e12-120eb044d690,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2498502d208e423cb475c2cf5b58ac65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:29:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:29:08Z,use_quota=True,user_id='072d359c8ccd4de1bc2ae51497eb60b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:08 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-88ea154f-652c-4396-8b0e-df5970b12c7c tempest-VolumeQuotasAdminTestJSON-1889720093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a873e09a-06f1-4f7d-aeef-8f027295e0ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:08 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-88ea154f-652c-4396-8b0e-df5970b12c7c tempest-VolumeQuotasAdminTestJSON-1889720093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a873e09a-06f1-4f7d-aeef-8f027295e0ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:08 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-88ea154f-652c-4396-8b0e-df5970b12c7c tempest-VolumeQuotasAdminTestJSON-1889720093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de2ddce6-bd09-4fba-bd3b-f21110ed1db8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:08 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-88ea154f-652c-4396-8b0e-df5970b12c7c tempest-VolumeQuotasAdminTestJSON-1889720093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de2ddce6-bd09-4fba-bd3b-f21110ed1db8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c55c6d0-979a-4a35-9e12-120eb044d690', 'volume_name': 'volume-0c55c6d0-979a-4a35-9e12-120eb044d690', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:08 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-88ea154f-652c-4396-8b0e-df5970b12c7c tempest-VolumeQuotasAdminTestJSON-1889720093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04ab7043-e851-4abc-a0b9-7c7ab442364f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:08 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-88ea154f-652c-4396-8b0e-df5970b12c7c tempest-VolumeQuotasAdminTestJSON-1889720093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04ab7043-e851-4abc-a0b9-7c7ab442364f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:08 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-88ea154f-652c-4396-8b0e-df5970b12c7c tempest-VolumeQuotasAdminTestJSON-1889720093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dee6a09-65e6-4a66-8909-62fdcdacfed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:08 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-88ea154f-652c-4396-8b0e-df5970b12c7c tempest-VolumeQuotasAdminTestJSON-1889720093 None] Volume 0c55c6d0-979a-4a35-9e12-120eb044d690: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c55c6d0-979a-4a35-9e12-120eb044d690', 'volume_size': 1}
Jul 30 20:29:08 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-88ea154f-652c-4396-8b0e-df5970b12c7c tempest-VolumeQuotasAdminTestJSON-1889720093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:29:08 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-88ea154f-652c-4396-8b0e-df5970b12c7c tempest-VolumeQuotasAdminTestJSON-1889720093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:29:08 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-88ea154f-652c-4396-8b0e-df5970b12c7c tempest-VolumeQuotasAdminTestJSON-1889720093 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:29:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-649951703',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c55c6d0-979a-4a35-9e12-120eb044d690,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2498502d208e423cb475c2cf5b58ac65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:29:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:29:08Z,use_quota=True,user_id='072d359c8ccd4de1bc2ae51497eb60b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:29:08 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-88ea154f-652c-4396-8b0e-df5970b12c7c tempest-VolumeQuotasAdminTestJSON-1889720093 None] Creating volume 0c55c6d0-979a-4a35-9e12-120eb044d690 {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:29:08 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-88ea154f-652c-4396-8b0e-df5970b12c7c tempest-VolumeQuotasAdminTestJSON-1889720093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:29:08 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-88ea154f-652c-4396-8b0e-df5970b12c7c tempest-VolumeQuotasAdminTestJSON-1889720093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:29:08 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-88ea154f-652c-4396-8b0e-df5970b12c7c tempest-VolumeQuotasAdminTestJSON-1889720093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:29:08 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-88ea154f-652c-4396-8b0e-df5970b12c7c tempest-VolumeQuotasAdminTestJSON-1889720093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:29:08 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-88ea154f-652c-4396-8b0e-df5970b12c7c tempest-VolumeQuotasAdminTestJSON-1889720093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:29:08 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-88ea154f-652c-4396-8b0e-df5970b12c7c tempest-VolumeQuotasAdminTestJSON-1889720093 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:29:08 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-88ea154f-652c-4396-8b0e-df5970b12c7c tempest-VolumeQuotasAdminTestJSON-1889720093 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:29:08 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-88ea154f-652c-4396-8b0e-df5970b12c7c tempest-VolumeQuotasAdminTestJSON-1889720093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0c55c6d0-979a-4a35-9e12-120eb044d690 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:08 devstack sudo[98028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0c55c6d0-979a-4a35-9e12-120eb044d690 1073741824
Jul 30 20:29:08 devstack sudo[98028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:08 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-6aa45c72-f22b-43ef-a7f3-01ef6ad4f617 tempest-VolumesActionsTest-2145718135 None] Acquiring lock "cinder-54410390-9276-4d90-ae41-9fa5caf0a7bb-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:29:08 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-6aa45c72-f22b-43ef-a7f3-01ef6ad4f617 tempest-VolumesActionsTest-2145718135 None] Lock "cinder-54410390-9276-4d90-ae41-9fa5caf0a7bb-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:29:08 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-6aa45c72-f22b-43ef-a7f3-01ef6ad4f617 tempest-VolumesActionsTest-2145718135 None] Acquiring lock "cinder-quobyte-54410390-9276-4d90-ae41-9fa5caf0a7bb" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:29:08 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-6aa45c72-f22b-43ef-a7f3-01ef6ad4f617 tempest-VolumesActionsTest-2145718135 None] Lock "cinder-quobyte-54410390-9276-4d90-ae41-9fa5caf0a7bb" acquired by "delete_volume" :: waited 0.020s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:29:08 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e4d0804-2ab2-487c-b091-bf04d65a9abc]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:29:08 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-6aa45c72-f22b-43ef-a7f3-01ef6ad4f617 tempest-VolumesActionsTest-2145718135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-54410390-9276-4d90-ae41-9fa5caf0a7bb {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:09 devstack sudo[98034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-54410390-9276-4d90-ae41-9fa5caf0a7bb
Jul 30 20:29:09 devstack sudo[98034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:09 devstack sudo[98028]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:09 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-88ea154f-652c-4396-8b0e-df5970b12c7c tempest-VolumeQuotasAdminTestJSON-1889720093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0c55c6d0-979a-4a35-9e12-120eb044d690 1073741824" returned: 0 in 0.621s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:09 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-88ea154f-652c-4396-8b0e-df5970b12c7c tempest-VolumeQuotasAdminTestJSON-1889720093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0c55c6d0-979a-4a35-9e12-120eb044d690 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:09 devstack sudo[98037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0c55c6d0-979a-4a35-9e12-120eb044d690
Jul 30 20:29:09 devstack sudo[98037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:09 devstack sudo[98034]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:09 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-6aa45c72-f22b-43ef-a7f3-01ef6ad4f617 tempest-VolumesActionsTest-2145718135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-54410390-9276-4d90-ae41-9fa5caf0a7bb" returned: 0 in 0.480s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:09 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-6aa45c72-f22b-43ef-a7f3-01ef6ad4f617 tempest-VolumesActionsTest-2145718135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-54410390-9276-4d90-ae41-9fa5caf0a7bb {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:09 devstack sudo[98042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-54410390-9276-4d90-ae41-9fa5caf0a7bb
Jul 30 20:29:09 devstack sudo[98042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:09 devstack sudo[98037]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:09 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-88ea154f-652c-4396-8b0e-df5970b12c7c tempest-VolumeQuotasAdminTestJSON-1889720093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0c55c6d0-979a-4a35-9e12-120eb044d690" returned: 0 in 0.391s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:09 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-88ea154f-652c-4396-8b0e-df5970b12c7c tempest-VolumeQuotasAdminTestJSON-1889720093 None] <== create_volume: return (1062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:29:09 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-88ea154f-652c-4396-8b0e-df5970b12c7c tempest-VolumeQuotasAdminTestJSON-1889720093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.065s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:29:09 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-88ea154f-652c-4396-8b0e-df5970b12c7c tempest-VolumeQuotasAdminTestJSON-1889720093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dee6a09-65e6-4a66-8909-62fdcdacfed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c55c6d0-979a-4a35-9e12-120eb044d690', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:09 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-88ea154f-652c-4396-8b0e-df5970b12c7c tempest-VolumeQuotasAdminTestJSON-1889720093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4033f938-a3aa-42d8-a69b-760804683cb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:09 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-88ea154f-652c-4396-8b0e-df5970b12c7c tempest-VolumeQuotasAdminTestJSON-1889720093 None] Volume volume-0c55c6d0-979a-4a35-9e12-120eb044d690 (0c55c6d0-979a-4a35-9e12-120eb044d690): created successfully
Jul 30 20:29:09 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-88ea154f-652c-4396-8b0e-df5970b12c7c tempest-VolumeQuotasAdminTestJSON-1889720093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4033f938-a3aa-42d8-a69b-760804683cb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:09 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-88ea154f-652c-4396-8b0e-df5970b12c7c tempest-VolumeQuotasAdminTestJSON-1889720093 None] Flow 'volume_create_manager' (e048b6cf-b735-44ff-8ec2-a851c75ee8a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:29:09 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-88ea154f-652c-4396-8b0e-df5970b12c7c tempest-VolumeQuotasAdminTestJSON-1889720093 None] Created volume successfully.
Jul 30 20:29:09 devstack sudo[98042]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:09 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-6aa45c72-f22b-43ef-a7f3-01ef6ad4f617 tempest-VolumesActionsTest-2145718135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-54410390-9276-4d90-ae41-9fa5caf0a7bb" returned: 0 in 0.324s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:09 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-6aa45c72-f22b-43ef-a7f3-01ef6ad4f617 tempest-VolumesActionsTest-2145718135 None] Lock "cinder-quobyte-54410390-9276-4d90-ae41-9fa5caf0a7bb" released by "delete_volume" :: held 0.875s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:29:09 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-6aa45c72-f22b-43ef-a7f3-01ef6ad4f617 tempest-VolumesActionsTest-2145718135 None] Created reservations ['78aaafa8-9cc0-4799-a375-cd6fc488adfd', '33fea628-3c30-4123-999b-ca7c2d11ae91', 'c38b3154-be43-4564-b5db-69a717774ca1', '4f398907-efe5-445d-9972-03892564d6a3'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:29:09 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-6aa45c72-f22b-43ef-a7f3-01ef6ad4f617 tempest-VolumesActionsTest-2145718135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:29:09 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-6aa45c72-f22b-43ef-a7f3-01ef6ad4f617 tempest-VolumesActionsTest-2145718135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:29:09 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-6aa45c72-f22b-43ef-a7f3-01ef6ad4f617 tempest-VolumesActionsTest-2145718135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:29:09 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-6aa45c72-f22b-43ef-a7f3-01ef6ad4f617 tempest-VolumesActionsTest-2145718135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:29:09 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-6aa45c72-f22b-43ef-a7f3-01ef6ad4f617 tempest-VolumesActionsTest-2145718135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:29:09 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-6aa45c72-f22b-43ef-a7f3-01ef6ad4f617 tempest-VolumesActionsTest-2145718135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:09 devstack sudo[98046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:29:09 devstack sudo[98046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:10 devstack sudo[98046]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:10 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-6aa45c72-f22b-43ef-a7f3-01ef6ad4f617 tempest-VolumesActionsTest-2145718135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.266s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:10 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-6aa45c72-f22b-43ef-a7f3-01ef6ad4f617 tempest-VolumesActionsTest-2145718135 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:29:10 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-6aa45c72-f22b-43ef-a7f3-01ef6ad4f617 tempest-VolumesActionsTest-2145718135 None] Deleted volume successfully.
Jul 30 20:29:10 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-6aa45c72-f22b-43ef-a7f3-01ef6ad4f617 tempest-VolumesActionsTest-2145718135 None] Lock "cinder-54410390-9276-4d90-ae41-9fa5caf0a7bb-delete_volume" released by "delete_volume" :: held 1.474s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:29:10 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-eaf04223-bc97-4900-9fb9-84747384b8a8 tempest-VolumeQuotasAdminTestJSON-1889720093 None] Acquiring lock "cinder-0c55c6d0-979a-4a35-9e12-120eb044d690-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:29:10 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-96708c60-5452-4f47-9eaf-2d71934950ca tempest-VolumesActionsTest-135968371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:29:10 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-96708c60-5452-4f47-9eaf-2d71934950ca tempest-VolumesActionsTest-135968371 None] Flow 'volume_create_manager' (308cc9b5-7781-43b9-b684-4ab0a215cd13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:29:10 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-96708c60-5452-4f47-9eaf-2d71934950ca tempest-VolumesActionsTest-135968371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65a34d17-c056-4dad-bf15-cbbf2abf34af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:10 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-96708c60-5452-4f47-9eaf-2d71934950ca tempest-VolumesActionsTest-135968371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65a34d17-c056-4dad-bf15-cbbf2abf34af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:29:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-417456039',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12efd5aa-da4e-4300-a3f1-bc8cea598e88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d5498700a384a6db5a774609f5b251a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:29:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:29:11Z,use_quota=True,user_id='785d5df48e1340b185bfa9fa0913e1a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:10 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-96708c60-5452-4f47-9eaf-2d71934950ca tempest-VolumesActionsTest-135968371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbd57f34-81b7-4091-9078-1b8593958e85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:10 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-96708c60-5452-4f47-9eaf-2d71934950ca tempest-VolumesActionsTest-135968371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbd57f34-81b7-4091-9078-1b8593958e85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:10 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-96708c60-5452-4f47-9eaf-2d71934950ca tempest-VolumesActionsTest-135968371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86d6a1bd-a0cb-4932-af4b-5d2f6d68238a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:10 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-96708c60-5452-4f47-9eaf-2d71934950ca tempest-VolumesActionsTest-135968371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86d6a1bd-a0cb-4932-af4b-5d2f6d68238a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12efd5aa-da4e-4300-a3f1-bc8cea598e88', 'volume_name': 'volume-12efd5aa-da4e-4300-a3f1-bc8cea598e88', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:10 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-96708c60-5452-4f47-9eaf-2d71934950ca tempest-VolumesActionsTest-135968371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ba8a07a-a23e-4e87-b6c1-d1764bb989ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:10 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-96708c60-5452-4f47-9eaf-2d71934950ca tempest-VolumesActionsTest-135968371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ba8a07a-a23e-4e87-b6c1-d1764bb989ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:10 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-96708c60-5452-4f47-9eaf-2d71934950ca tempest-VolumesActionsTest-135968371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60ab56e5-51ca-416f-924a-15561ead4ea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:10 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-96708c60-5452-4f47-9eaf-2d71934950ca tempest-VolumesActionsTest-135968371 None] Volume 12efd5aa-da4e-4300-a3f1-bc8cea598e88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12efd5aa-da4e-4300-a3f1-bc8cea598e88', 'volume_size': 1}
Jul 30 20:29:10 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-96708c60-5452-4f47-9eaf-2d71934950ca tempest-VolumesActionsTest-135968371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:29:10 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-96708c60-5452-4f47-9eaf-2d71934950ca tempest-VolumesActionsTest-135968371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:29:10 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-96708c60-5452-4f47-9eaf-2d71934950ca tempest-VolumesActionsTest-135968371 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:29:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-417456039',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12efd5aa-da4e-4300-a3f1-bc8cea598e88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d5498700a384a6db5a774609f5b251a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:29:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:29:11Z,use_quota=True,user_id='785d5df48e1340b185bfa9fa0913e1a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:29:10 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-96708c60-5452-4f47-9eaf-2d71934950ca tempest-VolumesActionsTest-135968371 None] Creating volume 12efd5aa-da4e-4300-a3f1-bc8cea598e88 {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:29:10 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-96708c60-5452-4f47-9eaf-2d71934950ca tempest-VolumesActionsTest-135968371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:29:10 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-96708c60-5452-4f47-9eaf-2d71934950ca tempest-VolumesActionsTest-135968371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:29:10 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-96708c60-5452-4f47-9eaf-2d71934950ca tempest-VolumesActionsTest-135968371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:29:10 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-96708c60-5452-4f47-9eaf-2d71934950ca tempest-VolumesActionsTest-135968371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:29:10 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-96708c60-5452-4f47-9eaf-2d71934950ca tempest-VolumesActionsTest-135968371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:29:10 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-96708c60-5452-4f47-9eaf-2d71934950ca tempest-VolumesActionsTest-135968371 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:29:10 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-96708c60-5452-4f47-9eaf-2d71934950ca tempest-VolumesActionsTest-135968371 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:29:10 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-96708c60-5452-4f47-9eaf-2d71934950ca tempest-VolumesActionsTest-135968371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-12efd5aa-da4e-4300-a3f1-bc8cea598e88 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:10 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-eaf04223-bc97-4900-9fb9-84747384b8a8 tempest-VolumeQuotasAdminTestJSON-1889720093 None] Lock "cinder-0c55c6d0-979a-4a35-9e12-120eb044d690-delete_volume" acquired by "delete_volume" :: waited 0.138s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:29:10 devstack sudo[98051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-12efd5aa-da4e-4300-a3f1-bc8cea598e88 1073741824
Jul 30 20:29:10 devstack sudo[98051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:10 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-eaf04223-bc97-4900-9fb9-84747384b8a8 tempest-VolumeQuotasAdminTestJSON-1889720093 None] Acquiring lock "cinder-quobyte-0c55c6d0-979a-4a35-9e12-120eb044d690" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:29:10 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-eaf04223-bc97-4900-9fb9-84747384b8a8 tempest-VolumeQuotasAdminTestJSON-1889720093 None] Lock "cinder-quobyte-0c55c6d0-979a-4a35-9e12-120eb044d690" acquired by "delete_volume" :: waited 0.021s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:29:10 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[17b6e35a-a83a-4650-8e42-e5fbac57ed9f]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:29:10 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-eaf04223-bc97-4900-9fb9-84747384b8a8 tempest-VolumeQuotasAdminTestJSON-1889720093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0c55c6d0-979a-4a35-9e12-120eb044d690 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:11 devstack sudo[98053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0c55c6d0-979a-4a35-9e12-120eb044d690
Jul 30 20:29:11 devstack sudo[98053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:11 devstack sudo[98051]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:11 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-96708c60-5452-4f47-9eaf-2d71934950ca tempest-VolumesActionsTest-135968371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-12efd5aa-da4e-4300-a3f1-bc8cea598e88 1073741824" returned: 0 in 0.544s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:11 devstack sudo[98053]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:11 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-eaf04223-bc97-4900-9fb9-84747384b8a8 tempest-VolumeQuotasAdminTestJSON-1889720093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0c55c6d0-979a-4a35-9e12-120eb044d690" returned: 0 in 0.455s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:11 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-eaf04223-bc97-4900-9fb9-84747384b8a8 tempest-VolumeQuotasAdminTestJSON-1889720093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0c55c6d0-979a-4a35-9e12-120eb044d690 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:11 devstack sudo[98062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0c55c6d0-979a-4a35-9e12-120eb044d690
Jul 30 20:29:11 devstack sudo[98062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:11 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-96708c60-5452-4f47-9eaf-2d71934950ca tempest-VolumesActionsTest-135968371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-12efd5aa-da4e-4300-a3f1-bc8cea598e88 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:11 devstack sudo[98064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-12efd5aa-da4e-4300-a3f1-bc8cea598e88
Jul 30 20:29:11 devstack sudo[98064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:11 devstack sudo[98062]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:11 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-eaf04223-bc97-4900-9fb9-84747384b8a8 tempest-VolumeQuotasAdminTestJSON-1889720093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0c55c6d0-979a-4a35-9e12-120eb044d690" returned: 0 in 0.319s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:11 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-eaf04223-bc97-4900-9fb9-84747384b8a8 tempest-VolumeQuotasAdminTestJSON-1889720093 None] Lock "cinder-quobyte-0c55c6d0-979a-4a35-9e12-120eb044d690" released by "delete_volume" :: held 0.831s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:29:11 devstack sudo[98064]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:11 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-96708c60-5452-4f47-9eaf-2d71934950ca tempest-VolumesActionsTest-135968371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-12efd5aa-da4e-4300-a3f1-bc8cea598e88" returned: 0 in 0.298s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:11 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-96708c60-5452-4f47-9eaf-2d71934950ca tempest-VolumesActionsTest-135968371 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:29:11 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-96708c60-5452-4f47-9eaf-2d71934950ca tempest-VolumesActionsTest-135968371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:29:11 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-96708c60-5452-4f47-9eaf-2d71934950ca tempest-VolumesActionsTest-135968371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60ab56e5-51ca-416f-924a-15561ead4ea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12efd5aa-da4e-4300-a3f1-bc8cea598e88', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:11 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-96708c60-5452-4f47-9eaf-2d71934950ca tempest-VolumesActionsTest-135968371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (325d5e5e-846d-4919-8c9b-bd5049d820ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:11 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-96708c60-5452-4f47-9eaf-2d71934950ca tempest-VolumesActionsTest-135968371 None] Volume volume-12efd5aa-da4e-4300-a3f1-bc8cea598e88 (12efd5aa-da4e-4300-a3f1-bc8cea598e88): created successfully
Jul 30 20:29:11 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-96708c60-5452-4f47-9eaf-2d71934950ca tempest-VolumesActionsTest-135968371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (325d5e5e-846d-4919-8c9b-bd5049d820ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:11 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-96708c60-5452-4f47-9eaf-2d71934950ca tempest-VolumesActionsTest-135968371 None] Flow 'volume_create_manager' (308cc9b5-7781-43b9-b684-4ab0a215cd13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:29:11 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-96708c60-5452-4f47-9eaf-2d71934950ca tempest-VolumesActionsTest-135968371 None] Created volume successfully.
Jul 30 20:29:11 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-eaf04223-bc97-4900-9fb9-84747384b8a8 tempest-VolumeQuotasAdminTestJSON-1889720093 None] Created reservations ['7ce74f0e-d3cc-4e84-9f26-e0b5a758646a', '9c4069b7-a175-43b6-8612-94f54958e73c', 'b23d8826-9d72-4919-9c11-f2d3f70d18e8', '6a262b44-c100-4a99-888a-955317e99442'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:29:11 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-eaf04223-bc97-4900-9fb9-84747384b8a8 tempest-VolumeQuotasAdminTestJSON-1889720093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:29:11 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-eaf04223-bc97-4900-9fb9-84747384b8a8 tempest-VolumeQuotasAdminTestJSON-1889720093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:29:11 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-eaf04223-bc97-4900-9fb9-84747384b8a8 tempest-VolumeQuotasAdminTestJSON-1889720093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:29:11 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-eaf04223-bc97-4900-9fb9-84747384b8a8 tempest-VolumeQuotasAdminTestJSON-1889720093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:29:11 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-eaf04223-bc97-4900-9fb9-84747384b8a8 tempest-VolumeQuotasAdminTestJSON-1889720093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:29:11 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-eaf04223-bc97-4900-9fb9-84747384b8a8 tempest-VolumeQuotasAdminTestJSON-1889720093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:11 devstack sudo[98068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:29:11 devstack sudo[98068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:12 devstack sudo[98068]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:12 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-eaf04223-bc97-4900-9fb9-84747384b8a8 tempest-VolumeQuotasAdminTestJSON-1889720093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.265s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:12 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-eaf04223-bc97-4900-9fb9-84747384b8a8 tempest-VolumeQuotasAdminTestJSON-1889720093 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:29:12 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-eaf04223-bc97-4900-9fb9-84747384b8a8 tempest-VolumeQuotasAdminTestJSON-1889720093 None] Deleted volume successfully.
Jul 30 20:29:12 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-eaf04223-bc97-4900-9fb9-84747384b8a8 tempest-VolumeQuotasAdminTestJSON-1889720093 None] Lock "cinder-0c55c6d0-979a-4a35-9e12-120eb044d690-delete_volume" released by "delete_volume" :: held 1.375s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:29:12 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-db17e669-1a16-47cb-8473-2ce84f7ae3ae tempest-VolumesActionsTest-2145718135 None] Acquiring lock "cinder-12efd5aa-da4e-4300-a3f1-bc8cea598e88-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:29:12 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-db17e669-1a16-47cb-8473-2ce84f7ae3ae tempest-VolumesActionsTest-2145718135 None] Lock "cinder-12efd5aa-da4e-4300-a3f1-bc8cea598e88-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:29:12 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-db17e669-1a16-47cb-8473-2ce84f7ae3ae tempest-VolumesActionsTest-2145718135 None] Acquiring lock "cinder-quobyte-12efd5aa-da4e-4300-a3f1-bc8cea598e88" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:29:12 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-db17e669-1a16-47cb-8473-2ce84f7ae3ae tempest-VolumesActionsTest-2145718135 None] Lock "cinder-quobyte-12efd5aa-da4e-4300-a3f1-bc8cea598e88" acquired by "delete_volume" :: waited 0.017s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:29:13 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6bc555e-d037-4963-8cab-464a7a388c87]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:29:13 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-db17e669-1a16-47cb-8473-2ce84f7ae3ae tempest-VolumesActionsTest-2145718135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-12efd5aa-da4e-4300-a3f1-bc8cea598e88 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:13 devstack sudo[98071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-12efd5aa-da4e-4300-a3f1-bc8cea598e88
Jul 30 20:29:13 devstack sudo[98071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:13 devstack sudo[98071]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:13 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-db17e669-1a16-47cb-8473-2ce84f7ae3ae tempest-VolumesActionsTest-2145718135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-12efd5aa-da4e-4300-a3f1-bc8cea598e88" returned: 0 in 0.496s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:13 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-db17e669-1a16-47cb-8473-2ce84f7ae3ae tempest-VolumesActionsTest-2145718135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-12efd5aa-da4e-4300-a3f1-bc8cea598e88 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:13 devstack sudo[98076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-12efd5aa-da4e-4300-a3f1-bc8cea598e88
Jul 30 20:29:13 devstack sudo[98076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:13 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2e0f8b6-935c-47fd-becf-f1de8ac2d748 tempest-VolumeQuotasAdminTestJSON-1889720093 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:29:13 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-a2e0f8b6-935c-47fd-becf-f1de8ac2d748 tempest-VolumeQuotasAdminTestJSON-1889720093 None] Flow 'volume_create_manager' (829b7397-4387-40dd-b785-1d0986e4bf6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:29:13 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-a2e0f8b6-935c-47fd-becf-f1de8ac2d748 tempest-VolumeQuotasAdminTestJSON-1889720093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5404253-043d-4877-971a-8c6b21b38c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:13 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-a2e0f8b6-935c-47fd-becf-f1de8ac2d748 tempest-VolumeQuotasAdminTestJSON-1889720093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5404253-043d-4877-971a-8c6b21b38c00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:29:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-433614077',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7976201-193b-4044-ac01-d6cd9cf50018,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2498502d208e423cb475c2cf5b58ac65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:29:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:29:14Z,use_quota=True,user_id='072d359c8ccd4de1bc2ae51497eb60b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:13 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-a2e0f8b6-935c-47fd-becf-f1de8ac2d748 tempest-VolumeQuotasAdminTestJSON-1889720093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91585e13-7bf9-4421-a7b4-138bcbeb2495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:13 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-a2e0f8b6-935c-47fd-becf-f1de8ac2d748 tempest-VolumeQuotasAdminTestJSON-1889720093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91585e13-7bf9-4421-a7b4-138bcbeb2495) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:13 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-a2e0f8b6-935c-47fd-becf-f1de8ac2d748 tempest-VolumeQuotasAdminTestJSON-1889720093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aedffbff-09a8-4101-9038-c7a21caa832f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:13 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-a2e0f8b6-935c-47fd-becf-f1de8ac2d748 tempest-VolumeQuotasAdminTestJSON-1889720093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aedffbff-09a8-4101-9038-c7a21caa832f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7976201-193b-4044-ac01-d6cd9cf50018', 'volume_name': 'volume-a7976201-193b-4044-ac01-d6cd9cf50018', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:13 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-a2e0f8b6-935c-47fd-becf-f1de8ac2d748 tempest-VolumeQuotasAdminTestJSON-1889720093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b15e1f5-f509-4e7c-ae30-b9ba76f04fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:13 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-a2e0f8b6-935c-47fd-becf-f1de8ac2d748 tempest-VolumeQuotasAdminTestJSON-1889720093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b15e1f5-f509-4e7c-ae30-b9ba76f04fb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:13 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-a2e0f8b6-935c-47fd-becf-f1de8ac2d748 tempest-VolumeQuotasAdminTestJSON-1889720093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9a81cd2-43cf-4e43-b1b5-0066f7a153ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:13 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-a2e0f8b6-935c-47fd-becf-f1de8ac2d748 tempest-VolumeQuotasAdminTestJSON-1889720093 None] Volume a7976201-193b-4044-ac01-d6cd9cf50018: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7976201-193b-4044-ac01-d6cd9cf50018', 'volume_size': 1}
Jul 30 20:29:13 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-a2e0f8b6-935c-47fd-becf-f1de8ac2d748 tempest-VolumeQuotasAdminTestJSON-1889720093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:29:13 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-a2e0f8b6-935c-47fd-becf-f1de8ac2d748 tempest-VolumeQuotasAdminTestJSON-1889720093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:29:13 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-a2e0f8b6-935c-47fd-becf-f1de8ac2d748 tempest-VolumeQuotasAdminTestJSON-1889720093 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:29:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-433614077',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7976201-193b-4044-ac01-d6cd9cf50018,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2498502d208e423cb475c2cf5b58ac65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:29:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:29:14Z,use_quota=True,user_id='072d359c8ccd4de1bc2ae51497eb60b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:29:13 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-a2e0f8b6-935c-47fd-becf-f1de8ac2d748 tempest-VolumeQuotasAdminTestJSON-1889720093 None] Creating volume a7976201-193b-4044-ac01-d6cd9cf50018 {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:29:13 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-a2e0f8b6-935c-47fd-becf-f1de8ac2d748 tempest-VolumeQuotasAdminTestJSON-1889720093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:29:13 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-a2e0f8b6-935c-47fd-becf-f1de8ac2d748 tempest-VolumeQuotasAdminTestJSON-1889720093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:29:13 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-a2e0f8b6-935c-47fd-becf-f1de8ac2d748 tempest-VolumeQuotasAdminTestJSON-1889720093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:29:13 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-a2e0f8b6-935c-47fd-becf-f1de8ac2d748 tempest-VolumeQuotasAdminTestJSON-1889720093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:29:13 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-a2e0f8b6-935c-47fd-becf-f1de8ac2d748 tempest-VolumeQuotasAdminTestJSON-1889720093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:29:13 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-a2e0f8b6-935c-47fd-becf-f1de8ac2d748 tempest-VolumeQuotasAdminTestJSON-1889720093 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:29:13 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-a2e0f8b6-935c-47fd-becf-f1de8ac2d748 tempest-VolumeQuotasAdminTestJSON-1889720093 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:29:13 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-a2e0f8b6-935c-47fd-becf-f1de8ac2d748 tempest-VolumeQuotasAdminTestJSON-1889720093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-a7976201-193b-4044-ac01-d6cd9cf50018 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:13 devstack sudo[98076]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:13 devstack sudo[98079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-a7976201-193b-4044-ac01-d6cd9cf50018 1073741824
Jul 30 20:29:13 devstack sudo[98079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:13 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-db17e669-1a16-47cb-8473-2ce84f7ae3ae tempest-VolumesActionsTest-2145718135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-12efd5aa-da4e-4300-a3f1-bc8cea598e88" returned: 0 in 0.355s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:13 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-db17e669-1a16-47cb-8473-2ce84f7ae3ae tempest-VolumesActionsTest-2145718135 None] Lock "cinder-quobyte-12efd5aa-da4e-4300-a3f1-bc8cea598e88" released by "delete_volume" :: held 0.903s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:29:13 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-db17e669-1a16-47cb-8473-2ce84f7ae3ae tempest-VolumesActionsTest-2145718135 None] Created reservations ['5a01ee43-69f1-4de1-82e2-05491b908f22', '944a11cf-0126-480c-b725-b5876ae3b5bc', '136ba5a3-6b34-45ea-b81e-d812ed90fa3d', '81a769db-c569-4c72-a29d-05d213d53bdd'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:29:14 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-db17e669-1a16-47cb-8473-2ce84f7ae3ae tempest-VolumesActionsTest-2145718135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:29:14 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-db17e669-1a16-47cb-8473-2ce84f7ae3ae tempest-VolumesActionsTest-2145718135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:29:14 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-db17e669-1a16-47cb-8473-2ce84f7ae3ae tempest-VolumesActionsTest-2145718135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:29:14 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-db17e669-1a16-47cb-8473-2ce84f7ae3ae tempest-VolumesActionsTest-2145718135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:29:14 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-db17e669-1a16-47cb-8473-2ce84f7ae3ae tempest-VolumesActionsTest-2145718135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:29:14 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-db17e669-1a16-47cb-8473-2ce84f7ae3ae tempest-VolumesActionsTest-2145718135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:14 devstack sudo[98081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:29:14 devstack sudo[98081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:14 devstack sudo[98081]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:14 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-db17e669-1a16-47cb-8473-2ce84f7ae3ae tempest-VolumesActionsTest-2145718135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.436s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:14 devstack sudo[98079]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:14 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-db17e669-1a16-47cb-8473-2ce84f7ae3ae tempest-VolumesActionsTest-2145718135 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:29:14 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [req-67d1dd27-84b6-42a7-8c68-7ab8ea2d7162 req-1921a34f-4630-4ec2-beb5-78d9c6d79571 tempest-VolumesSnapshotsTestJSON-15041044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:29:14 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [req-67d1dd27-84b6-42a7-8c68-7ab8ea2d7162 req-1921a34f-4630-4ec2-beb5-78d9c6d79571 tempest-VolumesSnapshotsTestJSON-15041044 None] Flow 'volume_create_manager' (c27dbfd4-d328-4681-bf91-3f92342ddd2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:29:14 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [req-67d1dd27-84b6-42a7-8c68-7ab8ea2d7162 req-1921a34f-4630-4ec2-beb5-78d9c6d79571 tempest-VolumesSnapshotsTestJSON-15041044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (525363af-a416-4096-9bde-536e5805afaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:14 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-a2e0f8b6-935c-47fd-becf-f1de8ac2d748 tempest-VolumeQuotasAdminTestJSON-1889720093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-a7976201-193b-4044-ac01-d6cd9cf50018 1073741824" returned: 0 in 0.731s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:14 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-db17e669-1a16-47cb-8473-2ce84f7ae3ae tempest-VolumesActionsTest-2145718135 None] Deleted volume successfully.
Jul 30 20:29:14 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [req-67d1dd27-84b6-42a7-8c68-7ab8ea2d7162 req-1921a34f-4630-4ec2-beb5-78d9c6d79571 tempest-VolumesSnapshotsTestJSON-15041044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (525363af-a416-4096-9bde-536e5805afaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:29:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-378386282',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6fef640-81ba-4e59-b863-b30bbf7342c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a08deca437954994aa2206717edccd2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:29:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:29:14Z,use_quota=True,user_id='2b93ab8ad30a44838b2c199435e83a31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:14 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [req-67d1dd27-84b6-42a7-8c68-7ab8ea2d7162 req-1921a34f-4630-4ec2-beb5-78d9c6d79571 tempest-VolumesSnapshotsTestJSON-15041044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32573f5f-a207-4209-b2b7-3035ae558ac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:14 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [req-67d1dd27-84b6-42a7-8c68-7ab8ea2d7162 req-1921a34f-4630-4ec2-beb5-78d9c6d79571 tempest-VolumesSnapshotsTestJSON-15041044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32573f5f-a207-4209-b2b7-3035ae558ac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:14 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [req-67d1dd27-84b6-42a7-8c68-7ab8ea2d7162 req-1921a34f-4630-4ec2-beb5-78d9c6d79571 tempest-VolumesSnapshotsTestJSON-15041044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36eac59a-ee5b-40dc-8c5b-10e136ab7125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:14 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [req-67d1dd27-84b6-42a7-8c68-7ab8ea2d7162 req-1921a34f-4630-4ec2-beb5-78d9c6d79571 tempest-VolumesSnapshotsTestJSON-15041044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36eac59a-ee5b-40dc-8c5b-10e136ab7125) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6fef640-81ba-4e59-b863-b30bbf7342c8', 'volume_name': 'volume-d6fef640-81ba-4e59-b863-b30bbf7342c8', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:14 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [req-67d1dd27-84b6-42a7-8c68-7ab8ea2d7162 req-1921a34f-4630-4ec2-beb5-78d9c6d79571 tempest-VolumesSnapshotsTestJSON-15041044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1930b5b2-0fed-4e43-9983-0c61fac3636b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:14 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [req-67d1dd27-84b6-42a7-8c68-7ab8ea2d7162 req-1921a34f-4630-4ec2-beb5-78d9c6d79571 tempest-VolumesSnapshotsTestJSON-15041044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1930b5b2-0fed-4e43-9983-0c61fac3636b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:14 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [req-67d1dd27-84b6-42a7-8c68-7ab8ea2d7162 req-1921a34f-4630-4ec2-beb5-78d9c6d79571 tempest-VolumesSnapshotsTestJSON-15041044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20704b27-e84d-42d4-8403-1c41f10a189e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:14 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [req-67d1dd27-84b6-42a7-8c68-7ab8ea2d7162 req-1921a34f-4630-4ec2-beb5-78d9c6d79571 tempest-VolumesSnapshotsTestJSON-15041044 None] Volume d6fef640-81ba-4e59-b863-b30bbf7342c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6fef640-81ba-4e59-b863-b30bbf7342c8', 'volume_size': 1}
Jul 30 20:29:14 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [req-67d1dd27-84b6-42a7-8c68-7ab8ea2d7162 req-1921a34f-4630-4ec2-beb5-78d9c6d79571 tempest-VolumesSnapshotsTestJSON-15041044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:29:14 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-db17e669-1a16-47cb-8473-2ce84f7ae3ae tempest-VolumesActionsTest-2145718135 None] Lock "cinder-12efd5aa-da4e-4300-a3f1-bc8cea598e88-delete_volume" released by "delete_volume" :: held 1.840s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:29:14 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-a2e0f8b6-935c-47fd-becf-f1de8ac2d748 tempest-VolumeQuotasAdminTestJSON-1889720093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-a7976201-193b-4044-ac01-d6cd9cf50018 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:14 devstack sudo[98088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-a7976201-193b-4044-ac01-d6cd9cf50018
Jul 30 20:29:14 devstack sudo[98088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:14 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-2296d5c4-806e-46f0-8182-153c09bf1c73 tempest-VolumesActionsTest-135968371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:29:14 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2296d5c4-806e-46f0-8182-153c09bf1c73 tempest-VolumesActionsTest-135968371 None] Flow 'volume_create_manager' (8c361064-3b3c-4634-985a-dfd6e896c27f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:29:14 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2296d5c4-806e-46f0-8182-153c09bf1c73 tempest-VolumesActionsTest-135968371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (786c524b-e6f7-43f1-a175-3fe3ed0f6bf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:14 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2296d5c4-806e-46f0-8182-153c09bf1c73 tempest-VolumesActionsTest-135968371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (786c524b-e6f7-43f1-a175-3fe3ed0f6bf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:29:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-361780439',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd1eb6e8-d6d3-4a98-a87d-ea8a53527026,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d5498700a384a6db5a774609f5b251a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:29:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:29:15Z,use_quota=True,user_id='785d5df48e1340b185bfa9fa0913e1a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:14 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2296d5c4-806e-46f0-8182-153c09bf1c73 tempest-VolumesActionsTest-135968371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d637347-8809-4213-9c2e-a64db455bf46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:14 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2296d5c4-806e-46f0-8182-153c09bf1c73 tempest-VolumesActionsTest-135968371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d637347-8809-4213-9c2e-a64db455bf46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:14 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2296d5c4-806e-46f0-8182-153c09bf1c73 tempest-VolumesActionsTest-135968371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (972d8a1e-f5ec-44d4-ada5-f9cc94da6a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:14 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2296d5c4-806e-46f0-8182-153c09bf1c73 tempest-VolumesActionsTest-135968371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (972d8a1e-f5ec-44d4-ada5-f9cc94da6a85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd1eb6e8-d6d3-4a98-a87d-ea8a53527026', 'volume_name': 'volume-fd1eb6e8-d6d3-4a98-a87d-ea8a53527026', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:14 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2296d5c4-806e-46f0-8182-153c09bf1c73 tempest-VolumesActionsTest-135968371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42406e4c-6496-4ca2-b856-f1594d9ffe6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:14 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2296d5c4-806e-46f0-8182-153c09bf1c73 tempest-VolumesActionsTest-135968371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42406e4c-6496-4ca2-b856-f1594d9ffe6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:14 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2296d5c4-806e-46f0-8182-153c09bf1c73 tempest-VolumesActionsTest-135968371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f61ab2b-913b-498c-8b42-3a7d3867c848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:14 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-2296d5c4-806e-46f0-8182-153c09bf1c73 tempest-VolumesActionsTest-135968371 None] Volume fd1eb6e8-d6d3-4a98-a87d-ea8a53527026: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd1eb6e8-d6d3-4a98-a87d-ea8a53527026', 'volume_size': 1}
Jul 30 20:29:14 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-2296d5c4-806e-46f0-8182-153c09bf1c73 tempest-VolumesActionsTest-135968371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:29:14 devstack sudo[98088]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:14 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-a2e0f8b6-935c-47fd-becf-f1de8ac2d748 tempest-VolumeQuotasAdminTestJSON-1889720093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-a7976201-193b-4044-ac01-d6cd9cf50018" returned: 0 in 0.242s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:14 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-a2e0f8b6-935c-47fd-becf-f1de8ac2d748 tempest-VolumeQuotasAdminTestJSON-1889720093 None] <== create_volume: return (1171ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:29:14 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-a2e0f8b6-935c-47fd-becf-f1de8ac2d748 tempest-VolumeQuotasAdminTestJSON-1889720093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.174s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:29:14 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [req-67d1dd27-84b6-42a7-8c68-7ab8ea2d7162 req-1921a34f-4630-4ec2-beb5-78d9c6d79571 tempest-VolumesSnapshotsTestJSON-15041044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.285s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:29:14 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [req-67d1dd27-84b6-42a7-8c68-7ab8ea2d7162 req-1921a34f-4630-4ec2-beb5-78d9c6d79571 tempest-VolumesSnapshotsTestJSON-15041044 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:29:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-378386282',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6fef640-81ba-4e59-b863-b30bbf7342c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a08deca437954994aa2206717edccd2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:29:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:29:14Z,use_quota=True,user_id='2b93ab8ad30a44838b2c199435e83a31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:29:14 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [req-67d1dd27-84b6-42a7-8c68-7ab8ea2d7162 req-1921a34f-4630-4ec2-beb5-78d9c6d79571 tempest-VolumesSnapshotsTestJSON-15041044 None] Creating volume d6fef640-81ba-4e59-b863-b30bbf7342c8 {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:29:14 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [req-67d1dd27-84b6-42a7-8c68-7ab8ea2d7162 req-1921a34f-4630-4ec2-beb5-78d9c6d79571 tempest-VolumesSnapshotsTestJSON-15041044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:29:14 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [req-67d1dd27-84b6-42a7-8c68-7ab8ea2d7162 req-1921a34f-4630-4ec2-beb5-78d9c6d79571 tempest-VolumesSnapshotsTestJSON-15041044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:29:14 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [req-67d1dd27-84b6-42a7-8c68-7ab8ea2d7162 req-1921a34f-4630-4ec2-beb5-78d9c6d79571 tempest-VolumesSnapshotsTestJSON-15041044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:29:14 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [req-67d1dd27-84b6-42a7-8c68-7ab8ea2d7162 req-1921a34f-4630-4ec2-beb5-78d9c6d79571 tempest-VolumesSnapshotsTestJSON-15041044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:29:14 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [req-67d1dd27-84b6-42a7-8c68-7ab8ea2d7162 req-1921a34f-4630-4ec2-beb5-78d9c6d79571 tempest-VolumesSnapshotsTestJSON-15041044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:29:14 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [req-67d1dd27-84b6-42a7-8c68-7ab8ea2d7162 req-1921a34f-4630-4ec2-beb5-78d9c6d79571 tempest-VolumesSnapshotsTestJSON-15041044 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:29:14 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [req-67d1dd27-84b6-42a7-8c68-7ab8ea2d7162 req-1921a34f-4630-4ec2-beb5-78d9c6d79571 tempest-VolumesSnapshotsTestJSON-15041044 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:29:14 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [req-67d1dd27-84b6-42a7-8c68-7ab8ea2d7162 req-1921a34f-4630-4ec2-beb5-78d9c6d79571 tempest-VolumesSnapshotsTestJSON-15041044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d6fef640-81ba-4e59-b863-b30bbf7342c8 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:15 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-a2e0f8b6-935c-47fd-becf-f1de8ac2d748 tempest-VolumeQuotasAdminTestJSON-1889720093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9a81cd2-43cf-4e43-b1b5-0066f7a153ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7976201-193b-4044-ac01-d6cd9cf50018', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:15 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-a2e0f8b6-935c-47fd-becf-f1de8ac2d748 tempest-VolumeQuotasAdminTestJSON-1889720093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7501df21-87f0-4396-b295-99911b51b1f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:15 devstack sudo[98091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d6fef640-81ba-4e59-b863-b30bbf7342c8 1073741824
Jul 30 20:29:15 devstack sudo[98091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:15 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-a2e0f8b6-935c-47fd-becf-f1de8ac2d748 tempest-VolumeQuotasAdminTestJSON-1889720093 None] Volume volume-a7976201-193b-4044-ac01-d6cd9cf50018 (a7976201-193b-4044-ac01-d6cd9cf50018): created successfully
Jul 30 20:29:15 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-a2e0f8b6-935c-47fd-becf-f1de8ac2d748 tempest-VolumeQuotasAdminTestJSON-1889720093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7501df21-87f0-4396-b295-99911b51b1f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:15 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-a2e0f8b6-935c-47fd-becf-f1de8ac2d748 tempest-VolumeQuotasAdminTestJSON-1889720093 None] Flow 'volume_create_manager' (829b7397-4387-40dd-b785-1d0986e4bf6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:29:15 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-a2e0f8b6-935c-47fd-becf-f1de8ac2d748 tempest-VolumeQuotasAdminTestJSON-1889720093 None] Created volume successfully.
Jul 30 20:29:15 devstack sudo[98091]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:15 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [req-67d1dd27-84b6-42a7-8c68-7ab8ea2d7162 req-1921a34f-4630-4ec2-beb5-78d9c6d79571 tempest-VolumesSnapshotsTestJSON-15041044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d6fef640-81ba-4e59-b863-b30bbf7342c8 1073741824" returned: 0 in 0.450s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:15 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [req-67d1dd27-84b6-42a7-8c68-7ab8ea2d7162 req-1921a34f-4630-4ec2-beb5-78d9c6d79571 tempest-VolumesSnapshotsTestJSON-15041044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d6fef640-81ba-4e59-b863-b30bbf7342c8 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:15 devstack sudo[98097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d6fef640-81ba-4e59-b863-b30bbf7342c8
Jul 30 20:29:15 devstack sudo[98097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:15 devstack sudo[98097]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:15 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [req-67d1dd27-84b6-42a7-8c68-7ab8ea2d7162 req-1921a34f-4630-4ec2-beb5-78d9c6d79571 tempest-VolumesSnapshotsTestJSON-15041044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d6fef640-81ba-4e59-b863-b30bbf7342c8" returned: 0 in 0.265s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:15 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [req-67d1dd27-84b6-42a7-8c68-7ab8ea2d7162 req-1921a34f-4630-4ec2-beb5-78d9c6d79571 tempest-VolumesSnapshotsTestJSON-15041044 None] <== create_volume: return (750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:29:15 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [req-67d1dd27-84b6-42a7-8c68-7ab8ea2d7162 req-1921a34f-4630-4ec2-beb5-78d9c6d79571 tempest-VolumesSnapshotsTestJSON-15041044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.752s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:29:15 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-2296d5c4-806e-46f0-8182-153c09bf1c73 tempest-VolumesActionsTest-135968371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.845s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:29:15 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-2296d5c4-806e-46f0-8182-153c09bf1c73 tempest-VolumesActionsTest-135968371 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:29:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-361780439',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd1eb6e8-d6d3-4a98-a87d-ea8a53527026,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d5498700a384a6db5a774609f5b251a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:29:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:29:15Z,use_quota=True,user_id='785d5df48e1340b185bfa9fa0913e1a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:29:15 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-2296d5c4-806e-46f0-8182-153c09bf1c73 tempest-VolumesActionsTest-135968371 None] Creating volume fd1eb6e8-d6d3-4a98-a87d-ea8a53527026 {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:29:15 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-2296d5c4-806e-46f0-8182-153c09bf1c73 tempest-VolumesActionsTest-135968371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:29:15 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-2296d5c4-806e-46f0-8182-153c09bf1c73 tempest-VolumesActionsTest-135968371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:29:15 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-2296d5c4-806e-46f0-8182-153c09bf1c73 tempest-VolumesActionsTest-135968371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:29:15 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-2296d5c4-806e-46f0-8182-153c09bf1c73 tempest-VolumesActionsTest-135968371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:29:15 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-2296d5c4-806e-46f0-8182-153c09bf1c73 tempest-VolumesActionsTest-135968371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:29:15 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-2296d5c4-806e-46f0-8182-153c09bf1c73 tempest-VolumesActionsTest-135968371 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:29:15 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-2296d5c4-806e-46f0-8182-153c09bf1c73 tempest-VolumesActionsTest-135968371 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:29:15 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2296d5c4-806e-46f0-8182-153c09bf1c73 tempest-VolumesActionsTest-135968371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-fd1eb6e8-d6d3-4a98-a87d-ea8a53527026 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:15 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [req-67d1dd27-84b6-42a7-8c68-7ab8ea2d7162 req-1921a34f-4630-4ec2-beb5-78d9c6d79571 tempest-VolumesSnapshotsTestJSON-15041044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20704b27-e84d-42d4-8403-1c41f10a189e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6fef640-81ba-4e59-b863-b30bbf7342c8', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:15 devstack sudo[98100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-fd1eb6e8-d6d3-4a98-a87d-ea8a53527026 1073741824
Jul 30 20:29:15 devstack sudo[98100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:15 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [req-67d1dd27-84b6-42a7-8c68-7ab8ea2d7162 req-1921a34f-4630-4ec2-beb5-78d9c6d79571 tempest-VolumesSnapshotsTestJSON-15041044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d09ba7d6-dc2d-4853-aab2-8d08a3ca14d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:15 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [req-67d1dd27-84b6-42a7-8c68-7ab8ea2d7162 req-1921a34f-4630-4ec2-beb5-78d9c6d79571 tempest-VolumesSnapshotsTestJSON-15041044 None] Volume volume-d6fef640-81ba-4e59-b863-b30bbf7342c8 (d6fef640-81ba-4e59-b863-b30bbf7342c8): created successfully
Jul 30 20:29:15 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [req-67d1dd27-84b6-42a7-8c68-7ab8ea2d7162 req-1921a34f-4630-4ec2-beb5-78d9c6d79571 tempest-VolumesSnapshotsTestJSON-15041044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d09ba7d6-dc2d-4853-aab2-8d08a3ca14d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:15 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [req-67d1dd27-84b6-42a7-8c68-7ab8ea2d7162 req-1921a34f-4630-4ec2-beb5-78d9c6d79571 tempest-VolumesSnapshotsTestJSON-15041044 None] Flow 'volume_create_manager' (c27dbfd4-d328-4681-bf91-3f92342ddd2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:29:15 devstack cinder-volume[88719]: INFO cinder.volume.manager [req-67d1dd27-84b6-42a7-8c68-7ab8ea2d7162 req-1921a34f-4630-4ec2-beb5-78d9c6d79571 tempest-VolumesSnapshotsTestJSON-15041044 None] Created volume successfully.
Jul 30 20:29:16 devstack sudo[98100]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2296d5c4-806e-46f0-8182-153c09bf1c73 tempest-VolumesActionsTest-135968371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-fd1eb6e8-d6d3-4a98-a87d-ea8a53527026 1073741824" returned: 0 in 0.519s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2296d5c4-806e-46f0-8182-153c09bf1c73 tempest-VolumesActionsTest-135968371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-fd1eb6e8-d6d3-4a98-a87d-ea8a53527026 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:16 devstack sudo[98105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-fd1eb6e8-d6d3-4a98-a87d-ea8a53527026
Jul 30 20:29:16 devstack sudo[98105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:16 devstack cinder-volume[88719]: DEBUG oslo_service.periodic_task [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88719) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 30 20:29:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:29:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:29:16 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:29:16 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:29:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:29:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:16 devstack sudo[98107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:29:16 devstack sudo[98107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:16 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-4cf817e2-96a1-4f9d-9ea5-ab8d8f898269 tempest-VolumeQuotasAdminTestJSON-1237474201 None] Transfer volume completed successfully.
Jul 30 20:29:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2296d5c4-806e-46f0-8182-153c09bf1c73 tempest-VolumesActionsTest-135968371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-fd1eb6e8-d6d3-4a98-a87d-ea8a53527026" returned: 0 in 0.355s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:16 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-2296d5c4-806e-46f0-8182-153c09bf1c73 tempest-VolumesActionsTest-135968371 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:29:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-2296d5c4-806e-46f0-8182-153c09bf1c73 tempest-VolumesActionsTest-135968371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:29:16 devstack sudo[98105]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:16 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2296d5c4-806e-46f0-8182-153c09bf1c73 tempest-VolumesActionsTest-135968371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f61ab2b-913b-498c-8b42-3a7d3867c848) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd1eb6e8-d6d3-4a98-a87d-ea8a53527026', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:16 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2296d5c4-806e-46f0-8182-153c09bf1c73 tempest-VolumesActionsTest-135968371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8d70712-4c56-4da4-96b0-ef26067fb632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:16 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-2296d5c4-806e-46f0-8182-153c09bf1c73 tempest-VolumesActionsTest-135968371 None] Volume volume-fd1eb6e8-d6d3-4a98-a87d-ea8a53527026 (fd1eb6e8-d6d3-4a98-a87d-ea8a53527026): created successfully
Jul 30 20:29:16 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2296d5c4-806e-46f0-8182-153c09bf1c73 tempest-VolumesActionsTest-135968371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8d70712-4c56-4da4-96b0-ef26067fb632) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:16 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2296d5c4-806e-46f0-8182-153c09bf1c73 tempest-VolumesActionsTest-135968371 None] Flow 'volume_create_manager' (8c361064-3b3c-4634-985a-dfd6e896c27f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:29:16 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-2296d5c4-806e-46f0-8182-153c09bf1c73 tempest-VolumesActionsTest-135968371 None] Created volume successfully.
Jul 30 20:29:16 devstack sudo[98107]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.328s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:16 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:29:16 devstack cinder-volume[88719]: DEBUG oslo_service.periodic_task [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Running periodic task VolumeManager._thread_info {{(pid=88719) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 30 20:29:16 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] thread count: 8 {{(pid=88719) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 30 20:29:16 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] thread info: [<_MainThread(MainThread, started 132390416908416)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132390306497536)>, <Thread(Thread-3 (stat_writer), started daemon 132390304471680)>, <Thread(Rabbit-heartbeat, started daemon 132390303393408)>, <Thread(Thread-5 (_runner), started daemon 132390303543168)>, <Thread(Thread-7 (_runner), started daemon 132390303563392)>, <Thread(fd_logger, started daemon 132390301344640)>, <Thread(privsep_reader, started daemon 132390301560640)>] {{(pid=88719) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 30 20:29:17 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [req-df598543-e45a-49f2-91de-b6ff2cc2864b req-f27da07d-432c-465b-8b06-04617bc812db tempest-VolumesSnapshotsTestJSON-15041044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:29:17 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [req-df598543-e45a-49f2-91de-b6ff2cc2864b req-f27da07d-432c-465b-8b06-04617bc812db tempest-VolumesSnapshotsTestJSON-15041044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:29:17 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [req-df598543-e45a-49f2-91de-b6ff2cc2864b req-f27da07d-432c-465b-8b06-04617bc812db tempest-VolumesSnapshotsTestJSON-15041044 None] Creating offline snapshot ca3e6a40-7eea-46dc-b14c-1dd4fd1c87d7 of volume d6fef640-81ba-4e59-b863-b30bbf7342c8 {{(pid=88719) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 30 20:29:17 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1a95c9f-844d-43d7-808c-a6494319a583]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:29:17 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [req-df598543-e45a-49f2-91de-b6ff2cc2864b req-f27da07d-432c-465b-8b06-04617bc812db tempest-VolumesSnapshotsTestJSON-15041044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d6fef640-81ba-4e59-b863-b30bbf7342c8 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:17 devstack sudo[98111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d6fef640-81ba-4e59-b863-b30bbf7342c8
Jul 30 20:29:17 devstack sudo[98111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:17 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-d94c4c43-64a4-4116-825a-5c574eb4e814 tempest-VolumeQuotasAdminTestJSON-948069477 None] Acquiring lock "cinder-a7976201-193b-4044-ac01-d6cd9cf50018-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:29:17 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-d94c4c43-64a4-4116-825a-5c574eb4e814 tempest-VolumeQuotasAdminTestJSON-948069477 None] Lock "cinder-a7976201-193b-4044-ac01-d6cd9cf50018-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:29:17 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-d94c4c43-64a4-4116-825a-5c574eb4e814 tempest-VolumeQuotasAdminTestJSON-948069477 None] Acquiring lock "cinder-quobyte-a7976201-193b-4044-ac01-d6cd9cf50018" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:29:17 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-d94c4c43-64a4-4116-825a-5c574eb4e814 tempest-VolumeQuotasAdminTestJSON-948069477 None] Lock "cinder-quobyte-a7976201-193b-4044-ac01-d6cd9cf50018" acquired by "delete_volume" :: waited 0.026s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:29:17 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[08cd153f-815b-4ba3-9c2b-726ce17079b9]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:29:17 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-d94c4c43-64a4-4116-825a-5c574eb4e814 tempest-VolumeQuotasAdminTestJSON-948069477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-a7976201-193b-4044-ac01-d6cd9cf50018 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:17 devstack sudo[98113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-a7976201-193b-4044-ac01-d6cd9cf50018
Jul 30 20:29:17 devstack sudo[98113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:17 devstack sudo[98111]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:17 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [req-df598543-e45a-49f2-91de-b6ff2cc2864b req-f27da07d-432c-465b-8b06-04617bc812db tempest-VolumesSnapshotsTestJSON-15041044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d6fef640-81ba-4e59-b863-b30bbf7342c8" returned: 0 in 0.558s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:17 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [req-df598543-e45a-49f2-91de-b6ff2cc2864b req-f27da07d-432c-465b-8b06-04617bc812db tempest-VolumesSnapshotsTestJSON-15041044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d6fef640-81ba-4e59-b863-b30bbf7342c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d6fef640-81ba-4e59-b863-b30bbf7342c8.ca3e6a40-7eea-46dc-b14c-1dd4fd1c87d7 1G {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:17 devstack sudo[98118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d6fef640-81ba-4e59-b863-b30bbf7342c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d6fef640-81ba-4e59-b863-b30bbf7342c8.ca3e6a40-7eea-46dc-b14c-1dd4fd1c87d7 1G
Jul 30 20:29:17 devstack sudo[98118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:17 devstack sudo[98113]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:17 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-d94c4c43-64a4-4116-825a-5c574eb4e814 tempest-VolumeQuotasAdminTestJSON-948069477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-a7976201-193b-4044-ac01-d6cd9cf50018" returned: 0 in 0.498s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:17 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-d94c4c43-64a4-4116-825a-5c574eb4e814 tempest-VolumeQuotasAdminTestJSON-948069477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-a7976201-193b-4044-ac01-d6cd9cf50018 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:17 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-c656a774-a532-487c-886b-055e95479b50 tempest-VolumesActionsTest-135968371 None] Acquiring lock "cinder-fd1eb6e8-d6d3-4a98-a87d-ea8a53527026-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:29:17 devstack sudo[98123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-a7976201-193b-4044-ac01-d6cd9cf50018
Jul 30 20:29:17 devstack sudo[98123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:18 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-c656a774-a532-487c-886b-055e95479b50 tempest-VolumesActionsTest-135968371 None] Lock "cinder-fd1eb6e8-d6d3-4a98-a87d-ea8a53527026-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:29:18 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-c656a774-a532-487c-886b-055e95479b50 tempest-VolumesActionsTest-135968371 None] Acquiring lock "cinder-quobyte-fd1eb6e8-d6d3-4a98-a87d-ea8a53527026" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:29:18 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-c656a774-a532-487c-886b-055e95479b50 tempest-VolumesActionsTest-135968371 None] Lock "cinder-quobyte-fd1eb6e8-d6d3-4a98-a87d-ea8a53527026" acquired by "delete_volume" :: waited 0.019s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:29:18 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[23a24654-f76d-4ed4-9f9f-73f951ee20aa]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:29:18 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-c656a774-a532-487c-886b-055e95479b50 tempest-VolumesActionsTest-135968371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-fd1eb6e8-d6d3-4a98-a87d-ea8a53527026 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:18 devstack sudo[98123]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:18 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-d94c4c43-64a4-4116-825a-5c574eb4e814 tempest-VolumeQuotasAdminTestJSON-948069477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-a7976201-193b-4044-ac01-d6cd9cf50018" returned: 0 in 0.294s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:18 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-d94c4c43-64a4-4116-825a-5c574eb4e814 tempest-VolumeQuotasAdminTestJSON-948069477 None] Lock "cinder-quobyte-a7976201-193b-4044-ac01-d6cd9cf50018" released by "delete_volume" :: held 0.860s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:29:18 devstack sudo[98118]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:18 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [req-df598543-e45a-49f2-91de-b6ff2cc2864b req-f27da07d-432c-465b-8b06-04617bc812db tempest-VolumesSnapshotsTestJSON-15041044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d6fef640-81ba-4e59-b863-b30bbf7342c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d6fef640-81ba-4e59-b863-b30bbf7342c8.ca3e6a40-7eea-46dc-b14c-1dd4fd1c87d7 1G" returned: 0 in 0.608s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:18 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [req-df598543-e45a-49f2-91de-b6ff2cc2864b req-f27da07d-432c-465b-8b06-04617bc812db tempest-VolumesSnapshotsTestJSON-15041044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6fef640-81ba-4e59-b863-b30bbf7342c8 -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d6fef640-81ba-4e59-b863-b30bbf7342c8.ca3e6a40-7eea-46dc-b14c-1dd4fd1c87d7 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:18 devstack sudo[98129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-fd1eb6e8-d6d3-4a98-a87d-ea8a53527026
Jul 30 20:29:18 devstack sudo[98129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:18 devstack sudo[98131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6fef640-81ba-4e59-b863-b30bbf7342c8 -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d6fef640-81ba-4e59-b863-b30bbf7342c8.ca3e6a40-7eea-46dc-b14c-1dd4fd1c87d7
Jul 30 20:29:18 devstack sudo[98131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:18 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-d94c4c43-64a4-4116-825a-5c574eb4e814 tempest-VolumeQuotasAdminTestJSON-948069477 None] Created reservations ['49a82570-13ad-432c-90b7-f154e1278f3b', '9ec730fd-b565-44ea-a070-98f1a39613c9', '57ff16e8-d9c6-4609-b0e0-520f08e1bc12', '3e293167-08e8-43aa-b06c-cd5b9ecc51be'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:29:18 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-d94c4c43-64a4-4116-825a-5c574eb4e814 tempest-VolumeQuotasAdminTestJSON-948069477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:29:18 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-d94c4c43-64a4-4116-825a-5c574eb4e814 tempest-VolumeQuotasAdminTestJSON-948069477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:29:18 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-d94c4c43-64a4-4116-825a-5c574eb4e814 tempest-VolumeQuotasAdminTestJSON-948069477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:29:18 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-d94c4c43-64a4-4116-825a-5c574eb4e814 tempest-VolumeQuotasAdminTestJSON-948069477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:29:18 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-d94c4c43-64a4-4116-825a-5c574eb4e814 tempest-VolumeQuotasAdminTestJSON-948069477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:29:18 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-d94c4c43-64a4-4116-825a-5c574eb4e814 tempest-VolumeQuotasAdminTestJSON-948069477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:18 devstack sudo[98134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:29:18 devstack sudo[98134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:18 devstack sudo[98129]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:18 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-c656a774-a532-487c-886b-055e95479b50 tempest-VolumesActionsTest-135968371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-fd1eb6e8-d6d3-4a98-a87d-ea8a53527026" returned: 0 in 0.532s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:18 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-c656a774-a532-487c-886b-055e95479b50 tempest-VolumesActionsTest-135968371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-fd1eb6e8-d6d3-4a98-a87d-ea8a53527026 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:18 devstack sudo[98131]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:18 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [req-df598543-e45a-49f2-91de-b6ff2cc2864b req-f27da07d-432c-465b-8b06-04617bc812db tempest-VolumesSnapshotsTestJSON-15041044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6fef640-81ba-4e59-b863-b30bbf7342c8 -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d6fef640-81ba-4e59-b863-b30bbf7342c8.ca3e6a40-7eea-46dc-b14c-1dd4fd1c87d7" returned: 0 in 0.429s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:18 devstack cinder-volume[88719]: WARNING cinder.volume.drivers.remotefs [req-df598543-e45a-49f2-91de-b6ff2cc2864b req-f27da07d-432c-465b-8b06-04617bc812db tempest-VolumesSnapshotsTestJSON-15041044 None] /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d6fef640-81ba-4e59-b863-b30bbf7342c8.ca3e6a40-7eea-46dc-b14c-1dd4fd1c87d7 is being set with open permissions: ugo+rw
Jul 30 20:29:18 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [req-df598543-e45a-49f2-91de-b6ff2cc2864b req-f27da07d-432c-465b-8b06-04617bc812db tempest-VolumesSnapshotsTestJSON-15041044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d6fef640-81ba-4e59-b863-b30bbf7342c8.ca3e6a40-7eea-46dc-b14c-1dd4fd1c87d7 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:18 devstack sudo[98144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-fd1eb6e8-d6d3-4a98-a87d-ea8a53527026
Jul 30 20:29:18 devstack sudo[98144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:18 devstack sudo[98146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d6fef640-81ba-4e59-b863-b30bbf7342c8.ca3e6a40-7eea-46dc-b14c-1dd4fd1c87d7
Jul 30 20:29:18 devstack sudo[98146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:18 devstack sudo[98134]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:18 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-d94c4c43-64a4-4116-825a-5c574eb4e814 tempest-VolumeQuotasAdminTestJSON-948069477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.461s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:18 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-d94c4c43-64a4-4116-825a-5c574eb4e814 tempest-VolumeQuotasAdminTestJSON-948069477 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:29:18 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-d94c4c43-64a4-4116-825a-5c574eb4e814 tempest-VolumeQuotasAdminTestJSON-948069477 None] Deleted volume successfully.
Jul 30 20:29:18 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-d94c4c43-64a4-4116-825a-5c574eb4e814 tempest-VolumeQuotasAdminTestJSON-948069477 None] Lock "cinder-a7976201-193b-4044-ac01-d6cd9cf50018-delete_volume" released by "delete_volume" :: held 1.639s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:29:19 devstack sudo[98144]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:19 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-c656a774-a532-487c-886b-055e95479b50 tempest-VolumesActionsTest-135968371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-fd1eb6e8-d6d3-4a98-a87d-ea8a53527026" returned: 0 in 0.355s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:19 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-c656a774-a532-487c-886b-055e95479b50 tempest-VolumesActionsTest-135968371 None] Lock "cinder-quobyte-fd1eb6e8-d6d3-4a98-a87d-ea8a53527026" released by "delete_volume" :: held 0.954s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:29:19 devstack sudo[98146]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:19 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [req-df598543-e45a-49f2-91de-b6ff2cc2864b req-f27da07d-432c-465b-8b06-04617bc812db tempest-VolumesSnapshotsTestJSON-15041044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d6fef640-81ba-4e59-b863-b30bbf7342c8.ca3e6a40-7eea-46dc-b14c-1dd4fd1c87d7" returned: 0 in 0.351s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:19 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [req-df598543-e45a-49f2-91de-b6ff2cc2864b req-f27da07d-432c-465b-8b06-04617bc812db tempest-VolumesSnapshotsTestJSON-15041044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d6fef640-81ba-4e59-b863-b30bbf7342c8.info {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:19 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-c656a774-a532-487c-886b-055e95479b50 tempest-VolumesActionsTest-135968371 None] Created reservations ['4d81e2ca-7f4d-4828-a80e-cc404932dc2f', '15a69292-9ff1-4b41-88f8-580e4ee89de1', '2036b343-dad4-41eb-98d9-ad1e0d46dd17', '4e6124e4-94b7-4678-8a79-3776527b5586'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:29:19 devstack sudo[98151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d6fef640-81ba-4e59-b863-b30bbf7342c8.info
Jul 30 20:29:19 devstack sudo[98151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:19 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-c656a774-a532-487c-886b-055e95479b50 tempest-VolumesActionsTest-135968371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:29:19 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-c656a774-a532-487c-886b-055e95479b50 tempest-VolumesActionsTest-135968371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:29:19 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-c656a774-a532-487c-886b-055e95479b50 tempest-VolumesActionsTest-135968371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:29:19 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-c656a774-a532-487c-886b-055e95479b50 tempest-VolumesActionsTest-135968371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:29:19 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-c656a774-a532-487c-886b-055e95479b50 tempest-VolumesActionsTest-135968371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:29:19 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-c656a774-a532-487c-886b-055e95479b50 tempest-VolumesActionsTest-135968371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:19 devstack sudo[98153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:29:19 devstack sudo[98153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:19 devstack sudo[98151]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:19 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [req-df598543-e45a-49f2-91de-b6ff2cc2864b req-f27da07d-432c-465b-8b06-04617bc812db tempest-VolumesSnapshotsTestJSON-15041044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d6fef640-81ba-4e59-b863-b30bbf7342c8.info" returned: 0 in 0.339s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:19 devstack cinder-volume[88719]: WARNING cinder.volume.drivers.remotefs [req-df598543-e45a-49f2-91de-b6ff2cc2864b req-f27da07d-432c-465b-8b06-04617bc812db tempest-VolumesSnapshotsTestJSON-15041044 None] /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d6fef640-81ba-4e59-b863-b30bbf7342c8.info is being set with open permissions: ugo+rw
Jul 30 20:29:19 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [req-df598543-e45a-49f2-91de-b6ff2cc2864b req-f27da07d-432c-465b-8b06-04617bc812db tempest-VolumesSnapshotsTestJSON-15041044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d6fef640-81ba-4e59-b863-b30bbf7342c8.info {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:19 devstack sudo[98156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d6fef640-81ba-4e59-b863-b30bbf7342c8.info
Jul 30 20:29:19 devstack sudo[98156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:19 devstack sudo[98153]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:19 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-c656a774-a532-487c-886b-055e95479b50 tempest-VolumesActionsTest-135968371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.290s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:19 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-c656a774-a532-487c-886b-055e95479b50 tempest-VolumesActionsTest-135968371 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:29:19 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-c656a774-a532-487c-886b-055e95479b50 tempest-VolumesActionsTest-135968371 None] Deleted volume successfully.
Jul 30 20:29:19 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-c656a774-a532-487c-886b-055e95479b50 tempest-VolumesActionsTest-135968371 None] Lock "cinder-fd1eb6e8-d6d3-4a98-a87d-ea8a53527026-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:29:19 devstack sudo[98156]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:19 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [req-df598543-e45a-49f2-91de-b6ff2cc2864b req-f27da07d-432c-465b-8b06-04617bc812db tempest-VolumesSnapshotsTestJSON-15041044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d6fef640-81ba-4e59-b863-b30bbf7342c8.info" returned: 0 in 0.302s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:19 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [req-df598543-e45a-49f2-91de-b6ff2cc2864b req-f27da07d-432c-465b-8b06-04617bc812db tempest-VolumesSnapshotsTestJSON-15041044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.771s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:29:19 devstack cinder-volume[88719]: INFO cinder.volume.manager [req-df598543-e45a-49f2-91de-b6ff2cc2864b req-f27da07d-432c-465b-8b06-04617bc812db tempest-VolumesSnapshotsTestJSON-15041044 None] Create snapshot completed successfully
Jul 30 20:29:20 devstack cinder-volume[88719]: DEBUG cinder.coordination [req-f2b5d237-2e4a-4365-bf12-de786f1b1c1a req-c394dc6a-c84d-4040-9ab5-76203e18952b tempest-VolumesSnapshotsTestJSON-15041044 None] Acquiring lock "cinder-ca3e6a40-7eea-46dc-b14c-1dd4fd1c87d7-delete_snapshot" by "delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:29:21 devstack cinder-volume[88719]: DEBUG cinder.coordination [req-f2b5d237-2e4a-4365-bf12-de786f1b1c1a req-c394dc6a-c84d-4040-9ab5-76203e18952b tempest-VolumesSnapshotsTestJSON-15041044 None] Lock "cinder-ca3e6a40-7eea-46dc-b14c-1dd4fd1c87d7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:29:21 devstack cinder-volume[88719]: DEBUG cinder.coordination [req-f2b5d237-2e4a-4365-bf12-de786f1b1c1a req-c394dc6a-c84d-4040-9ab5-76203e18952b tempest-VolumesSnapshotsTestJSON-15041044 None] Acquiring lock "cinder-quobyte-d6fef640-81ba-4e59-b863-b30bbf7342c8" by "delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:29:21 devstack cinder-volume[88719]: DEBUG cinder.coordination [req-f2b5d237-2e4a-4365-bf12-de786f1b1c1a req-c394dc6a-c84d-4040-9ab5-76203e18952b tempest-VolumesSnapshotsTestJSON-15041044 None] Lock "cinder-quobyte-d6fef640-81ba-4e59-b863-b30bbf7342c8" acquired by "delete_snapshot" :: waited 0.032s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:29:21 devstack cinder-volume[88719]: DEBUG cinder.coordination [req-f2b5d237-2e4a-4365-bf12-de786f1b1c1a req-c394dc6a-c84d-4040-9ab5-76203e18952b tempest-VolumesSnapshotsTestJSON-15041044 None] Acquiring lock "cinder-quobyte-ca3e6a40-7eea-46dc-b14c-1dd4fd1c87d7" by "_delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:29:21 devstack cinder-volume[88719]: DEBUG cinder.coordination [req-f2b5d237-2e4a-4365-bf12-de786f1b1c1a req-c394dc6a-c84d-4040-9ab5-76203e18952b tempest-VolumesSnapshotsTestJSON-15041044 None] Lock "cinder-quobyte-ca3e6a40-7eea-46dc-b14c-1dd4fd1c87d7" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:29:21 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [req-f2b5d237-2e4a-4365-bf12-de786f1b1c1a req-c394dc6a-c84d-4040-9ab5-76203e18952b tempest-VolumesSnapshotsTestJSON-15041044 None] Deleting offline snapshot ca3e6a40-7eea-46dc-b14c-1dd4fd1c87d7 of volume d6fef640-81ba-4e59-b863-b30bbf7342c8 {{(pid=88719) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 30 20:29:21 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [req-f2b5d237-2e4a-4365-bf12-de786f1b1c1a req-c394dc6a-c84d-4040-9ab5-76203e18952b tempest-VolumesSnapshotsTestJSON-15041044 None] snapshot_file for this snap is: volume-d6fef640-81ba-4e59-b863-b30bbf7342c8.ca3e6a40-7eea-46dc-b14c-1dd4fd1c87d7 {{(pid=88719) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 30 20:29:21 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[1726d00e-858a-4061-90fe-511885a07299]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:29:21 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [req-f2b5d237-2e4a-4365-bf12-de786f1b1c1a req-c394dc6a-c84d-4040-9ab5-76203e18952b tempest-VolumesSnapshotsTestJSON-15041044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d6fef640-81ba-4e59-b863-b30bbf7342c8.ca3e6a40-7eea-46dc-b14c-1dd4fd1c87d7 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:21 devstack sudo[98160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d6fef640-81ba-4e59-b863-b30bbf7342c8.ca3e6a40-7eea-46dc-b14c-1dd4fd1c87d7
Jul 30 20:29:21 devstack sudo[98160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:21 devstack sudo[98160]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:21 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [req-f2b5d237-2e4a-4365-bf12-de786f1b1c1a req-c394dc6a-c84d-4040-9ab5-76203e18952b tempest-VolumesSnapshotsTestJSON-15041044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d6fef640-81ba-4e59-b863-b30bbf7342c8.ca3e6a40-7eea-46dc-b14c-1dd4fd1c87d7" returned: 0 in 0.463s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:21 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [req-f2b5d237-2e4a-4365-bf12-de786f1b1c1a req-c394dc6a-c84d-4040-9ab5-76203e18952b tempest-VolumesSnapshotsTestJSON-15041044 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d6fef640-81ba-4e59-b863-b30bbf7342c8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88719) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 30 20:29:21 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc219a6f-93e9-4d9c-8e46-e08f82ad8755]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:29:21 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [req-f2b5d237-2e4a-4365-bf12-de786f1b1c1a req-c394dc6a-c84d-4040-9ab5-76203e18952b tempest-VolumesSnapshotsTestJSON-15041044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d6fef640-81ba-4e59-b863-b30bbf7342c8 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:21 devstack sudo[98166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d6fef640-81ba-4e59-b863-b30bbf7342c8
Jul 30 20:29:21 devstack sudo[98166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:22 devstack sudo[98166]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:22 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [req-f2b5d237-2e4a-4365-bf12-de786f1b1c1a req-c394dc6a-c84d-4040-9ab5-76203e18952b tempest-VolumesSnapshotsTestJSON-15041044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d6fef640-81ba-4e59-b863-b30bbf7342c8" returned: 0 in 0.565s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:22 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [req-f2b5d237-2e4a-4365-bf12-de786f1b1c1a req-c394dc6a-c84d-4040-9ab5-76203e18952b tempest-VolumesSnapshotsTestJSON-15041044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d6fef640-81ba-4e59-b863-b30bbf7342c8.ca3e6a40-7eea-46dc-b14c-1dd4fd1c87d7 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:22 devstack sudo[98171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d6fef640-81ba-4e59-b863-b30bbf7342c8.ca3e6a40-7eea-46dc-b14c-1dd4fd1c87d7
Jul 30 20:29:22 devstack sudo[98171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:22 devstack sudo[98171]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:22 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [req-f2b5d237-2e4a-4365-bf12-de786f1b1c1a req-c394dc6a-c84d-4040-9ab5-76203e18952b tempest-VolumesSnapshotsTestJSON-15041044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d6fef640-81ba-4e59-b863-b30bbf7342c8.ca3e6a40-7eea-46dc-b14c-1dd4fd1c87d7" returned: 0 in 0.504s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:22 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [req-f2b5d237-2e4a-4365-bf12-de786f1b1c1a req-c394dc6a-c84d-4040-9ab5-76203e18952b tempest-VolumesSnapshotsTestJSON-15041044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d6fef640-81ba-4e59-b863-b30bbf7342c8.ca3e6a40-7eea-46dc-b14c-1dd4fd1c87d7 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:22 devstack sudo[98178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d6fef640-81ba-4e59-b863-b30bbf7342c8.ca3e6a40-7eea-46dc-b14c-1dd4fd1c87d7
Jul 30 20:29:22 devstack sudo[98178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:22 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b9a0d80-8175-42da-ad35-38ec653e43e7 tempest-VolumesListAdminTestJSON-292013889 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:29:22 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-4b9a0d80-8175-42da-ad35-38ec653e43e7 tempest-VolumesListAdminTestJSON-292013889 None] Flow 'volume_create_manager' (3ac7d531-d027-4cbd-919f-849ee56d53cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:29:22 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-4b9a0d80-8175-42da-ad35-38ec653e43e7 tempest-VolumesListAdminTestJSON-292013889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99505a2d-78c5-4166-9e69-06cdd665e729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:22 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-4b9a0d80-8175-42da-ad35-38ec653e43e7 tempest-VolumesListAdminTestJSON-292013889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99505a2d-78c5-4166-9e69-06cdd665e729) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:29:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-289245895',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2098dfb7-bdf0-4c77-8a37-1c12f64e81a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2d5ebfbab8e454b974d64314f781daa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:29:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:29:23Z,use_quota=True,user_id='9133f5c89ca74a51b406523ff71ff4ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:22 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-4b9a0d80-8175-42da-ad35-38ec653e43e7 tempest-VolumesListAdminTestJSON-292013889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (295b0612-a4a7-4fd2-a999-da3590d134d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:22 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-4b9a0d80-8175-42da-ad35-38ec653e43e7 tempest-VolumesListAdminTestJSON-292013889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (295b0612-a4a7-4fd2-a999-da3590d134d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:22 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-4b9a0d80-8175-42da-ad35-38ec653e43e7 tempest-VolumesListAdminTestJSON-292013889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e172d05-4c29-4d83-8ebf-b91fcecc9327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:22 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-4b9a0d80-8175-42da-ad35-38ec653e43e7 tempest-VolumesListAdminTestJSON-292013889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e172d05-4c29-4d83-8ebf-b91fcecc9327) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2098dfb7-bdf0-4c77-8a37-1c12f64e81a9', 'volume_name': 'volume-2098dfb7-bdf0-4c77-8a37-1c12f64e81a9', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:22 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-4b9a0d80-8175-42da-ad35-38ec653e43e7 tempest-VolumesListAdminTestJSON-292013889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70e30961-6041-46d6-b7bb-44f0d30fd383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:22 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-4b9a0d80-8175-42da-ad35-38ec653e43e7 tempest-VolumesListAdminTestJSON-292013889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70e30961-6041-46d6-b7bb-44f0d30fd383) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:22 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-4b9a0d80-8175-42da-ad35-38ec653e43e7 tempest-VolumesListAdminTestJSON-292013889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abe9ef52-37d5-4db2-80b5-3d8867e6ffa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:22 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-4b9a0d80-8175-42da-ad35-38ec653e43e7 tempest-VolumesListAdminTestJSON-292013889 None] Volume 2098dfb7-bdf0-4c77-8a37-1c12f64e81a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2098dfb7-bdf0-4c77-8a37-1c12f64e81a9', 'volume_size': 1}
Jul 30 20:29:22 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-4b9a0d80-8175-42da-ad35-38ec653e43e7 tempest-VolumesListAdminTestJSON-292013889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:29:22 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-4b9a0d80-8175-42da-ad35-38ec653e43e7 tempest-VolumesListAdminTestJSON-292013889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:29:22 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-4b9a0d80-8175-42da-ad35-38ec653e43e7 tempest-VolumesListAdminTestJSON-292013889 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:29:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-289245895',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2098dfb7-bdf0-4c77-8a37-1c12f64e81a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2d5ebfbab8e454b974d64314f781daa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:29:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:29:23Z,use_quota=True,user_id='9133f5c89ca74a51b406523ff71ff4ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:29:22 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-4b9a0d80-8175-42da-ad35-38ec653e43e7 tempest-VolumesListAdminTestJSON-292013889 None] Creating volume 2098dfb7-bdf0-4c77-8a37-1c12f64e81a9 {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:29:22 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-4b9a0d80-8175-42da-ad35-38ec653e43e7 tempest-VolumesListAdminTestJSON-292013889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:29:22 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-4b9a0d80-8175-42da-ad35-38ec653e43e7 tempest-VolumesListAdminTestJSON-292013889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:29:22 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-4b9a0d80-8175-42da-ad35-38ec653e43e7 tempest-VolumesListAdminTestJSON-292013889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:29:22 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-4b9a0d80-8175-42da-ad35-38ec653e43e7 tempest-VolumesListAdminTestJSON-292013889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:29:22 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-4b9a0d80-8175-42da-ad35-38ec653e43e7 tempest-VolumesListAdminTestJSON-292013889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:29:22 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-4b9a0d80-8175-42da-ad35-38ec653e43e7 tempest-VolumesListAdminTestJSON-292013889 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:29:22 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-4b9a0d80-8175-42da-ad35-38ec653e43e7 tempest-VolumesListAdminTestJSON-292013889 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:29:22 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-4b9a0d80-8175-42da-ad35-38ec653e43e7 tempest-VolumesListAdminTestJSON-292013889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2098dfb7-bdf0-4c77-8a37-1c12f64e81a9 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:23 devstack sudo[98180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2098dfb7-bdf0-4c77-8a37-1c12f64e81a9 1073741824
Jul 30 20:29:23 devstack sudo[98180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:23 devstack sudo[98178]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:23 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [req-f2b5d237-2e4a-4365-bf12-de786f1b1c1a req-c394dc6a-c84d-4040-9ab5-76203e18952b tempest-VolumesSnapshotsTestJSON-15041044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d6fef640-81ba-4e59-b863-b30bbf7342c8.ca3e6a40-7eea-46dc-b14c-1dd4fd1c87d7" returned: 0 in 0.348s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:23 devstack cinder-volume[88719]: DEBUG cinder.coordination [req-f2b5d237-2e4a-4365-bf12-de786f1b1c1a req-c394dc6a-c84d-4040-9ab5-76203e18952b tempest-VolumesSnapshotsTestJSON-15041044 None] Lock "cinder-quobyte-ca3e6a40-7eea-46dc-b14c-1dd4fd1c87d7" released by "_delete_snapshot" :: held 2.040s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:29:23 devstack cinder-volume[88719]: DEBUG cinder.coordination [req-f2b5d237-2e4a-4365-bf12-de786f1b1c1a req-c394dc6a-c84d-4040-9ab5-76203e18952b tempest-VolumesSnapshotsTestJSON-15041044 None] Lock "cinder-quobyte-d6fef640-81ba-4e59-b863-b30bbf7342c8" released by "delete_snapshot" :: held 2.077s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:29:23 devstack cinder-volume[88719]: DEBUG cinder.quota [req-f2b5d237-2e4a-4365-bf12-de786f1b1c1a req-c394dc6a-c84d-4040-9ab5-76203e18952b tempest-VolumesSnapshotsTestJSON-15041044 None] Created reservations ['51f07633-f4a1-4fee-9dd9-66e6dde742ac', '26d33007-a71f-426a-a129-efaa3a6fdf42', '7f5a02e6-4479-477d-9003-40c03645d331', '5d4f82f0-2621-4c93-a429-cb88c30133fd'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:29:23 devstack cinder-volume[88719]: INFO cinder.volume.manager [req-f2b5d237-2e4a-4365-bf12-de786f1b1c1a req-c394dc6a-c84d-4040-9ab5-76203e18952b tempest-VolumesSnapshotsTestJSON-15041044 None] Delete snapshot completed successfully.
Jul 30 20:29:23 devstack cinder-volume[88719]: DEBUG cinder.coordination [req-f2b5d237-2e4a-4365-bf12-de786f1b1c1a req-c394dc6a-c84d-4040-9ab5-76203e18952b tempest-VolumesSnapshotsTestJSON-15041044 None] Lock "cinder-ca3e6a40-7eea-46dc-b14c-1dd4fd1c87d7-delete_snapshot" released by "delete_snapshot" :: held 2.301s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:29:23 devstack sudo[98180]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:23 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-4b9a0d80-8175-42da-ad35-38ec653e43e7 tempest-VolumesListAdminTestJSON-292013889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2098dfb7-bdf0-4c77-8a37-1c12f64e81a9 1073741824" returned: 0 in 0.589s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:23 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-4b9a0d80-8175-42da-ad35-38ec653e43e7 tempest-VolumesListAdminTestJSON-292013889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2098dfb7-bdf0-4c77-8a37-1c12f64e81a9 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:23 devstack sudo[98187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2098dfb7-bdf0-4c77-8a37-1c12f64e81a9
Jul 30 20:29:23 devstack sudo[98187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:23 devstack sudo[98187]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:23 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-4b9a0d80-8175-42da-ad35-38ec653e43e7 tempest-VolumesListAdminTestJSON-292013889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2098dfb7-bdf0-4c77-8a37-1c12f64e81a9" returned: 0 in 0.305s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:23 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-4b9a0d80-8175-42da-ad35-38ec653e43e7 tempest-VolumesListAdminTestJSON-292013889 None] <== create_volume: return (942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:29:23 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-4b9a0d80-8175-42da-ad35-38ec653e43e7 tempest-VolumesListAdminTestJSON-292013889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:29:23 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-4b9a0d80-8175-42da-ad35-38ec653e43e7 tempest-VolumesListAdminTestJSON-292013889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abe9ef52-37d5-4db2-80b5-3d8867e6ffa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2098dfb7-bdf0-4c77-8a37-1c12f64e81a9', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:23 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-4b9a0d80-8175-42da-ad35-38ec653e43e7 tempest-VolumesListAdminTestJSON-292013889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efaeebab-a5ac-4af2-a19e-3c765298deb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:23 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-4b9a0d80-8175-42da-ad35-38ec653e43e7 tempest-VolumesListAdminTestJSON-292013889 None] Volume volume-2098dfb7-bdf0-4c77-8a37-1c12f64e81a9 (2098dfb7-bdf0-4c77-8a37-1c12f64e81a9): created successfully
Jul 30 20:29:23 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-4b9a0d80-8175-42da-ad35-38ec653e43e7 tempest-VolumesListAdminTestJSON-292013889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efaeebab-a5ac-4af2-a19e-3c765298deb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:23 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-4b9a0d80-8175-42da-ad35-38ec653e43e7 tempest-VolumesListAdminTestJSON-292013889 None] Flow 'volume_create_manager' (3ac7d531-d027-4cbd-919f-849ee56d53cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:29:23 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-4b9a0d80-8175-42da-ad35-38ec653e43e7 tempest-VolumesListAdminTestJSON-292013889 None] Created volume successfully.
Jul 30 20:29:24 devstack cinder-volume[88719]: DEBUG cinder.coordination [req-d57480b7-8c3e-41f6-a412-4835d79f2f01 req-bb508543-d36d-4b41-8ecc-610732e1bec3 tempest-VolumesSnapshotsTestJSON-15041044 None] Acquiring lock "cinder-d6fef640-81ba-4e59-b863-b30bbf7342c8-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:29:24 devstack cinder-volume[88719]: DEBUG cinder.coordination [req-d57480b7-8c3e-41f6-a412-4835d79f2f01 req-bb508543-d36d-4b41-8ecc-610732e1bec3 tempest-VolumesSnapshotsTestJSON-15041044 None] Lock "cinder-d6fef640-81ba-4e59-b863-b30bbf7342c8-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:29:24 devstack cinder-volume[88719]: DEBUG cinder.coordination [req-d57480b7-8c3e-41f6-a412-4835d79f2f01 req-bb508543-d36d-4b41-8ecc-610732e1bec3 tempest-VolumesSnapshotsTestJSON-15041044 None] Acquiring lock "cinder-quobyte-d6fef640-81ba-4e59-b863-b30bbf7342c8" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:29:24 devstack cinder-volume[88719]: DEBUG cinder.coordination [req-d57480b7-8c3e-41f6-a412-4835d79f2f01 req-bb508543-d36d-4b41-8ecc-610732e1bec3 tempest-VolumesSnapshotsTestJSON-15041044 None] Lock "cinder-quobyte-d6fef640-81ba-4e59-b863-b30bbf7342c8" acquired by "delete_volume" :: waited 0.034s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:29:24 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[5716a96b-02a6-460d-ac5c-8612c44f9d6f]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:29:24 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [req-d57480b7-8c3e-41f6-a412-4835d79f2f01 req-bb508543-d36d-4b41-8ecc-610732e1bec3 tempest-VolumesSnapshotsTestJSON-15041044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d6fef640-81ba-4e59-b863-b30bbf7342c8 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:24 devstack sudo[98191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d6fef640-81ba-4e59-b863-b30bbf7342c8
Jul 30 20:29:24 devstack sudo[98191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:25 devstack sudo[98191]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:25 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [req-d57480b7-8c3e-41f6-a412-4835d79f2f01 req-bb508543-d36d-4b41-8ecc-610732e1bec3 tempest-VolumesSnapshotsTestJSON-15041044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d6fef640-81ba-4e59-b863-b30bbf7342c8" returned: 0 in 0.469s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:25 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [req-d57480b7-8c3e-41f6-a412-4835d79f2f01 req-bb508543-d36d-4b41-8ecc-610732e1bec3 tempest-VolumesSnapshotsTestJSON-15041044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d6fef640-81ba-4e59-b863-b30bbf7342c8 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:25 devstack sudo[98197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d6fef640-81ba-4e59-b863-b30bbf7342c8
Jul 30 20:29:25 devstack sudo[98197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:25 devstack sudo[98197]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:25 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [req-d57480b7-8c3e-41f6-a412-4835d79f2f01 req-bb508543-d36d-4b41-8ecc-610732e1bec3 tempest-VolumesSnapshotsTestJSON-15041044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d6fef640-81ba-4e59-b863-b30bbf7342c8" returned: 0 in 0.362s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:25 devstack cinder-volume[88719]: DEBUG cinder.coordination [req-d57480b7-8c3e-41f6-a412-4835d79f2f01 req-bb508543-d36d-4b41-8ecc-610732e1bec3 tempest-VolumesSnapshotsTestJSON-15041044 None] Lock "cinder-quobyte-d6fef640-81ba-4e59-b863-b30bbf7342c8" released by "delete_volume" :: held 0.934s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:29:25 devstack cinder-volume[88719]: DEBUG cinder.quota [req-d57480b7-8c3e-41f6-a412-4835d79f2f01 req-bb508543-d36d-4b41-8ecc-610732e1bec3 tempest-VolumesSnapshotsTestJSON-15041044 None] Created reservations ['4c757f87-1286-4b77-b6a7-5e8811aa479b', '8f6b2e82-c2f0-4076-b89e-8d06c661b372', '5fad1a85-8624-46b9-8714-3c2e5eedb60f', '9fb25208-4310-4a5f-bc6b-1d7d94aec914'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:29:25 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c5fa021-5fd0-468e-ba03-9f6e6b4e540f tempest-VolumesListAdminTestJSON-292013889 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:29:25 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-9c5fa021-5fd0-468e-ba03-9f6e6b4e540f tempest-VolumesListAdminTestJSON-292013889 None] Flow 'volume_create_manager' (92633014-96a7-4ca5-8252-f4022d7b14ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:29:25 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-9c5fa021-5fd0-468e-ba03-9f6e6b4e540f tempest-VolumesListAdminTestJSON-292013889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2059b49a-f1ea-483d-9546-8baad2d3edb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:25 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-9c5fa021-5fd0-468e-ba03-9f6e6b4e540f tempest-VolumesListAdminTestJSON-292013889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2059b49a-f1ea-483d-9546-8baad2d3edb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:29:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-710616381',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c887208-4114-46ab-8a68-54f1345eedaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2d5ebfbab8e454b974d64314f781daa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:29:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:29:26Z,use_quota=True,user_id='9133f5c89ca74a51b406523ff71ff4ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:25 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-9c5fa021-5fd0-468e-ba03-9f6e6b4e540f tempest-VolumesListAdminTestJSON-292013889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ae88a9e-db5a-403d-9034-aaddfa1013c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:25 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-9c5fa021-5fd0-468e-ba03-9f6e6b4e540f tempest-VolumesListAdminTestJSON-292013889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ae88a9e-db5a-403d-9034-aaddfa1013c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:25 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-9c5fa021-5fd0-468e-ba03-9f6e6b4e540f tempest-VolumesListAdminTestJSON-292013889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3522ff98-a3ae-4eec-89dc-d8760588b193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:25 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-9c5fa021-5fd0-468e-ba03-9f6e6b4e540f tempest-VolumesListAdminTestJSON-292013889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3522ff98-a3ae-4eec-89dc-d8760588b193) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c887208-4114-46ab-8a68-54f1345eedaa', 'volume_name': 'volume-7c887208-4114-46ab-8a68-54f1345eedaa', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:25 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-9c5fa021-5fd0-468e-ba03-9f6e6b4e540f tempest-VolumesListAdminTestJSON-292013889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fd59e84-10a0-4312-bb63-82820808d72a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:25 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-9c5fa021-5fd0-468e-ba03-9f6e6b4e540f tempest-VolumesListAdminTestJSON-292013889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fd59e84-10a0-4312-bb63-82820808d72a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:25 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-9c5fa021-5fd0-468e-ba03-9f6e6b4e540f tempest-VolumesListAdminTestJSON-292013889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b17bb40-f1e6-4a46-a3a9-c09d399b2fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:25 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-9c5fa021-5fd0-468e-ba03-9f6e6b4e540f tempest-VolumesListAdminTestJSON-292013889 None] Volume 7c887208-4114-46ab-8a68-54f1345eedaa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c887208-4114-46ab-8a68-54f1345eedaa', 'volume_size': 1}
Jul 30 20:29:25 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-9c5fa021-5fd0-468e-ba03-9f6e6b4e540f tempest-VolumesListAdminTestJSON-292013889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:29:25 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-9c5fa021-5fd0-468e-ba03-9f6e6b4e540f tempest-VolumesListAdminTestJSON-292013889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:29:25 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-9c5fa021-5fd0-468e-ba03-9f6e6b4e540f tempest-VolumesListAdminTestJSON-292013889 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:29:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-710616381',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c887208-4114-46ab-8a68-54f1345eedaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2d5ebfbab8e454b974d64314f781daa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:29:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:29:26Z,use_quota=True,user_id='9133f5c89ca74a51b406523ff71ff4ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:29:25 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-9c5fa021-5fd0-468e-ba03-9f6e6b4e540f tempest-VolumesListAdminTestJSON-292013889 None] Creating volume 7c887208-4114-46ab-8a68-54f1345eedaa {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:29:25 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-9c5fa021-5fd0-468e-ba03-9f6e6b4e540f tempest-VolumesListAdminTestJSON-292013889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:29:25 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-9c5fa021-5fd0-468e-ba03-9f6e6b4e540f tempest-VolumesListAdminTestJSON-292013889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:29:25 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-9c5fa021-5fd0-468e-ba03-9f6e6b4e540f tempest-VolumesListAdminTestJSON-292013889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:29:25 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-9c5fa021-5fd0-468e-ba03-9f6e6b4e540f tempest-VolumesListAdminTestJSON-292013889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:29:25 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-9c5fa021-5fd0-468e-ba03-9f6e6b4e540f tempest-VolumesListAdminTestJSON-292013889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:29:25 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-9c5fa021-5fd0-468e-ba03-9f6e6b4e540f tempest-VolumesListAdminTestJSON-292013889 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:29:25 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-9c5fa021-5fd0-468e-ba03-9f6e6b4e540f tempest-VolumesListAdminTestJSON-292013889 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:29:25 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-9c5fa021-5fd0-468e-ba03-9f6e6b4e540f tempest-VolumesListAdminTestJSON-292013889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-7c887208-4114-46ab-8a68-54f1345eedaa 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:25 devstack sudo[98201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-7c887208-4114-46ab-8a68-54f1345eedaa 1073741824
Jul 30 20:29:25 devstack sudo[98201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:25 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [req-d57480b7-8c3e-41f6-a412-4835d79f2f01 req-bb508543-d36d-4b41-8ecc-610732e1bec3 tempest-VolumesSnapshotsTestJSON-15041044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:29:25 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [req-d57480b7-8c3e-41f6-a412-4835d79f2f01 req-bb508543-d36d-4b41-8ecc-610732e1bec3 tempest-VolumesSnapshotsTestJSON-15041044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:29:25 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [req-d57480b7-8c3e-41f6-a412-4835d79f2f01 req-bb508543-d36d-4b41-8ecc-610732e1bec3 tempest-VolumesSnapshotsTestJSON-15041044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:29:25 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [req-d57480b7-8c3e-41f6-a412-4835d79f2f01 req-bb508543-d36d-4b41-8ecc-610732e1bec3 tempest-VolumesSnapshotsTestJSON-15041044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:29:25 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [req-d57480b7-8c3e-41f6-a412-4835d79f2f01 req-bb508543-d36d-4b41-8ecc-610732e1bec3 tempest-VolumesSnapshotsTestJSON-15041044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:29:25 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [req-d57480b7-8c3e-41f6-a412-4835d79f2f01 req-bb508543-d36d-4b41-8ecc-610732e1bec3 tempest-VolumesSnapshotsTestJSON-15041044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:25 devstack sudo[98203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:29:25 devstack sudo[98203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:26 devstack sudo[98203]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:26 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [req-d57480b7-8c3e-41f6-a412-4835d79f2f01 req-bb508543-d36d-4b41-8ecc-610732e1bec3 tempest-VolumesSnapshotsTestJSON-15041044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.320s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:26 devstack cinder-volume[88719]: DEBUG cinder.manager [req-d57480b7-8c3e-41f6-a412-4835d79f2f01 req-bb508543-d36d-4b41-8ecc-610732e1bec3 tempest-VolumesSnapshotsTestJSON-15041044 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:29:26 devstack cinder-volume[88719]: INFO cinder.volume.manager [req-d57480b7-8c3e-41f6-a412-4835d79f2f01 req-bb508543-d36d-4b41-8ecc-610732e1bec3 tempest-VolumesSnapshotsTestJSON-15041044 None] Deleted volume successfully.
Jul 30 20:29:26 devstack cinder-volume[88719]: DEBUG cinder.coordination [req-d57480b7-8c3e-41f6-a412-4835d79f2f01 req-bb508543-d36d-4b41-8ecc-610732e1bec3 tempest-VolumesSnapshotsTestJSON-15041044 None] Lock "cinder-d6fef640-81ba-4e59-b863-b30bbf7342c8-delete_volume" released by "delete_volume" :: held 1.787s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:29:26 devstack sudo[98201]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:26 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-9c5fa021-5fd0-468e-ba03-9f6e6b4e540f tempest-VolumesListAdminTestJSON-292013889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-7c887208-4114-46ab-8a68-54f1345eedaa 1073741824" returned: 0 in 0.521s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:26 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-9c5fa021-5fd0-468e-ba03-9f6e6b4e540f tempest-VolumesListAdminTestJSON-292013889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-7c887208-4114-46ab-8a68-54f1345eedaa {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:26 devstack sudo[98210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-7c887208-4114-46ab-8a68-54f1345eedaa
Jul 30 20:29:26 devstack sudo[98210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:26 devstack sudo[98210]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:26 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-9c5fa021-5fd0-468e-ba03-9f6e6b4e540f tempest-VolumesListAdminTestJSON-292013889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-7c887208-4114-46ab-8a68-54f1345eedaa" returned: 0 in 0.305s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:26 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-9c5fa021-5fd0-468e-ba03-9f6e6b4e540f tempest-VolumesListAdminTestJSON-292013889 None] <== create_volume: return (885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:29:26 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-9c5fa021-5fd0-468e-ba03-9f6e6b4e540f tempest-VolumesListAdminTestJSON-292013889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.888s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:29:26 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-9c5fa021-5fd0-468e-ba03-9f6e6b4e540f tempest-VolumesListAdminTestJSON-292013889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b17bb40-f1e6-4a46-a3a9-c09d399b2fd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c887208-4114-46ab-8a68-54f1345eedaa', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:26 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-9c5fa021-5fd0-468e-ba03-9f6e6b4e540f tempest-VolumesListAdminTestJSON-292013889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efc1f943-6de1-4fe2-a3af-a2f86b20374f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:26 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-9c5fa021-5fd0-468e-ba03-9f6e6b4e540f tempest-VolumesListAdminTestJSON-292013889 None] Volume volume-7c887208-4114-46ab-8a68-54f1345eedaa (7c887208-4114-46ab-8a68-54f1345eedaa): created successfully
Jul 30 20:29:26 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-9c5fa021-5fd0-468e-ba03-9f6e6b4e540f tempest-VolumesListAdminTestJSON-292013889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efc1f943-6de1-4fe2-a3af-a2f86b20374f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:26 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-9c5fa021-5fd0-468e-ba03-9f6e6b4e540f tempest-VolumesListAdminTestJSON-292013889 None] Flow 'volume_create_manager' (92633014-96a7-4ca5-8252-f4022d7b14ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:29:26 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-9c5fa021-5fd0-468e-ba03-9f6e6b4e540f tempest-VolumesListAdminTestJSON-292013889 None] Created volume successfully.
Jul 30 20:29:27 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-986a48dc-cfe2-40f3-bbe2-bbbd8a0c3349 tempest-VolumesServicesTestJSON-211889186 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:29:27 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-986a48dc-cfe2-40f3-bbe2-bbbd8a0c3349 tempest-VolumesServicesTestJSON-211889186 None] Flow 'volume_create_manager' (1548e46d-c252-4374-9761-63bc5a3ea983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:29:27 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-986a48dc-cfe2-40f3-bbe2-bbbd8a0c3349 tempest-VolumesServicesTestJSON-211889186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e72d304-b7f9-492b-aeac-f8f2353badd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:27 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-986a48dc-cfe2-40f3-bbe2-bbbd8a0c3349 tempest-VolumesServicesTestJSON-211889186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e72d304-b7f9-492b-aeac-f8f2353badd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:29:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-2113985740',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=095f052f-004e-444a-929e-bcefc8615801,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f5e8606b4ed4b588ce086a3d0716140',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:29:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:29:28Z,use_quota=True,user_id='4b0cf9681be746509a92bbf4e90e8cec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:27 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-986a48dc-cfe2-40f3-bbe2-bbbd8a0c3349 tempest-VolumesServicesTestJSON-211889186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fd725ef-e7a0-4df7-9bb2-344c4ed2124e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:27 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-986a48dc-cfe2-40f3-bbe2-bbbd8a0c3349 tempest-VolumesServicesTestJSON-211889186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fd725ef-e7a0-4df7-9bb2-344c4ed2124e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:27 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-986a48dc-cfe2-40f3-bbe2-bbbd8a0c3349 tempest-VolumesServicesTestJSON-211889186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (473af21a-694e-423a-9260-3ac73a0582bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:27 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-986a48dc-cfe2-40f3-bbe2-bbbd8a0c3349 tempest-VolumesServicesTestJSON-211889186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (473af21a-694e-423a-9260-3ac73a0582bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '095f052f-004e-444a-929e-bcefc8615801', 'volume_name': 'volume-095f052f-004e-444a-929e-bcefc8615801', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:27 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-986a48dc-cfe2-40f3-bbe2-bbbd8a0c3349 tempest-VolumesServicesTestJSON-211889186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08dbc972-92b3-4358-859d-da11713cde88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:27 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-986a48dc-cfe2-40f3-bbe2-bbbd8a0c3349 tempest-VolumesServicesTestJSON-211889186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08dbc972-92b3-4358-859d-da11713cde88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:27 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-986a48dc-cfe2-40f3-bbe2-bbbd8a0c3349 tempest-VolumesServicesTestJSON-211889186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cef237c7-38b7-4936-9544-cdf4954301be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:27 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-986a48dc-cfe2-40f3-bbe2-bbbd8a0c3349 tempest-VolumesServicesTestJSON-211889186 None] Volume 095f052f-004e-444a-929e-bcefc8615801: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-095f052f-004e-444a-929e-bcefc8615801', 'volume_size': 1}
Jul 30 20:29:27 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-986a48dc-cfe2-40f3-bbe2-bbbd8a0c3349 tempest-VolumesServicesTestJSON-211889186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:29:27 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-986a48dc-cfe2-40f3-bbe2-bbbd8a0c3349 tempest-VolumesServicesTestJSON-211889186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:29:27 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-986a48dc-cfe2-40f3-bbe2-bbbd8a0c3349 tempest-VolumesServicesTestJSON-211889186 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:29:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-2113985740',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=095f052f-004e-444a-929e-bcefc8615801,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f5e8606b4ed4b588ce086a3d0716140',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:29:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:29:28Z,use_quota=True,user_id='4b0cf9681be746509a92bbf4e90e8cec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:29:27 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-986a48dc-cfe2-40f3-bbe2-bbbd8a0c3349 tempest-VolumesServicesTestJSON-211889186 None] Creating volume 095f052f-004e-444a-929e-bcefc8615801 {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:29:27 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-986a48dc-cfe2-40f3-bbe2-bbbd8a0c3349 tempest-VolumesServicesTestJSON-211889186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:29:27 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-986a48dc-cfe2-40f3-bbe2-bbbd8a0c3349 tempest-VolumesServicesTestJSON-211889186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:29:27 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-986a48dc-cfe2-40f3-bbe2-bbbd8a0c3349 tempest-VolumesServicesTestJSON-211889186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:29:27 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-986a48dc-cfe2-40f3-bbe2-bbbd8a0c3349 tempest-VolumesServicesTestJSON-211889186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:29:27 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-986a48dc-cfe2-40f3-bbe2-bbbd8a0c3349 tempest-VolumesServicesTestJSON-211889186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:29:27 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-986a48dc-cfe2-40f3-bbe2-bbbd8a0c3349 tempest-VolumesServicesTestJSON-211889186 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:29:27 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-986a48dc-cfe2-40f3-bbe2-bbbd8a0c3349 tempest-VolumesServicesTestJSON-211889186 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:29:27 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-986a48dc-cfe2-40f3-bbe2-bbbd8a0c3349 tempest-VolumesServicesTestJSON-211889186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-095f052f-004e-444a-929e-bcefc8615801 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:27 devstack sudo[98214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-095f052f-004e-444a-929e-bcefc8615801 1073741824
Jul 30 20:29:27 devstack sudo[98214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:28 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-6472aca4-8504-43f7-8fe2-39526dee9476 tempest-VolumesListAdminTestJSON-292013889 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:29:28 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-6472aca4-8504-43f7-8fe2-39526dee9476 tempest-VolumesListAdminTestJSON-292013889 None] Flow 'volume_create_manager' (95c9aacd-4855-411f-9aef-7c76955e7dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:29:28 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-6472aca4-8504-43f7-8fe2-39526dee9476 tempest-VolumesListAdminTestJSON-292013889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22521da0-a5ef-46c8-a490-ad002e1648c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:28 devstack sudo[98214]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:28 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-6472aca4-8504-43f7-8fe2-39526dee9476 tempest-VolumesListAdminTestJSON-292013889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22521da0-a5ef-46c8-a490-ad002e1648c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:29:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-256890424',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbb64117-0953-419b-8cb1-bf9c4ae1bf24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2d5ebfbab8e454b974d64314f781daa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:29:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:29:28Z,use_quota=True,user_id='9133f5c89ca74a51b406523ff71ff4ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:28 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-6472aca4-8504-43f7-8fe2-39526dee9476 tempest-VolumesListAdminTestJSON-292013889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccfa3174-dd07-4868-8aa7-db519774885c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:28 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-6472aca4-8504-43f7-8fe2-39526dee9476 tempest-VolumesListAdminTestJSON-292013889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccfa3174-dd07-4868-8aa7-db519774885c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:28 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-6472aca4-8504-43f7-8fe2-39526dee9476 tempest-VolumesListAdminTestJSON-292013889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b5ba25f-c3b8-42cc-80df-738cb2d9cd6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:28 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-6472aca4-8504-43f7-8fe2-39526dee9476 tempest-VolumesListAdminTestJSON-292013889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b5ba25f-c3b8-42cc-80df-738cb2d9cd6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbb64117-0953-419b-8cb1-bf9c4ae1bf24', 'volume_name': 'volume-cbb64117-0953-419b-8cb1-bf9c4ae1bf24', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:28 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-6472aca4-8504-43f7-8fe2-39526dee9476 tempest-VolumesListAdminTestJSON-292013889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eeb5759e-439b-4982-a40a-f0e971687c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:28 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-6472aca4-8504-43f7-8fe2-39526dee9476 tempest-VolumesListAdminTestJSON-292013889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eeb5759e-439b-4982-a40a-f0e971687c18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:28 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-6472aca4-8504-43f7-8fe2-39526dee9476 tempest-VolumesListAdminTestJSON-292013889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39ed2d73-67e5-41f7-8e9f-3b11ee697f77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:28 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-6472aca4-8504-43f7-8fe2-39526dee9476 tempest-VolumesListAdminTestJSON-292013889 None] Volume cbb64117-0953-419b-8cb1-bf9c4ae1bf24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbb64117-0953-419b-8cb1-bf9c4ae1bf24', 'volume_size': 1}
Jul 30 20:29:28 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-6472aca4-8504-43f7-8fe2-39526dee9476 tempest-VolumesListAdminTestJSON-292013889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:29:28 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-986a48dc-cfe2-40f3-bbe2-bbbd8a0c3349 tempest-VolumesServicesTestJSON-211889186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-095f052f-004e-444a-929e-bcefc8615801 1073741824" returned: 0 in 0.719s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:28 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-986a48dc-cfe2-40f3-bbe2-bbbd8a0c3349 tempest-VolumesServicesTestJSON-211889186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-095f052f-004e-444a-929e-bcefc8615801 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:28 devstack sudo[98220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-095f052f-004e-444a-929e-bcefc8615801
Jul 30 20:29:28 devstack sudo[98220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:28 devstack sudo[98220]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:28 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-986a48dc-cfe2-40f3-bbe2-bbbd8a0c3349 tempest-VolumesServicesTestJSON-211889186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-095f052f-004e-444a-929e-bcefc8615801" returned: 0 in 0.295s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:28 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-986a48dc-cfe2-40f3-bbe2-bbbd8a0c3349 tempest-VolumesServicesTestJSON-211889186 None] <== create_volume: return (1063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:29:28 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-986a48dc-cfe2-40f3-bbe2-bbbd8a0c3349 tempest-VolumesServicesTestJSON-211889186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.066s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:29:28 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-6472aca4-8504-43f7-8fe2-39526dee9476 tempest-VolumesListAdminTestJSON-292013889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.340s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:29:28 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-6472aca4-8504-43f7-8fe2-39526dee9476 tempest-VolumesListAdminTestJSON-292013889 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:29:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-256890424',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbb64117-0953-419b-8cb1-bf9c4ae1bf24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2d5ebfbab8e454b974d64314f781daa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:29:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:29:28Z,use_quota=True,user_id='9133f5c89ca74a51b406523ff71ff4ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:29:28 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-6472aca4-8504-43f7-8fe2-39526dee9476 tempest-VolumesListAdminTestJSON-292013889 None] Creating volume cbb64117-0953-419b-8cb1-bf9c4ae1bf24 {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:29:28 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-6472aca4-8504-43f7-8fe2-39526dee9476 tempest-VolumesListAdminTestJSON-292013889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:29:28 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-6472aca4-8504-43f7-8fe2-39526dee9476 tempest-VolumesListAdminTestJSON-292013889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:29:28 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-6472aca4-8504-43f7-8fe2-39526dee9476 tempest-VolumesListAdminTestJSON-292013889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:29:28 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-6472aca4-8504-43f7-8fe2-39526dee9476 tempest-VolumesListAdminTestJSON-292013889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:29:28 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-6472aca4-8504-43f7-8fe2-39526dee9476 tempest-VolumesListAdminTestJSON-292013889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:29:28 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-6472aca4-8504-43f7-8fe2-39526dee9476 tempest-VolumesListAdminTestJSON-292013889 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:29:28 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-6472aca4-8504-43f7-8fe2-39526dee9476 tempest-VolumesListAdminTestJSON-292013889 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:29:28 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-6472aca4-8504-43f7-8fe2-39526dee9476 tempest-VolumesListAdminTestJSON-292013889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-cbb64117-0953-419b-8cb1-bf9c4ae1bf24 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:28 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-986a48dc-cfe2-40f3-bbe2-bbbd8a0c3349 tempest-VolumesServicesTestJSON-211889186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cef237c7-38b7-4936-9544-cdf4954301be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-095f052f-004e-444a-929e-bcefc8615801', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:28 devstack sudo[98223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-cbb64117-0953-419b-8cb1-bf9c4ae1bf24 1073741824
Jul 30 20:29:28 devstack sudo[98223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:28 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-986a48dc-cfe2-40f3-bbe2-bbbd8a0c3349 tempest-VolumesServicesTestJSON-211889186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5db0d65-ce52-495f-8f62-72251df43d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:28 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-986a48dc-cfe2-40f3-bbe2-bbbd8a0c3349 tempest-VolumesServicesTestJSON-211889186 None] Volume volume-095f052f-004e-444a-929e-bcefc8615801 (095f052f-004e-444a-929e-bcefc8615801): created successfully
Jul 30 20:29:28 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-986a48dc-cfe2-40f3-bbe2-bbbd8a0c3349 tempest-VolumesServicesTestJSON-211889186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5db0d65-ce52-495f-8f62-72251df43d66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:28 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-986a48dc-cfe2-40f3-bbe2-bbbd8a0c3349 tempest-VolumesServicesTestJSON-211889186 None] Flow 'volume_create_manager' (1548e46d-c252-4374-9761-63bc5a3ea983) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:29:28 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-986a48dc-cfe2-40f3-bbe2-bbbd8a0c3349 tempest-VolumesServicesTestJSON-211889186 None] Created volume successfully.
Jul 30 20:29:29 devstack sudo[98223]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:29 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-6472aca4-8504-43f7-8fe2-39526dee9476 tempest-VolumesListAdminTestJSON-292013889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-cbb64117-0953-419b-8cb1-bf9c4ae1bf24 1073741824" returned: 0 in 0.630s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:29 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-6472aca4-8504-43f7-8fe2-39526dee9476 tempest-VolumesListAdminTestJSON-292013889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-cbb64117-0953-419b-8cb1-bf9c4ae1bf24 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:29 devstack sudo[98230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-cbb64117-0953-419b-8cb1-bf9c4ae1bf24
Jul 30 20:29:29 devstack sudo[98230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:29 devstack sudo[98230]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:29 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-6472aca4-8504-43f7-8fe2-39526dee9476 tempest-VolumesListAdminTestJSON-292013889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-cbb64117-0953-419b-8cb1-bf9c4ae1bf24" returned: 0 in 0.275s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:29 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-6472aca4-8504-43f7-8fe2-39526dee9476 tempest-VolumesListAdminTestJSON-292013889 None] <== create_volume: return (950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:29:29 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-6472aca4-8504-43f7-8fe2-39526dee9476 tempest-VolumesListAdminTestJSON-292013889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:29:29 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-6472aca4-8504-43f7-8fe2-39526dee9476 tempest-VolumesListAdminTestJSON-292013889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39ed2d73-67e5-41f7-8e9f-3b11ee697f77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbb64117-0953-419b-8cb1-bf9c4ae1bf24', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:29 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-6472aca4-8504-43f7-8fe2-39526dee9476 tempest-VolumesListAdminTestJSON-292013889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc39813f-dea0-4adb-bf48-70de3ca63767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:29 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-6472aca4-8504-43f7-8fe2-39526dee9476 tempest-VolumesListAdminTestJSON-292013889 None] Volume volume-cbb64117-0953-419b-8cb1-bf9c4ae1bf24 (cbb64117-0953-419b-8cb1-bf9c4ae1bf24): created successfully
Jul 30 20:29:29 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-6472aca4-8504-43f7-8fe2-39526dee9476 tempest-VolumesListAdminTestJSON-292013889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc39813f-dea0-4adb-bf48-70de3ca63767) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:29 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-6472aca4-8504-43f7-8fe2-39526dee9476 tempest-VolumesListAdminTestJSON-292013889 None] Flow 'volume_create_manager' (95c9aacd-4855-411f-9aef-7c76955e7dd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:29:29 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-6472aca4-8504-43f7-8fe2-39526dee9476 tempest-VolumesListAdminTestJSON-292013889 None] Created volume successfully.
Jul 30 20:29:30 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-b0984815-71f5-4342-98de-46c0cdedffd4 tempest-VolumesServicesTestJSON-211889186 None] Acquiring lock "cinder-095f052f-004e-444a-929e-bcefc8615801-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:29:30 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-b0984815-71f5-4342-98de-46c0cdedffd4 tempest-VolumesServicesTestJSON-211889186 None] Lock "cinder-095f052f-004e-444a-929e-bcefc8615801-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:29:30 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-b0984815-71f5-4342-98de-46c0cdedffd4 tempest-VolumesServicesTestJSON-211889186 None] Acquiring lock "cinder-quobyte-095f052f-004e-444a-929e-bcefc8615801" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:29:30 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-b0984815-71f5-4342-98de-46c0cdedffd4 tempest-VolumesServicesTestJSON-211889186 None] Lock "cinder-quobyte-095f052f-004e-444a-929e-bcefc8615801" acquired by "delete_volume" :: waited 0.032s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:29:30 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[c504a1d3-e292-43f3-a8bd-7e794ce3b70a]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:29:30 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-b0984815-71f5-4342-98de-46c0cdedffd4 tempest-VolumesServicesTestJSON-211889186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-095f052f-004e-444a-929e-bcefc8615801 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:30 devstack sudo[98234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-095f052f-004e-444a-929e-bcefc8615801
Jul 30 20:29:30 devstack sudo[98234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:30 devstack sudo[98234]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:30 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-b0984815-71f5-4342-98de-46c0cdedffd4 tempest-VolumesServicesTestJSON-211889186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-095f052f-004e-444a-929e-bcefc8615801" returned: 0 in 0.402s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:30 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-b0984815-71f5-4342-98de-46c0cdedffd4 tempest-VolumesServicesTestJSON-211889186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-095f052f-004e-444a-929e-bcefc8615801 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:30 devstack sudo[98239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-095f052f-004e-444a-929e-bcefc8615801
Jul 30 20:29:30 devstack sudo[98239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:30 devstack sudo[98239]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:30 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-b0984815-71f5-4342-98de-46c0cdedffd4 tempest-VolumesServicesTestJSON-211889186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-095f052f-004e-444a-929e-bcefc8615801" returned: 0 in 0.276s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:30 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-b0984815-71f5-4342-98de-46c0cdedffd4 tempest-VolumesServicesTestJSON-211889186 None] Lock "cinder-quobyte-095f052f-004e-444a-929e-bcefc8615801" released by "delete_volume" :: held 0.736s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:29:30 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-b0984815-71f5-4342-98de-46c0cdedffd4 tempest-VolumesServicesTestJSON-211889186 None] Created reservations ['6daf26e6-e2ab-4827-b3fd-7e8ea27fd465', 'e2674f62-8a32-4e46-8b45-6a08b3d9ccf5', '0f7c4c60-1df5-4d8a-8760-72865319fe84', '7566ac1d-bbe7-4917-8750-365eebe9a564'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:29:30 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-b0984815-71f5-4342-98de-46c0cdedffd4 tempest-VolumesServicesTestJSON-211889186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:29:30 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-b0984815-71f5-4342-98de-46c0cdedffd4 tempest-VolumesServicesTestJSON-211889186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:29:30 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-b0984815-71f5-4342-98de-46c0cdedffd4 tempest-VolumesServicesTestJSON-211889186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:29:31 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-b0984815-71f5-4342-98de-46c0cdedffd4 tempest-VolumesServicesTestJSON-211889186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:29:31 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-b0984815-71f5-4342-98de-46c0cdedffd4 tempest-VolumesServicesTestJSON-211889186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:29:31 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-b0984815-71f5-4342-98de-46c0cdedffd4 tempest-VolumesServicesTestJSON-211889186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:31 devstack sudo[98242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:29:31 devstack sudo[98242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:31 devstack sudo[98242]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:31 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-b0984815-71f5-4342-98de-46c0cdedffd4 tempest-VolumesServicesTestJSON-211889186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.362s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:31 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-b0984815-71f5-4342-98de-46c0cdedffd4 tempest-VolumesServicesTestJSON-211889186 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:29:31 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-b0984815-71f5-4342-98de-46c0cdedffd4 tempest-VolumesServicesTestJSON-211889186 None] Deleted volume successfully.
Jul 30 20:29:31 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-b0984815-71f5-4342-98de-46c0cdedffd4 tempest-VolumesServicesTestJSON-211889186 None] Lock "cinder-095f052f-004e-444a-929e-bcefc8615801-delete_volume" released by "delete_volume" :: held 1.360s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:29:31 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-da177849-b95f-41f7-92f1-d166c7a9cd36 tempest-VolumesListAdminTestJSON-28857773 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:29:31 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-da177849-b95f-41f7-92f1-d166c7a9cd36 tempest-VolumesListAdminTestJSON-28857773 None] Flow 'volume_create_manager' (26696de2-5758-4496-8580-1c45a8bc6b99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:29:31 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-da177849-b95f-41f7-92f1-d166c7a9cd36 tempest-VolumesListAdminTestJSON-28857773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83112c90-ff26-4bdc-983c-32428fa06e39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:31 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-da177849-b95f-41f7-92f1-d166c7a9cd36 tempest-VolumesListAdminTestJSON-28857773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83112c90-ff26-4bdc-983c-32428fa06e39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:29:31Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61646bff-0f39-495f-a309-563f3f28aa5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d3d33cac0a840e590038e6eb88fdf9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:29:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:29:31Z,use_quota=True,user_id='8366e520d7de4a16b9a055b823453df0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:31 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-da177849-b95f-41f7-92f1-d166c7a9cd36 tempest-VolumesListAdminTestJSON-28857773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (125d5ca4-8ce7-4d92-b2bd-facd3fc3f417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:31 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-da177849-b95f-41f7-92f1-d166c7a9cd36 tempest-VolumesListAdminTestJSON-28857773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (125d5ca4-8ce7-4d92-b2bd-facd3fc3f417) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:31 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-da177849-b95f-41f7-92f1-d166c7a9cd36 tempest-VolumesListAdminTestJSON-28857773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a621986-0025-4737-9b3e-dc3ed3919c81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:31 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-da177849-b95f-41f7-92f1-d166c7a9cd36 tempest-VolumesListAdminTestJSON-28857773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a621986-0025-4737-9b3e-dc3ed3919c81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61646bff-0f39-495f-a309-563f3f28aa5a', 'volume_name': 'volume-61646bff-0f39-495f-a309-563f3f28aa5a', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:31 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-da177849-b95f-41f7-92f1-d166c7a9cd36 tempest-VolumesListAdminTestJSON-28857773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (388b6020-35e6-4059-8d07-8009cd3a5169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:31 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-da177849-b95f-41f7-92f1-d166c7a9cd36 tempest-VolumesListAdminTestJSON-28857773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (388b6020-35e6-4059-8d07-8009cd3a5169) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:31 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-da177849-b95f-41f7-92f1-d166c7a9cd36 tempest-VolumesListAdminTestJSON-28857773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ba6fa9a-bd4b-48d0-86e0-822c68890b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:31 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-da177849-b95f-41f7-92f1-d166c7a9cd36 tempest-VolumesListAdminTestJSON-28857773 None] Volume 61646bff-0f39-495f-a309-563f3f28aa5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61646bff-0f39-495f-a309-563f3f28aa5a', 'volume_size': 1}
Jul 30 20:29:31 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-da177849-b95f-41f7-92f1-d166c7a9cd36 tempest-VolumesListAdminTestJSON-28857773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:29:31 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-da177849-b95f-41f7-92f1-d166c7a9cd36 tempest-VolumesListAdminTestJSON-28857773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:29:31 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-da177849-b95f-41f7-92f1-d166c7a9cd36 tempest-VolumesListAdminTestJSON-28857773 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:29:31Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61646bff-0f39-495f-a309-563f3f28aa5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d3d33cac0a840e590038e6eb88fdf9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:29:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:29:31Z,use_quota=True,user_id='8366e520d7de4a16b9a055b823453df0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:29:31 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-da177849-b95f-41f7-92f1-d166c7a9cd36 tempest-VolumesListAdminTestJSON-28857773 None] Creating volume 61646bff-0f39-495f-a309-563f3f28aa5a {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:29:31 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-da177849-b95f-41f7-92f1-d166c7a9cd36 tempest-VolumesListAdminTestJSON-28857773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:29:31 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-da177849-b95f-41f7-92f1-d166c7a9cd36 tempest-VolumesListAdminTestJSON-28857773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:29:31 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-da177849-b95f-41f7-92f1-d166c7a9cd36 tempest-VolumesListAdminTestJSON-28857773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:29:31 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-da177849-b95f-41f7-92f1-d166c7a9cd36 tempest-VolumesListAdminTestJSON-28857773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:29:31 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-da177849-b95f-41f7-92f1-d166c7a9cd36 tempest-VolumesListAdminTestJSON-28857773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:29:31 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-da177849-b95f-41f7-92f1-d166c7a9cd36 tempest-VolumesListAdminTestJSON-28857773 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:29:31 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-da177849-b95f-41f7-92f1-d166c7a9cd36 tempest-VolumesListAdminTestJSON-28857773 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:29:31 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-da177849-b95f-41f7-92f1-d166c7a9cd36 tempest-VolumesListAdminTestJSON-28857773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-61646bff-0f39-495f-a309-563f3f28aa5a 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:31 devstack sudo[98245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-61646bff-0f39-495f-a309-563f3f28aa5a 1073741824
Jul 30 20:29:31 devstack sudo[98245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:32 devstack sudo[98245]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:32 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-da177849-b95f-41f7-92f1-d166c7a9cd36 tempest-VolumesListAdminTestJSON-28857773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-61646bff-0f39-495f-a309-563f3f28aa5a 1073741824" returned: 0 in 0.506s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:32 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-da177849-b95f-41f7-92f1-d166c7a9cd36 tempest-VolumesListAdminTestJSON-28857773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-61646bff-0f39-495f-a309-563f3f28aa5a {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:32 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a9f3890-daaa-4f3a-b8c5-bdd098747c57 tempest-VolumesTestJSON-459864983 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:29:32 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-3a9f3890-daaa-4f3a-b8c5-bdd098747c57 tempest-VolumesTestJSON-459864983 None] Flow 'volume_create_manager' (35d0931b-3684-4971-9135-a440e099b82d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:29:32 devstack sudo[98251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-61646bff-0f39-495f-a309-563f3f28aa5a
Jul 30 20:29:32 devstack sudo[98251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:32 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-3a9f3890-daaa-4f3a-b8c5-bdd098747c57 tempest-VolumesTestJSON-459864983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f438775-2cc7-4d66-96c2-ba6b8699454b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:32 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-3a9f3890-daaa-4f3a-b8c5-bdd098747c57 tempest-VolumesTestJSON-459864983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f438775-2cc7-4d66-96c2-ba6b8699454b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:29:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-79024860',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=519479b1-4e45-42d5-aee5-bbf903e077f8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3ef7ec4a68494e98bd7cb412f54d1996',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:29:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:29:32Z,use_quota=True,user_id='b5b83971ab1c4bc0b81812ca82aa8b21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:32 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-3a9f3890-daaa-4f3a-b8c5-bdd098747c57 tempest-VolumesTestJSON-459864983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33564247-6b16-41a9-b384-e5242f2cf06b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:32 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-3a9f3890-daaa-4f3a-b8c5-bdd098747c57 tempest-VolumesTestJSON-459864983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33564247-6b16-41a9-b384-e5242f2cf06b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:32 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-3a9f3890-daaa-4f3a-b8c5-bdd098747c57 tempest-VolumesTestJSON-459864983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b55cf802-6bbe-4012-b225-34a141dafcf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:32 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-3a9f3890-daaa-4f3a-b8c5-bdd098747c57 tempest-VolumesTestJSON-459864983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b55cf802-6bbe-4012-b225-34a141dafcf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '519479b1-4e45-42d5-aee5-bbf903e077f8', 'volume_name': 'volume-519479b1-4e45-42d5-aee5-bbf903e077f8', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:32 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-3a9f3890-daaa-4f3a-b8c5-bdd098747c57 tempest-VolumesTestJSON-459864983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2c5de23-0b10-4676-a1e9-4594bf36dc1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:32 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-3a9f3890-daaa-4f3a-b8c5-bdd098747c57 tempest-VolumesTestJSON-459864983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2c5de23-0b10-4676-a1e9-4594bf36dc1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:32 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-3a9f3890-daaa-4f3a-b8c5-bdd098747c57 tempest-VolumesTestJSON-459864983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd7e95b7-cfd5-4f48-a927-a46a3b1faeec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:32 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-3a9f3890-daaa-4f3a-b8c5-bdd098747c57 tempest-VolumesTestJSON-459864983 None] Volume 519479b1-4e45-42d5-aee5-bbf903e077f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-519479b1-4e45-42d5-aee5-bbf903e077f8', 'volume_size': 1}
Jul 30 20:29:32 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-3a9f3890-daaa-4f3a-b8c5-bdd098747c57 tempest-VolumesTestJSON-459864983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:29:32 devstack sudo[98251]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:32 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-da177849-b95f-41f7-92f1-d166c7a9cd36 tempest-VolumesListAdminTestJSON-28857773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-61646bff-0f39-495f-a309-563f3f28aa5a" returned: 0 in 0.324s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:32 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-da177849-b95f-41f7-92f1-d166c7a9cd36 tempest-VolumesListAdminTestJSON-28857773 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:29:32 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-da177849-b95f-41f7-92f1-d166c7a9cd36 tempest-VolumesListAdminTestJSON-28857773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:29:32 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-3a9f3890-daaa-4f3a-b8c5-bdd098747c57 tempest-VolumesTestJSON-459864983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.218s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:29:32 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-3a9f3890-daaa-4f3a-b8c5-bdd098747c57 tempest-VolumesTestJSON-459864983 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:29:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-79024860',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=519479b1-4e45-42d5-aee5-bbf903e077f8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3ef7ec4a68494e98bd7cb412f54d1996',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:29:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:29:32Z,use_quota=True,user_id='b5b83971ab1c4bc0b81812ca82aa8b21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:29:32 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-3a9f3890-daaa-4f3a-b8c5-bdd098747c57 tempest-VolumesTestJSON-459864983 None] Creating volume 519479b1-4e45-42d5-aee5-bbf903e077f8 {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:29:32 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-3a9f3890-daaa-4f3a-b8c5-bdd098747c57 tempest-VolumesTestJSON-459864983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:29:32 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-3a9f3890-daaa-4f3a-b8c5-bdd098747c57 tempest-VolumesTestJSON-459864983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:29:32 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-3a9f3890-daaa-4f3a-b8c5-bdd098747c57 tempest-VolumesTestJSON-459864983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:29:32 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-3a9f3890-daaa-4f3a-b8c5-bdd098747c57 tempest-VolumesTestJSON-459864983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:29:32 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-3a9f3890-daaa-4f3a-b8c5-bdd098747c57 tempest-VolumesTestJSON-459864983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:29:32 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-3a9f3890-daaa-4f3a-b8c5-bdd098747c57 tempest-VolumesTestJSON-459864983 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:29:32 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-3a9f3890-daaa-4f3a-b8c5-bdd098747c57 tempest-VolumesTestJSON-459864983 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:29:32 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3a9f3890-daaa-4f3a-b8c5-bdd098747c57 tempest-VolumesTestJSON-459864983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-519479b1-4e45-42d5-aee5-bbf903e077f8 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:32 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-da177849-b95f-41f7-92f1-d166c7a9cd36 tempest-VolumesListAdminTestJSON-28857773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ba6fa9a-bd4b-48d0-86e0-822c68890b68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61646bff-0f39-495f-a309-563f3f28aa5a', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:32 devstack sudo[98254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-519479b1-4e45-42d5-aee5-bbf903e077f8 1073741824
Jul 30 20:29:32 devstack sudo[98254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:32 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-da177849-b95f-41f7-92f1-d166c7a9cd36 tempest-VolumesListAdminTestJSON-28857773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46505b36-7b4a-4e2f-8318-830a09568941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:32 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-da177849-b95f-41f7-92f1-d166c7a9cd36 tempest-VolumesListAdminTestJSON-28857773 None] Volume volume-61646bff-0f39-495f-a309-563f3f28aa5a (61646bff-0f39-495f-a309-563f3f28aa5a): created successfully
Jul 30 20:29:32 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-da177849-b95f-41f7-92f1-d166c7a9cd36 tempest-VolumesListAdminTestJSON-28857773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46505b36-7b4a-4e2f-8318-830a09568941) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:32 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-da177849-b95f-41f7-92f1-d166c7a9cd36 tempest-VolumesListAdminTestJSON-28857773 None] Flow 'volume_create_manager' (26696de2-5758-4496-8580-1c45a8bc6b99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:29:32 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-da177849-b95f-41f7-92f1-d166c7a9cd36 tempest-VolumesListAdminTestJSON-28857773 None] Created volume successfully.
Jul 30 20:29:33 devstack sudo[98254]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:33 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3a9f3890-daaa-4f3a-b8c5-bdd098747c57 tempest-VolumesTestJSON-459864983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-519479b1-4e45-42d5-aee5-bbf903e077f8 1073741824" returned: 0 in 0.498s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:33 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3a9f3890-daaa-4f3a-b8c5-bdd098747c57 tempest-VolumesTestJSON-459864983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-519479b1-4e45-42d5-aee5-bbf903e077f8 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:33 devstack sudo[98259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-519479b1-4e45-42d5-aee5-bbf903e077f8
Jul 30 20:29:33 devstack sudo[98259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:33 devstack sudo[98259]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:33 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3a9f3890-daaa-4f3a-b8c5-bdd098747c57 tempest-VolumesTestJSON-459864983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-519479b1-4e45-42d5-aee5-bbf903e077f8" returned: 0 in 0.287s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:33 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-3a9f3890-daaa-4f3a-b8c5-bdd098747c57 tempest-VolumesTestJSON-459864983 None] <== create_volume: return (845ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:29:33 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-3a9f3890-daaa-4f3a-b8c5-bdd098747c57 tempest-VolumesTestJSON-459864983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.850s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:29:33 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-3a9f3890-daaa-4f3a-b8c5-bdd098747c57 tempest-VolumesTestJSON-459864983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd7e95b7-cfd5-4f48-a927-a46a3b1faeec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-519479b1-4e45-42d5-aee5-bbf903e077f8', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:33 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-3a9f3890-daaa-4f3a-b8c5-bdd098747c57 tempest-VolumesTestJSON-459864983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcc41259-ed41-46c8-8e55-3a1aadadcc1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:33 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-3a9f3890-daaa-4f3a-b8c5-bdd098747c57 tempest-VolumesTestJSON-459864983 None] Volume volume-519479b1-4e45-42d5-aee5-bbf903e077f8 (519479b1-4e45-42d5-aee5-bbf903e077f8): created successfully
Jul 30 20:29:33 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-3a9f3890-daaa-4f3a-b8c5-bdd098747c57 tempest-VolumesTestJSON-459864983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcc41259-ed41-46c8-8e55-3a1aadadcc1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:33 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-3a9f3890-daaa-4f3a-b8c5-bdd098747c57 tempest-VolumesTestJSON-459864983 None] Flow 'volume_create_manager' (35d0931b-3684-4971-9135-a440e099b82d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:29:33 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-3a9f3890-daaa-4f3a-b8c5-bdd098747c57 tempest-VolumesTestJSON-459864983 None] Created volume successfully.
Jul 30 20:29:33 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-2074aeba-d463-43a3-b325-c7e6b550c7df tempest-VolumesListAdminTestJSON-28857773 None] Acquiring lock "cinder-61646bff-0f39-495f-a309-563f3f28aa5a-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:29:33 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-2074aeba-d463-43a3-b325-c7e6b550c7df tempest-VolumesListAdminTestJSON-28857773 None] Lock "cinder-61646bff-0f39-495f-a309-563f3f28aa5a-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:29:33 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-2074aeba-d463-43a3-b325-c7e6b550c7df tempest-VolumesListAdminTestJSON-28857773 None] Acquiring lock "cinder-quobyte-61646bff-0f39-495f-a309-563f3f28aa5a" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:29:33 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-2074aeba-d463-43a3-b325-c7e6b550c7df tempest-VolumesListAdminTestJSON-28857773 None] Lock "cinder-quobyte-61646bff-0f39-495f-a309-563f3f28aa5a" acquired by "delete_volume" :: waited 0.021s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:29:33 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb59ba2-9178-4794-bc02-06f6335ff5b4]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:29:33 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2074aeba-d463-43a3-b325-c7e6b550c7df tempest-VolumesListAdminTestJSON-28857773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-61646bff-0f39-495f-a309-563f3f28aa5a {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:33 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-7261b650-3fc9-4ef5-aed1-8c21e6d70189 tempest-VolumesListAdminTestJSON-292013889 None] Acquiring lock "cinder-cbb64117-0953-419b-8cb1-bf9c4ae1bf24-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:29:33 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-7261b650-3fc9-4ef5-aed1-8c21e6d70189 tempest-VolumesListAdminTestJSON-292013889 None] Lock "cinder-cbb64117-0953-419b-8cb1-bf9c4ae1bf24-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:29:34 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-7261b650-3fc9-4ef5-aed1-8c21e6d70189 tempest-VolumesListAdminTestJSON-292013889 None] Acquiring lock "cinder-quobyte-cbb64117-0953-419b-8cb1-bf9c4ae1bf24" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:29:34 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-7261b650-3fc9-4ef5-aed1-8c21e6d70189 tempest-VolumesListAdminTestJSON-292013889 None] Lock "cinder-quobyte-cbb64117-0953-419b-8cb1-bf9c4ae1bf24" acquired by "delete_volume" :: waited 0.016s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:29:34 devstack sudo[98262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-61646bff-0f39-495f-a309-563f3f28aa5a
Jul 30 20:29:34 devstack sudo[98262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:34 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[58802d47-ca3f-4fa6-9d97-77992af86348]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:29:34 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-7261b650-3fc9-4ef5-aed1-8c21e6d70189 tempest-VolumesListAdminTestJSON-292013889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-cbb64117-0953-419b-8cb1-bf9c4ae1bf24 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:34 devstack sudo[98264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-cbb64117-0953-419b-8cb1-bf9c4ae1bf24
Jul 30 20:29:34 devstack sudo[98264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:34 devstack sudo[98262]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:34 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2074aeba-d463-43a3-b325-c7e6b550c7df tempest-VolumesListAdminTestJSON-28857773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-61646bff-0f39-495f-a309-563f3f28aa5a" returned: 0 in 0.523s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:34 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2074aeba-d463-43a3-b325-c7e6b550c7df tempest-VolumesListAdminTestJSON-28857773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-61646bff-0f39-495f-a309-563f3f28aa5a {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:34 devstack sudo[98270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-61646bff-0f39-495f-a309-563f3f28aa5a
Jul 30 20:29:34 devstack sudo[98270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:34 devstack sudo[98264]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:34 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-7261b650-3fc9-4ef5-aed1-8c21e6d70189 tempest-VolumesListAdminTestJSON-292013889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-cbb64117-0953-419b-8cb1-bf9c4ae1bf24" returned: 0 in 0.506s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:34 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-7261b650-3fc9-4ef5-aed1-8c21e6d70189 tempest-VolumesListAdminTestJSON-292013889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-cbb64117-0953-419b-8cb1-bf9c4ae1bf24 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:34 devstack sudo[98277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-cbb64117-0953-419b-8cb1-bf9c4ae1bf24
Jul 30 20:29:34 devstack sudo[98277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:34 devstack sudo[98270]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:34 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2074aeba-d463-43a3-b325-c7e6b550c7df tempest-VolumesListAdminTestJSON-28857773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-61646bff-0f39-495f-a309-563f3f28aa5a" returned: 0 in 0.435s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:34 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-2074aeba-d463-43a3-b325-c7e6b550c7df tempest-VolumesListAdminTestJSON-28857773 None] Lock "cinder-quobyte-61646bff-0f39-495f-a309-563f3f28aa5a" released by "delete_volume" :: held 1.034s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:29:34 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-2074aeba-d463-43a3-b325-c7e6b550c7df tempest-VolumesListAdminTestJSON-28857773 None] Created reservations ['62f8e0e6-44f2-4649-af64-636720ed9232', '5bafd4aa-b946-49d0-9e58-bea1669a8e5c', 'c6227eaf-761a-465f-bc04-aaf6647176c5', '4d20f585-0085-4c98-9020-a57256d0fd65'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:29:34 devstack sudo[98277]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:34 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-7261b650-3fc9-4ef5-aed1-8c21e6d70189 tempest-VolumesListAdminTestJSON-292013889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-cbb64117-0953-419b-8cb1-bf9c4ae1bf24" returned: 0 in 0.423s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:35 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-7261b650-3fc9-4ef5-aed1-8c21e6d70189 tempest-VolumesListAdminTestJSON-292013889 None] Lock "cinder-quobyte-cbb64117-0953-419b-8cb1-bf9c4ae1bf24" released by "delete_volume" :: held 1.002s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:29:35 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-7261b650-3fc9-4ef5-aed1-8c21e6d70189 tempest-VolumesListAdminTestJSON-292013889 None] Created reservations ['1091c5b7-a0ce-456d-89d1-935b52ca5962', 'cdd28ce1-fcc8-4e67-a4ac-56522631176b', '72b10a9e-3252-4977-82e5-aec0c9841416', 'aa4bd6d5-ef63-492e-a02f-49b472ffc3a7'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:29:35 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-2074aeba-d463-43a3-b325-c7e6b550c7df tempest-VolumesListAdminTestJSON-28857773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:29:35 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-2074aeba-d463-43a3-b325-c7e6b550c7df tempest-VolumesListAdminTestJSON-28857773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:29:35 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-2074aeba-d463-43a3-b325-c7e6b550c7df tempest-VolumesListAdminTestJSON-28857773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:29:35 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-2074aeba-d463-43a3-b325-c7e6b550c7df tempest-VolumesListAdminTestJSON-28857773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:29:35 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-2074aeba-d463-43a3-b325-c7e6b550c7df tempest-VolumesListAdminTestJSON-28857773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:29:35 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2074aeba-d463-43a3-b325-c7e6b550c7df tempest-VolumesListAdminTestJSON-28857773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:35 devstack sudo[98282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:29:35 devstack sudo[98282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:35 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-7261b650-3fc9-4ef5-aed1-8c21e6d70189 tempest-VolumesListAdminTestJSON-292013889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:29:35 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-7261b650-3fc9-4ef5-aed1-8c21e6d70189 tempest-VolumesListAdminTestJSON-292013889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:29:35 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-7261b650-3fc9-4ef5-aed1-8c21e6d70189 tempest-VolumesListAdminTestJSON-292013889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:29:35 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-7261b650-3fc9-4ef5-aed1-8c21e6d70189 tempest-VolumesListAdminTestJSON-292013889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:29:35 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-7261b650-3fc9-4ef5-aed1-8c21e6d70189 tempest-VolumesListAdminTestJSON-292013889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:29:35 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-7261b650-3fc9-4ef5-aed1-8c21e6d70189 tempest-VolumesListAdminTestJSON-292013889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:35 devstack sudo[98284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:29:35 devstack sudo[98284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:35 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9a49f9d-b900-42df-9232-f3a6f900e99f tempest-VolumesTestJSON-459864983 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:29:35 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e9a49f9d-b900-42df-9232-f3a6f900e99f tempest-VolumesTestJSON-459864983 None] Flow 'volume_create_manager' (758249e7-4c97-4e01-92c7-2918e95e1ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:29:35 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e9a49f9d-b900-42df-9232-f3a6f900e99f tempest-VolumesTestJSON-459864983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdb0de7f-c0ae-442f-ae97-5aa84fe1f70a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:35 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e9a49f9d-b900-42df-9232-f3a6f900e99f tempest-VolumesTestJSON-459864983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdb0de7f-c0ae-442f-ae97-5aa84fe1f70a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:29:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-478719443',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9152314f-d408-4a33-9b98-dc7fcb103f4f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3ef7ec4a68494e98bd7cb412f54d1996',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:29:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:29:35Z,use_quota=True,user_id='b5b83971ab1c4bc0b81812ca82aa8b21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:35 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e9a49f9d-b900-42df-9232-f3a6f900e99f tempest-VolumesTestJSON-459864983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84f19849-c072-4223-bc78-52da884c203b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:35 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e9a49f9d-b900-42df-9232-f3a6f900e99f tempest-VolumesTestJSON-459864983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84f19849-c072-4223-bc78-52da884c203b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:35 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e9a49f9d-b900-42df-9232-f3a6f900e99f tempest-VolumesTestJSON-459864983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dad6481-4f87-4584-80b6-a87b1f9e570d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:35 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e9a49f9d-b900-42df-9232-f3a6f900e99f tempest-VolumesTestJSON-459864983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dad6481-4f87-4584-80b6-a87b1f9e570d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9152314f-d408-4a33-9b98-dc7fcb103f4f', 'volume_name': 'volume-9152314f-d408-4a33-9b98-dc7fcb103f4f', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:35 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e9a49f9d-b900-42df-9232-f3a6f900e99f tempest-VolumesTestJSON-459864983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46ba7e98-9cec-42e5-a269-86074be9fc27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:35 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e9a49f9d-b900-42df-9232-f3a6f900e99f tempest-VolumesTestJSON-459864983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46ba7e98-9cec-42e5-a269-86074be9fc27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:35 devstack sudo[98282]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:35 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e9a49f9d-b900-42df-9232-f3a6f900e99f tempest-VolumesTestJSON-459864983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33797f20-9994-4d74-8120-209839d017fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:35 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-e9a49f9d-b900-42df-9232-f3a6f900e99f tempest-VolumesTestJSON-459864983 None] Volume 9152314f-d408-4a33-9b98-dc7fcb103f4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9152314f-d408-4a33-9b98-dc7fcb103f4f', 'volume_size': 1}
Jul 30 20:29:35 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-e9a49f9d-b900-42df-9232-f3a6f900e99f tempest-VolumesTestJSON-459864983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:29:35 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-e9a49f9d-b900-42df-9232-f3a6f900e99f tempest-VolumesTestJSON-459864983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:29:35 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-e9a49f9d-b900-42df-9232-f3a6f900e99f tempest-VolumesTestJSON-459864983 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:29:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-478719443',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9152314f-d408-4a33-9b98-dc7fcb103f4f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3ef7ec4a68494e98bd7cb412f54d1996',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:29:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:29:35Z,use_quota=True,user_id='b5b83971ab1c4bc0b81812ca82aa8b21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:29:35 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-e9a49f9d-b900-42df-9232-f3a6f900e99f tempest-VolumesTestJSON-459864983 None] Creating volume 9152314f-d408-4a33-9b98-dc7fcb103f4f {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:29:35 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-e9a49f9d-b900-42df-9232-f3a6f900e99f tempest-VolumesTestJSON-459864983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:29:35 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-e9a49f9d-b900-42df-9232-f3a6f900e99f tempest-VolumesTestJSON-459864983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:29:35 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-e9a49f9d-b900-42df-9232-f3a6f900e99f tempest-VolumesTestJSON-459864983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:29:35 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-e9a49f9d-b900-42df-9232-f3a6f900e99f tempest-VolumesTestJSON-459864983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:29:35 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-e9a49f9d-b900-42df-9232-f3a6f900e99f tempest-VolumesTestJSON-459864983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:29:35 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-e9a49f9d-b900-42df-9232-f3a6f900e99f tempest-VolumesTestJSON-459864983 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:29:35 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-e9a49f9d-b900-42df-9232-f3a6f900e99f tempest-VolumesTestJSON-459864983 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:29:35 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-e9a49f9d-b900-42df-9232-f3a6f900e99f tempest-VolumesTestJSON-459864983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-9152314f-d408-4a33-9b98-dc7fcb103f4f 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:35 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2074aeba-d463-43a3-b325-c7e6b550c7df tempest-VolumesListAdminTestJSON-28857773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.341s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:35 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-2074aeba-d463-43a3-b325-c7e6b550c7df tempest-VolumesListAdminTestJSON-28857773 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:29:35 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-2074aeba-d463-43a3-b325-c7e6b550c7df tempest-VolumesListAdminTestJSON-28857773 None] Deleted volume successfully.
Jul 30 20:29:35 devstack sudo[98288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-9152314f-d408-4a33-9b98-dc7fcb103f4f 1073741824
Jul 30 20:29:35 devstack sudo[98288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:35 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-2074aeba-d463-43a3-b325-c7e6b550c7df tempest-VolumesListAdminTestJSON-28857773 None] Lock "cinder-61646bff-0f39-495f-a309-563f3f28aa5a-delete_volume" released by "delete_volume" :: held 1.832s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:29:35 devstack sudo[98284]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:35 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-7261b650-3fc9-4ef5-aed1-8c21e6d70189 tempest-VolumesListAdminTestJSON-292013889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.314s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:35 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-7261b650-3fc9-4ef5-aed1-8c21e6d70189 tempest-VolumesListAdminTestJSON-292013889 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:29:35 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-7261b650-3fc9-4ef5-aed1-8c21e6d70189 tempest-VolumesListAdminTestJSON-292013889 None] Deleted volume successfully.
Jul 30 20:29:35 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-7261b650-3fc9-4ef5-aed1-8c21e6d70189 tempest-VolumesListAdminTestJSON-292013889 None] Lock "cinder-cbb64117-0953-419b-8cb1-bf9c4ae1bf24-delete_volume" released by "delete_volume" :: held 1.626s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:29:35 devstack sudo[98288]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:35 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-e9a49f9d-b900-42df-9232-f3a6f900e99f tempest-VolumesTestJSON-459864983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-9152314f-d408-4a33-9b98-dc7fcb103f4f 1073741824" returned: 0 in 0.522s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:36 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-e9a49f9d-b900-42df-9232-f3a6f900e99f tempest-VolumesTestJSON-459864983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-9152314f-d408-4a33-9b98-dc7fcb103f4f {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:36 devstack sudo[98294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-9152314f-d408-4a33-9b98-dc7fcb103f4f
Jul 30 20:29:36 devstack sudo[98294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:36 devstack sudo[98294]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:36 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-e9a49f9d-b900-42df-9232-f3a6f900e99f tempest-VolumesTestJSON-459864983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-9152314f-d408-4a33-9b98-dc7fcb103f4f" returned: 0 in 0.276s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:36 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-e9a49f9d-b900-42df-9232-f3a6f900e99f tempest-VolumesTestJSON-459864983 None] <== create_volume: return (864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:29:36 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-e9a49f9d-b900-42df-9232-f3a6f900e99f tempest-VolumesTestJSON-459864983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.867s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:29:36 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e9a49f9d-b900-42df-9232-f3a6f900e99f tempest-VolumesTestJSON-459864983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33797f20-9994-4d74-8120-209839d017fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9152314f-d408-4a33-9b98-dc7fcb103f4f', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:36 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e9a49f9d-b900-42df-9232-f3a6f900e99f tempest-VolumesTestJSON-459864983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85316791-38e6-40ea-8ca5-e2fdef07007b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:36 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-b7cd1b1a-d3be-492d-9ade-ba77c9612a1f tempest-VolumesListAdminTestJSON-292013889 None] Acquiring lock "cinder-7c887208-4114-46ab-8a68-54f1345eedaa-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:29:36 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-e9a49f9d-b900-42df-9232-f3a6f900e99f tempest-VolumesTestJSON-459864983 None] Volume volume-9152314f-d408-4a33-9b98-dc7fcb103f4f (9152314f-d408-4a33-9b98-dc7fcb103f4f): created successfully
Jul 30 20:29:36 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e9a49f9d-b900-42df-9232-f3a6f900e99f tempest-VolumesTestJSON-459864983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85316791-38e6-40ea-8ca5-e2fdef07007b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:36 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e9a49f9d-b900-42df-9232-f3a6f900e99f tempest-VolumesTestJSON-459864983 None] Flow 'volume_create_manager' (758249e7-4c97-4e01-92c7-2918e95e1ecc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:29:36 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-b7cd1b1a-d3be-492d-9ade-ba77c9612a1f tempest-VolumesListAdminTestJSON-292013889 None] Lock "cinder-7c887208-4114-46ab-8a68-54f1345eedaa-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:29:36 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-e9a49f9d-b900-42df-9232-f3a6f900e99f tempest-VolumesTestJSON-459864983 None] Created volume successfully.
Jul 30 20:29:36 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-b7cd1b1a-d3be-492d-9ade-ba77c9612a1f tempest-VolumesListAdminTestJSON-292013889 None] Acquiring lock "cinder-quobyte-7c887208-4114-46ab-8a68-54f1345eedaa" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:29:36 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-b7cd1b1a-d3be-492d-9ade-ba77c9612a1f tempest-VolumesListAdminTestJSON-292013889 None] Lock "cinder-quobyte-7c887208-4114-46ab-8a68-54f1345eedaa" acquired by "delete_volume" :: waited 0.020s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:29:36 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3e75c02-b146-4940-ac07-140e5aadbb4e]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:29:36 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-b7cd1b1a-d3be-492d-9ade-ba77c9612a1f tempest-VolumesListAdminTestJSON-292013889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-7c887208-4114-46ab-8a68-54f1345eedaa {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:36 devstack sudo[98297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-7c887208-4114-46ab-8a68-54f1345eedaa
Jul 30 20:29:36 devstack sudo[98297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:36 devstack sudo[98297]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:36 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-b7cd1b1a-d3be-492d-9ade-ba77c9612a1f tempest-VolumesListAdminTestJSON-292013889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-7c887208-4114-46ab-8a68-54f1345eedaa" returned: 0 in 0.403s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:36 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-b7cd1b1a-d3be-492d-9ade-ba77c9612a1f tempest-VolumesListAdminTestJSON-292013889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-7c887208-4114-46ab-8a68-54f1345eedaa {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:36 devstack sudo[98302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-7c887208-4114-46ab-8a68-54f1345eedaa
Jul 30 20:29:36 devstack sudo[98302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:37 devstack sudo[98302]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:37 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-b7cd1b1a-d3be-492d-9ade-ba77c9612a1f tempest-VolumesListAdminTestJSON-292013889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-7c887208-4114-46ab-8a68-54f1345eedaa" returned: 0 in 0.267s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:37 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-b7cd1b1a-d3be-492d-9ade-ba77c9612a1f tempest-VolumesListAdminTestJSON-292013889 None] Lock "cinder-quobyte-7c887208-4114-46ab-8a68-54f1345eedaa" released by "delete_volume" :: held 0.727s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:29:37 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-b7cd1b1a-d3be-492d-9ade-ba77c9612a1f tempest-VolumesListAdminTestJSON-292013889 None] Created reservations ['cde9cf4f-14e2-47dc-93b2-dd04cb8247f8', '912b37fb-cbd3-424c-a736-55e04c319248', '962e6a65-0921-463b-bcc1-e9c5e1f92624', '988dee86-5f6b-43df-9bbf-2893b9354884'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:29:37 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-b7cd1b1a-d3be-492d-9ade-ba77c9612a1f tempest-VolumesListAdminTestJSON-292013889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:29:37 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-b7cd1b1a-d3be-492d-9ade-ba77c9612a1f tempest-VolumesListAdminTestJSON-292013889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:29:37 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-b7cd1b1a-d3be-492d-9ade-ba77c9612a1f tempest-VolumesListAdminTestJSON-292013889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:29:37 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-b7cd1b1a-d3be-492d-9ade-ba77c9612a1f tempest-VolumesListAdminTestJSON-292013889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:29:37 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-b7cd1b1a-d3be-492d-9ade-ba77c9612a1f tempest-VolumesListAdminTestJSON-292013889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:29:37 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-b7cd1b1a-d3be-492d-9ade-ba77c9612a1f tempest-VolumesListAdminTestJSON-292013889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:37 devstack sudo[98305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:29:37 devstack sudo[98305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:37 devstack sudo[98305]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:37 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-b7cd1b1a-d3be-492d-9ade-ba77c9612a1f tempest-VolumesListAdminTestJSON-292013889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.274s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:37 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-b7cd1b1a-d3be-492d-9ade-ba77c9612a1f tempest-VolumesListAdminTestJSON-292013889 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:29:37 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-b7cd1b1a-d3be-492d-9ade-ba77c9612a1f tempest-VolumesListAdminTestJSON-292013889 None] Deleted volume successfully.
Jul 30 20:29:37 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-b7cd1b1a-d3be-492d-9ade-ba77c9612a1f tempest-VolumesListAdminTestJSON-292013889 None] Lock "cinder-7c887208-4114-46ab-8a68-54f1345eedaa-delete_volume" released by "delete_volume" :: held 1.267s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:29:37 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-8e6caa23-d562-40c0-ae0e-11f7edad2aab tempest-VolumesListAdminTestJSON-292013889 None] Acquiring lock "cinder-2098dfb7-bdf0-4c77-8a37-1c12f64e81a9-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:29:37 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-8e6caa23-d562-40c0-ae0e-11f7edad2aab tempest-VolumesListAdminTestJSON-292013889 None] Lock "cinder-2098dfb7-bdf0-4c77-8a37-1c12f64e81a9-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:29:38 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-8e6caa23-d562-40c0-ae0e-11f7edad2aab tempest-VolumesListAdminTestJSON-292013889 None] Acquiring lock "cinder-quobyte-2098dfb7-bdf0-4c77-8a37-1c12f64e81a9" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:29:38 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-8e6caa23-d562-40c0-ae0e-11f7edad2aab tempest-VolumesListAdminTestJSON-292013889 None] Lock "cinder-quobyte-2098dfb7-bdf0-4c77-8a37-1c12f64e81a9" acquired by "delete_volume" :: waited 0.028s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:29:38 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb3b6a06-2121-4b53-a8c0-194fb8a1eb9e]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:29:38 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8e6caa23-d562-40c0-ae0e-11f7edad2aab tempest-VolumesListAdminTestJSON-292013889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2098dfb7-bdf0-4c77-8a37-1c12f64e81a9 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:38 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-444430e0-af8a-4212-a18a-498e74f49264 tempest-VolumesTestJSON-459864983 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:29:38 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-444430e0-af8a-4212-a18a-498e74f49264 tempest-VolumesTestJSON-459864983 None] Flow 'volume_create_manager' (274e6d77-6d9b-4f0d-982e-5aad8cd7f225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:29:38 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-444430e0-af8a-4212-a18a-498e74f49264 tempest-VolumesTestJSON-459864983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0f50db7-b44f-498f-922f-3d36f7a24234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:38 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-444430e0-af8a-4212-a18a-498e74f49264 tempest-VolumesTestJSON-459864983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0f50db7-b44f-498f-922f-3d36f7a24234) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:29:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2060909748',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31546941-91c8-4bad-941d-46a79c00c185,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3ef7ec4a68494e98bd7cb412f54d1996',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:29:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:29:38Z,use_quota=True,user_id='b5b83971ab1c4bc0b81812ca82aa8b21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:38 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-444430e0-af8a-4212-a18a-498e74f49264 tempest-VolumesTestJSON-459864983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (624ee30f-cbef-404b-9eb3-b37e797ddb34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:38 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-444430e0-af8a-4212-a18a-498e74f49264 tempest-VolumesTestJSON-459864983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (624ee30f-cbef-404b-9eb3-b37e797ddb34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:38 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-444430e0-af8a-4212-a18a-498e74f49264 tempest-VolumesTestJSON-459864983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30678e08-c3af-43e6-a2cf-c52f7ff9bab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:38 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-444430e0-af8a-4212-a18a-498e74f49264 tempest-VolumesTestJSON-459864983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30678e08-c3af-43e6-a2cf-c52f7ff9bab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31546941-91c8-4bad-941d-46a79c00c185', 'volume_name': 'volume-31546941-91c8-4bad-941d-46a79c00c185', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:38 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-444430e0-af8a-4212-a18a-498e74f49264 tempest-VolumesTestJSON-459864983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8f37969-93d4-4e29-b4e1-14bbddc07b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:38 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-444430e0-af8a-4212-a18a-498e74f49264 tempest-VolumesTestJSON-459864983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8f37969-93d4-4e29-b4e1-14bbddc07b90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:38 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-444430e0-af8a-4212-a18a-498e74f49264 tempest-VolumesTestJSON-459864983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e6cf1de-b532-4249-a8b8-0fbedfbad536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:38 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-444430e0-af8a-4212-a18a-498e74f49264 tempest-VolumesTestJSON-459864983 None] Volume 31546941-91c8-4bad-941d-46a79c00c185: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31546941-91c8-4bad-941d-46a79c00c185', 'volume_size': 1}
Jul 30 20:29:38 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-444430e0-af8a-4212-a18a-498e74f49264 tempest-VolumesTestJSON-459864983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:29:38 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-444430e0-af8a-4212-a18a-498e74f49264 tempest-VolumesTestJSON-459864983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:29:38 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-444430e0-af8a-4212-a18a-498e74f49264 tempest-VolumesTestJSON-459864983 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:29:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2060909748',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31546941-91c8-4bad-941d-46a79c00c185,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3ef7ec4a68494e98bd7cb412f54d1996',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:29:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:29:38Z,use_quota=True,user_id='b5b83971ab1c4bc0b81812ca82aa8b21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:29:38 devstack sudo[98311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2098dfb7-bdf0-4c77-8a37-1c12f64e81a9
Jul 30 20:29:38 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-444430e0-af8a-4212-a18a-498e74f49264 tempest-VolumesTestJSON-459864983 None] Creating volume 31546941-91c8-4bad-941d-46a79c00c185 {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:29:38 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-444430e0-af8a-4212-a18a-498e74f49264 tempest-VolumesTestJSON-459864983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:29:38 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-444430e0-af8a-4212-a18a-498e74f49264 tempest-VolumesTestJSON-459864983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:29:38 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-444430e0-af8a-4212-a18a-498e74f49264 tempest-VolumesTestJSON-459864983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:29:38 devstack sudo[98311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:38 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-444430e0-af8a-4212-a18a-498e74f49264 tempest-VolumesTestJSON-459864983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:29:38 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-444430e0-af8a-4212-a18a-498e74f49264 tempest-VolumesTestJSON-459864983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:29:38 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-444430e0-af8a-4212-a18a-498e74f49264 tempest-VolumesTestJSON-459864983 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:29:38 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-444430e0-af8a-4212-a18a-498e74f49264 tempest-VolumesTestJSON-459864983 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:29:38 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-444430e0-af8a-4212-a18a-498e74f49264 tempest-VolumesTestJSON-459864983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-31546941-91c8-4bad-941d-46a79c00c185 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:38 devstack sudo[98313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-31546941-91c8-4bad-941d-46a79c00c185 1073741824
Jul 30 20:29:38 devstack sudo[98313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:38 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcb445c7-f2fc-4449-9e54-8e54e23c64aa tempest-VolumesMetadataTest-283805290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:29:38 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-dcb445c7-f2fc-4449-9e54-8e54e23c64aa tempest-VolumesMetadataTest-283805290 None] Flow 'volume_create_manager' (cecfc99c-6994-4aef-8a5b-6705a9569698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:29:38 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-dcb445c7-f2fc-4449-9e54-8e54e23c64aa tempest-VolumesMetadataTest-283805290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c61be059-1e8e-4372-923f-72b561d40916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:38 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-dcb445c7-f2fc-4449-9e54-8e54e23c64aa tempest-VolumesMetadataTest-283805290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c61be059-1e8e-4372-923f-72b561d40916) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:29:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1372345346',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fef22d6-1e35-46b7-8a9f-150baf5e4ff5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a158d8dc2f9457bb01864f7a68b220b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:29:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:29:38Z,use_quota=True,user_id='9d899cc12dda407cb5b2090f9e40a5fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:38 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-dcb445c7-f2fc-4449-9e54-8e54e23c64aa tempest-VolumesMetadataTest-283805290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bbba8df-04a3-485b-9647-3fbe75c2a7fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:38 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-dcb445c7-f2fc-4449-9e54-8e54e23c64aa tempest-VolumesMetadataTest-283805290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bbba8df-04a3-485b-9647-3fbe75c2a7fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:38 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-dcb445c7-f2fc-4449-9e54-8e54e23c64aa tempest-VolumesMetadataTest-283805290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5e9d585-bf35-43f2-9dcb-6e0d3d8065f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:38 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-dcb445c7-f2fc-4449-9e54-8e54e23c64aa tempest-VolumesMetadataTest-283805290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5e9d585-bf35-43f2-9dcb-6e0d3d8065f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3fef22d6-1e35-46b7-8a9f-150baf5e4ff5', 'volume_name': 'volume-3fef22d6-1e35-46b7-8a9f-150baf5e4ff5', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:38 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-dcb445c7-f2fc-4449-9e54-8e54e23c64aa tempest-VolumesMetadataTest-283805290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81bed456-bf8c-4bc1-b541-fde198e51e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:38 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-dcb445c7-f2fc-4449-9e54-8e54e23c64aa tempest-VolumesMetadataTest-283805290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81bed456-bf8c-4bc1-b541-fde198e51e4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:38 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-dcb445c7-f2fc-4449-9e54-8e54e23c64aa tempest-VolumesMetadataTest-283805290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60ec5844-e635-468b-97ee-4fcb885d7a8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:38 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-dcb445c7-f2fc-4449-9e54-8e54e23c64aa tempest-VolumesMetadataTest-283805290 None] Volume 3fef22d6-1e35-46b7-8a9f-150baf5e4ff5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3fef22d6-1e35-46b7-8a9f-150baf5e4ff5', 'volume_size': 1}
Jul 30 20:29:38 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-dcb445c7-f2fc-4449-9e54-8e54e23c64aa tempest-VolumesMetadataTest-283805290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:29:38 devstack sudo[98311]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:38 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8e6caa23-d562-40c0-ae0e-11f7edad2aab tempest-VolumesListAdminTestJSON-292013889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2098dfb7-bdf0-4c77-8a37-1c12f64e81a9" returned: 0 in 0.415s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:38 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8e6caa23-d562-40c0-ae0e-11f7edad2aab tempest-VolumesListAdminTestJSON-292013889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2098dfb7-bdf0-4c77-8a37-1c12f64e81a9 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:38 devstack sudo[98322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2098dfb7-bdf0-4c77-8a37-1c12f64e81a9
Jul 30 20:29:38 devstack sudo[98322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:38 devstack sudo[98313]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:38 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-444430e0-af8a-4212-a18a-498e74f49264 tempest-VolumesTestJSON-459864983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-31546941-91c8-4bad-941d-46a79c00c185 1073741824" returned: 0 in 0.527s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:38 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-444430e0-af8a-4212-a18a-498e74f49264 tempest-VolumesTestJSON-459864983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-31546941-91c8-4bad-941d-46a79c00c185 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:38 devstack sudo[98326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-31546941-91c8-4bad-941d-46a79c00c185
Jul 30 20:29:38 devstack sudo[98326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:38 devstack sudo[98322]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:38 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8e6caa23-d562-40c0-ae0e-11f7edad2aab tempest-VolumesListAdminTestJSON-292013889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2098dfb7-bdf0-4c77-8a37-1c12f64e81a9" returned: 0 in 0.365s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:38 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-8e6caa23-d562-40c0-ae0e-11f7edad2aab tempest-VolumesListAdminTestJSON-292013889 None] Lock "cinder-quobyte-2098dfb7-bdf0-4c77-8a37-1c12f64e81a9" released by "delete_volume" :: held 0.861s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:29:38 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-119deb8a-894e-4aaa-afa1-cd899ca85868 tempest-VolumeTypesAccessTest-139608777 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:29:38 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-119deb8a-894e-4aaa-afa1-cd899ca85868 tempest-VolumeTypesAccessTest-139608777 None] Flow 'volume_create_manager' (2ff6927e-8d8e-4565-a90a-8120948c999b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:29:38 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-119deb8a-894e-4aaa-afa1-cd899ca85868 tempest-VolumeTypesAccessTest-139608777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9492acea-f259-4f0c-988c-f0d39a24269d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:38 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-119deb8a-894e-4aaa-afa1-cd899ca85868 tempest-VolumeTypesAccessTest-139608777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9492acea-f259-4f0c-988c-f0d39a24269d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:29:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-809727300',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3aee9e05-ff6e-4d59-92ac-53708cf853ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5925b98118042bda319a11ea6df49ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:29:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:29:39Z,use_quota=True,user_id='f2f476c4bc5a4f28b85c672b3da8850f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0a3c88f-7ad1-4281-b664-c6fe8cb759f9),volume_type_id=c0a3c88f-7ad1-4281-b664-c6fe8cb759f9)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:38 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-119deb8a-894e-4aaa-afa1-cd899ca85868 tempest-VolumeTypesAccessTest-139608777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e5d85c7-5a60-4c08-878d-d1b4326b94ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:38 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-119deb8a-894e-4aaa-afa1-cd899ca85868 tempest-VolumeTypesAccessTest-139608777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e5d85c7-5a60-4c08-878d-d1b4326b94ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:39 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-119deb8a-894e-4aaa-afa1-cd899ca85868 tempest-VolumeTypesAccessTest-139608777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f196cafc-4a82-47be-874e-6564370bef60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:39 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-119deb8a-894e-4aaa-afa1-cd899ca85868 tempest-VolumeTypesAccessTest-139608777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f196cafc-4a82-47be-874e-6564370bef60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3aee9e05-ff6e-4d59-92ac-53708cf853ba', 'volume_name': 'volume-3aee9e05-ff6e-4d59-92ac-53708cf853ba', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:39 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-119deb8a-894e-4aaa-afa1-cd899ca85868 tempest-VolumeTypesAccessTest-139608777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3348baff-74fd-4036-be6f-0b8d1854bd4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:39 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-119deb8a-894e-4aaa-afa1-cd899ca85868 tempest-VolumeTypesAccessTest-139608777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3348baff-74fd-4036-be6f-0b8d1854bd4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:39 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-119deb8a-894e-4aaa-afa1-cd899ca85868 tempest-VolumeTypesAccessTest-139608777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2714f3e-def7-400c-81b7-eef5c350a80a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:39 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-119deb8a-894e-4aaa-afa1-cd899ca85868 tempest-VolumeTypesAccessTest-139608777 None] Volume 3aee9e05-ff6e-4d59-92ac-53708cf853ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3aee9e05-ff6e-4d59-92ac-53708cf853ba', 'volume_size': 1}
Jul 30 20:29:39 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-119deb8a-894e-4aaa-afa1-cd899ca85868 tempest-VolumeTypesAccessTest-139608777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:29:39 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-8e6caa23-d562-40c0-ae0e-11f7edad2aab tempest-VolumesListAdminTestJSON-292013889 None] Created reservations ['e9a9191e-b036-4c22-b931-b95d4914ef78', '195f0f14-0d15-4933-804e-0f68102b54d0', '0ee631bd-da53-4e4a-a01b-64cc9003af3f', '6f7212de-3a93-4454-8c6b-b9b292461523'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:29:39 devstack sudo[98326]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:39 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-444430e0-af8a-4212-a18a-498e74f49264 tempest-VolumesTestJSON-459864983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-31546941-91c8-4bad-941d-46a79c00c185" returned: 0 in 0.281s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:39 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-444430e0-af8a-4212-a18a-498e74f49264 tempest-VolumesTestJSON-459864983 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:29:39 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-444430e0-af8a-4212-a18a-498e74f49264 tempest-VolumesTestJSON-459864983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:29:39 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-dcb445c7-f2fc-4449-9e54-8e54e23c64aa tempest-VolumesMetadataTest-283805290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.773s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:29:39 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-dcb445c7-f2fc-4449-9e54-8e54e23c64aa tempest-VolumesMetadataTest-283805290 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:29:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1372345346',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fef22d6-1e35-46b7-8a9f-150baf5e4ff5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a158d8dc2f9457bb01864f7a68b220b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:29:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:29:38Z,use_quota=True,user_id='9d899cc12dda407cb5b2090f9e40a5fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:29:39 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-dcb445c7-f2fc-4449-9e54-8e54e23c64aa tempest-VolumesMetadataTest-283805290 None] Creating volume 3fef22d6-1e35-46b7-8a9f-150baf5e4ff5 {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:29:39 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-dcb445c7-f2fc-4449-9e54-8e54e23c64aa tempest-VolumesMetadataTest-283805290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:29:39 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-dcb445c7-f2fc-4449-9e54-8e54e23c64aa tempest-VolumesMetadataTest-283805290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:29:39 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-dcb445c7-f2fc-4449-9e54-8e54e23c64aa tempest-VolumesMetadataTest-283805290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:29:39 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-dcb445c7-f2fc-4449-9e54-8e54e23c64aa tempest-VolumesMetadataTest-283805290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:29:39 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-dcb445c7-f2fc-4449-9e54-8e54e23c64aa tempest-VolumesMetadataTest-283805290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:29:39 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-dcb445c7-f2fc-4449-9e54-8e54e23c64aa tempest-VolumesMetadataTest-283805290 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:29:39 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-dcb445c7-f2fc-4449-9e54-8e54e23c64aa tempest-VolumesMetadataTest-283805290 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:29:39 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-dcb445c7-f2fc-4449-9e54-8e54e23c64aa tempest-VolumesMetadataTest-283805290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3fef22d6-1e35-46b7-8a9f-150baf5e4ff5 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:39 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-444430e0-af8a-4212-a18a-498e74f49264 tempest-VolumesTestJSON-459864983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e6cf1de-b532-4249-a8b8-0fbedfbad536) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31546941-91c8-4bad-941d-46a79c00c185', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:39 devstack sudo[98329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3fef22d6-1e35-46b7-8a9f-150baf5e4ff5 1073741824
Jul 30 20:29:39 devstack sudo[98329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:39 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-444430e0-af8a-4212-a18a-498e74f49264 tempest-VolumesTestJSON-459864983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cde49461-6a46-48d4-ab70-aa0cfd7afbe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:39 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-8e6caa23-d562-40c0-ae0e-11f7edad2aab tempest-VolumesListAdminTestJSON-292013889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:29:39 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-8e6caa23-d562-40c0-ae0e-11f7edad2aab tempest-VolumesListAdminTestJSON-292013889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:29:39 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-8e6caa23-d562-40c0-ae0e-11f7edad2aab tempest-VolumesListAdminTestJSON-292013889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:29:39 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-8e6caa23-d562-40c0-ae0e-11f7edad2aab tempest-VolumesListAdminTestJSON-292013889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:29:39 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-8e6caa23-d562-40c0-ae0e-11f7edad2aab tempest-VolumesListAdminTestJSON-292013889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:29:39 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8e6caa23-d562-40c0-ae0e-11f7edad2aab tempest-VolumesListAdminTestJSON-292013889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:39 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-444430e0-af8a-4212-a18a-498e74f49264 tempest-VolumesTestJSON-459864983 None] Volume volume-31546941-91c8-4bad-941d-46a79c00c185 (31546941-91c8-4bad-941d-46a79c00c185): created successfully
Jul 30 20:29:39 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-444430e0-af8a-4212-a18a-498e74f49264 tempest-VolumesTestJSON-459864983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cde49461-6a46-48d4-ab70-aa0cfd7afbe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:39 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-444430e0-af8a-4212-a18a-498e74f49264 tempest-VolumesTestJSON-459864983 None] Flow 'volume_create_manager' (274e6d77-6d9b-4f0d-982e-5aad8cd7f225) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:29:39 devstack sudo[98331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:29:39 devstack sudo[98331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:39 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-444430e0-af8a-4212-a18a-498e74f49264 tempest-VolumesTestJSON-459864983 None] Created volume successfully.
Jul 30 20:29:39 devstack sudo[98331]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:39 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8e6caa23-d562-40c0-ae0e-11f7edad2aab tempest-VolumesListAdminTestJSON-292013889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.286s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:39 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-8e6caa23-d562-40c0-ae0e-11f7edad2aab tempest-VolumesListAdminTestJSON-292013889 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:29:39 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-8e6caa23-d562-40c0-ae0e-11f7edad2aab tempest-VolumesListAdminTestJSON-292013889 None] Deleted volume successfully.
Jul 30 20:29:39 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-8e6caa23-d562-40c0-ae0e-11f7edad2aab tempest-VolumesListAdminTestJSON-292013889 None] Lock "cinder-2098dfb7-bdf0-4c77-8a37-1c12f64e81a9-delete_volume" released by "delete_volume" :: held 1.551s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:29:39 devstack sudo[98329]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:39 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-dcb445c7-f2fc-4449-9e54-8e54e23c64aa tempest-VolumesMetadataTest-283805290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3fef22d6-1e35-46b7-8a9f-150baf5e4ff5 1073741824" returned: 0 in 0.488s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:39 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-dcb445c7-f2fc-4449-9e54-8e54e23c64aa tempest-VolumesMetadataTest-283805290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3fef22d6-1e35-46b7-8a9f-150baf5e4ff5 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:39 devstack sudo[98338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3fef22d6-1e35-46b7-8a9f-150baf5e4ff5
Jul 30 20:29:39 devstack sudo[98338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:39 devstack sudo[98338]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:39 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-dcb445c7-f2fc-4449-9e54-8e54e23c64aa tempest-VolumesMetadataTest-283805290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3fef22d6-1e35-46b7-8a9f-150baf5e4ff5" returned: 0 in 0.253s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:39 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-dcb445c7-f2fc-4449-9e54-8e54e23c64aa tempest-VolumesMetadataTest-283805290 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:29:39 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-dcb445c7-f2fc-4449-9e54-8e54e23c64aa tempest-VolumesMetadataTest-283805290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.791s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:29:39 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-119deb8a-894e-4aaa-afa1-cd899ca85868 tempest-VolumeTypesAccessTest-139608777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.900s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:29:39 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-119deb8a-894e-4aaa-afa1-cd899ca85868 tempest-VolumeTypesAccessTest-139608777 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:29:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-809727300',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3aee9e05-ff6e-4d59-92ac-53708cf853ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5925b98118042bda319a11ea6df49ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:29:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:29:39Z,use_quota=True,user_id='f2f476c4bc5a4f28b85c672b3da8850f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0a3c88f-7ad1-4281-b664-c6fe8cb759f9),volume_type_id=c0a3c88f-7ad1-4281-b664-c6fe8cb759f9)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:29:39 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-119deb8a-894e-4aaa-afa1-cd899ca85868 tempest-VolumeTypesAccessTest-139608777 None] Creating volume 3aee9e05-ff6e-4d59-92ac-53708cf853ba {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:29:39 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-119deb8a-894e-4aaa-afa1-cd899ca85868 tempest-VolumeTypesAccessTest-139608777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:29:39 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-119deb8a-894e-4aaa-afa1-cd899ca85868 tempest-VolumeTypesAccessTest-139608777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:29:39 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-119deb8a-894e-4aaa-afa1-cd899ca85868 tempest-VolumeTypesAccessTest-139608777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:29:39 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-119deb8a-894e-4aaa-afa1-cd899ca85868 tempest-VolumeTypesAccessTest-139608777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:29:39 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-119deb8a-894e-4aaa-afa1-cd899ca85868 tempest-VolumeTypesAccessTest-139608777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:29:39 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-119deb8a-894e-4aaa-afa1-cd899ca85868 tempest-VolumeTypesAccessTest-139608777 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:29:39 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-119deb8a-894e-4aaa-afa1-cd899ca85868 tempest-VolumeTypesAccessTest-139608777 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:29:39 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-119deb8a-894e-4aaa-afa1-cd899ca85868 tempest-VolumeTypesAccessTest-139608777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3aee9e05-ff6e-4d59-92ac-53708cf853ba 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:39 devstack cinder-volume[88719]: DEBUG dbcounter [-] [88719] Writing DB stats cinder:SELECT=166,cinder:UPDATE=214,cinder:INSERT=58,cinder:DELETE=24 {{(pid=88719) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 30 20:29:39 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-dcb445c7-f2fc-4449-9e54-8e54e23c64aa tempest-VolumesMetadataTest-283805290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60ec5844-e635-468b-97ee-4fcb885d7a8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fef22d6-1e35-46b7-8a9f-150baf5e4ff5', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:39 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-dcb445c7-f2fc-4449-9e54-8e54e23c64aa tempest-VolumesMetadataTest-283805290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1b1b34f-5ed3-4bd8-a15a-97bb3e3a6aa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:39 devstack sudo[98341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3aee9e05-ff6e-4d59-92ac-53708cf853ba 1073741824
Jul 30 20:29:39 devstack sudo[98341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:39 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-dcb445c7-f2fc-4449-9e54-8e54e23c64aa tempest-VolumesMetadataTest-283805290 None] Volume volume-3fef22d6-1e35-46b7-8a9f-150baf5e4ff5 (3fef22d6-1e35-46b7-8a9f-150baf5e4ff5): created successfully
Jul 30 20:29:39 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-dcb445c7-f2fc-4449-9e54-8e54e23c64aa tempest-VolumesMetadataTest-283805290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1b1b34f-5ed3-4bd8-a15a-97bb3e3a6aa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:39 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-dcb445c7-f2fc-4449-9e54-8e54e23c64aa tempest-VolumesMetadataTest-283805290 None] Flow 'volume_create_manager' (cecfc99c-6994-4aef-8a5b-6705a9569698) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:29:40 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-dcb445c7-f2fc-4449-9e54-8e54e23c64aa tempest-VolumesMetadataTest-283805290 None] Created volume successfully.
Jul 30 20:29:40 devstack cinder-volume[88719]: DEBUG dbcounter [-] [88719] Writing DB stats cinder:UPDATE=233,cinder:SELECT=163,cinder:INSERT=46,cinder:DELETE=16 {{(pid=88719) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 30 20:29:40 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-119deb8a-894e-4aaa-afa1-cd899ca85868 tempest-VolumeTypesAccessTest-139608777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3aee9e05-ff6e-4d59-92ac-53708cf853ba 1073741824" returned: 0 in 0.565s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:40 devstack sudo[98341]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:40 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-119deb8a-894e-4aaa-afa1-cd899ca85868 tempest-VolumeTypesAccessTest-139608777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3aee9e05-ff6e-4d59-92ac-53708cf853ba {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:40 devstack sudo[98347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3aee9e05-ff6e-4d59-92ac-53708cf853ba
Jul 30 20:29:40 devstack sudo[98347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:40 devstack sudo[98347]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:40 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-119deb8a-894e-4aaa-afa1-cd899ca85868 tempest-VolumeTypesAccessTest-139608777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3aee9e05-ff6e-4d59-92ac-53708cf853ba" returned: 0 in 0.330s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:40 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-119deb8a-894e-4aaa-afa1-cd899ca85868 tempest-VolumeTypesAccessTest-139608777 None] <== create_volume: return (954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:29:40 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-119deb8a-894e-4aaa-afa1-cd899ca85868 tempest-VolumeTypesAccessTest-139608777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:29:40 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-119deb8a-894e-4aaa-afa1-cd899ca85868 tempest-VolumeTypesAccessTest-139608777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2714f3e-def7-400c-81b7-eef5c350a80a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3aee9e05-ff6e-4d59-92ac-53708cf853ba', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:40 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-119deb8a-894e-4aaa-afa1-cd899ca85868 tempest-VolumeTypesAccessTest-139608777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bba2036-c13f-4b1d-9818-d333b6d6b929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:40 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-119deb8a-894e-4aaa-afa1-cd899ca85868 tempest-VolumeTypesAccessTest-139608777 None] Volume volume-3aee9e05-ff6e-4d59-92ac-53708cf853ba (3aee9e05-ff6e-4d59-92ac-53708cf853ba): created successfully
Jul 30 20:29:40 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-119deb8a-894e-4aaa-afa1-cd899ca85868 tempest-VolumeTypesAccessTest-139608777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bba2036-c13f-4b1d-9818-d333b6d6b929) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:40 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-119deb8a-894e-4aaa-afa1-cd899ca85868 tempest-VolumeTypesAccessTest-139608777 None] Flow 'volume_create_manager' (2ff6927e-8d8e-4565-a90a-8120948c999b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:29:40 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-119deb8a-894e-4aaa-afa1-cd899ca85868 tempest-VolumeTypesAccessTest-139608777 None] Created volume successfully.
Jul 30 20:29:41 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-ea745180-e5e5-4cb9-9aef-061f7600f5ac tempest-VolumesMetadataTest-283805290 None] Acquiring lock "cinder-3fef22d6-1e35-46b7-8a9f-150baf5e4ff5-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:29:41 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-ea745180-e5e5-4cb9-9aef-061f7600f5ac tempest-VolumesMetadataTest-283805290 None] Lock "cinder-3fef22d6-1e35-46b7-8a9f-150baf5e4ff5-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:29:41 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-ea745180-e5e5-4cb9-9aef-061f7600f5ac tempest-VolumesMetadataTest-283805290 None] Acquiring lock "cinder-quobyte-3fef22d6-1e35-46b7-8a9f-150baf5e4ff5" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:29:41 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-ea745180-e5e5-4cb9-9aef-061f7600f5ac tempest-VolumesMetadataTest-283805290 None] Lock "cinder-quobyte-3fef22d6-1e35-46b7-8a9f-150baf5e4ff5" acquired by "delete_volume" :: waited 0.017s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:29:41 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[f03035dd-a726-42e8-9e4f-269e5471ba04]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:29:41 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-ea745180-e5e5-4cb9-9aef-061f7600f5ac tempest-VolumesMetadataTest-283805290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3fef22d6-1e35-46b7-8a9f-150baf5e4ff5 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:41 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-90a3cfb2-61b5-4616-8c0f-3d05dc4ea777 tempest-VolumesTestJSON-459864983 None] Acquiring lock "cinder-31546941-91c8-4bad-941d-46a79c00c185-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:29:41 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-90a3cfb2-61b5-4616-8c0f-3d05dc4ea777 tempest-VolumesTestJSON-459864983 None] Lock "cinder-31546941-91c8-4bad-941d-46a79c00c185-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:29:41 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-90a3cfb2-61b5-4616-8c0f-3d05dc4ea777 tempest-VolumesTestJSON-459864983 None] Acquiring lock "cinder-quobyte-31546941-91c8-4bad-941d-46a79c00c185" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:29:41 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-90a3cfb2-61b5-4616-8c0f-3d05dc4ea777 tempest-VolumesTestJSON-459864983 None] Lock "cinder-quobyte-31546941-91c8-4bad-941d-46a79c00c185" acquired by "delete_volume" :: waited 0.018s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:29:41 devstack sudo[98350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3fef22d6-1e35-46b7-8a9f-150baf5e4ff5
Jul 30 20:29:41 devstack sudo[98350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:41 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eaff365-ec6f-4d8c-bc1e-7a56d67e61bc]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:29:41 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-90a3cfb2-61b5-4616-8c0f-3d05dc4ea777 tempest-VolumesTestJSON-459864983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-31546941-91c8-4bad-941d-46a79c00c185 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:41 devstack sudo[98352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-31546941-91c8-4bad-941d-46a79c00c185
Jul 30 20:29:41 devstack sudo[98352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:41 devstack sudo[98350]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:41 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-ea745180-e5e5-4cb9-9aef-061f7600f5ac tempest-VolumesMetadataTest-283805290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3fef22d6-1e35-46b7-8a9f-150baf5e4ff5" returned: 0 in 0.426s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:41 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-ea745180-e5e5-4cb9-9aef-061f7600f5ac tempest-VolumesMetadataTest-283805290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3fef22d6-1e35-46b7-8a9f-150baf5e4ff5 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:41 devstack sudo[98358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3fef22d6-1e35-46b7-8a9f-150baf5e4ff5
Jul 30 20:29:41 devstack sudo[98358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:41 devstack sudo[98352]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:41 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-90a3cfb2-61b5-4616-8c0f-3d05dc4ea777 tempest-VolumesTestJSON-459864983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-31546941-91c8-4bad-941d-46a79c00c185" returned: 0 in 0.404s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:41 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-90a3cfb2-61b5-4616-8c0f-3d05dc4ea777 tempest-VolumesTestJSON-459864983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-31546941-91c8-4bad-941d-46a79c00c185 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:41 devstack sudo[98364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-31546941-91c8-4bad-941d-46a79c00c185
Jul 30 20:29:41 devstack sudo[98364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:42 devstack sudo[98358]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:42 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-ea745180-e5e5-4cb9-9aef-061f7600f5ac tempest-VolumesMetadataTest-283805290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3fef22d6-1e35-46b7-8a9f-150baf5e4ff5" returned: 0 in 0.331s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:42 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-ea745180-e5e5-4cb9-9aef-061f7600f5ac tempest-VolumesMetadataTest-283805290 None] Lock "cinder-quobyte-3fef22d6-1e35-46b7-8a9f-150baf5e4ff5" released by "delete_volume" :: held 0.817s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:29:42 devstack sudo[98364]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:42 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-90a3cfb2-61b5-4616-8c0f-3d05dc4ea777 tempest-VolumesTestJSON-459864983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-31546941-91c8-4bad-941d-46a79c00c185" returned: 0 in 0.295s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:42 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-90a3cfb2-61b5-4616-8c0f-3d05dc4ea777 tempest-VolumesTestJSON-459864983 None] Lock "cinder-quobyte-31546941-91c8-4bad-941d-46a79c00c185" released by "delete_volume" :: held 0.746s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:29:42 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-ea745180-e5e5-4cb9-9aef-061f7600f5ac tempest-VolumesMetadataTest-283805290 None] Created reservations ['cf492334-6fe1-4ef2-8343-a900340dae4b', 'ad6cb42b-5d8d-42a2-b242-9207a7413a00', '619f1c64-357f-4360-9bfa-14c7f318d6a2', '39cf300e-154d-47c5-92e6-5202ed3e6f0f'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:29:42 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-a67b9641-0171-4e3b-b5cb-6a8672e7a1a6 tempest-VolumeTypesAccessTest-139608777 None] Acquiring lock "cinder-3aee9e05-ff6e-4d59-92ac-53708cf853ba-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:29:42 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-a67b9641-0171-4e3b-b5cb-6a8672e7a1a6 tempest-VolumeTypesAccessTest-139608777 None] Lock "cinder-3aee9e05-ff6e-4d59-92ac-53708cf853ba-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:29:42 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-a67b9641-0171-4e3b-b5cb-6a8672e7a1a6 tempest-VolumeTypesAccessTest-139608777 None] Acquiring lock "cinder-quobyte-3aee9e05-ff6e-4d59-92ac-53708cf853ba" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:29:42 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-90a3cfb2-61b5-4616-8c0f-3d05dc4ea777 tempest-VolumesTestJSON-459864983 None] Created reservations ['dd8ca028-6ce8-4433-a4a9-7e5eb3c07da1', '4d8fd74a-a9a3-4e9f-99b3-e0f61b5a6177', '0fb5dae1-76b5-40a1-bfb8-60cd530a1741', 'c7e0c640-faa4-428b-a461-6d00cbf2ff6b'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:29:42 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-a67b9641-0171-4e3b-b5cb-6a8672e7a1a6 tempest-VolumeTypesAccessTest-139608777 None] Lock "cinder-quobyte-3aee9e05-ff6e-4d59-92ac-53708cf853ba" acquired by "delete_volume" :: waited 0.035s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:29:42 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-ea745180-e5e5-4cb9-9aef-061f7600f5ac tempest-VolumesMetadataTest-283805290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:29:42 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-ea745180-e5e5-4cb9-9aef-061f7600f5ac tempest-VolumesMetadataTest-283805290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:29:42 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-ea745180-e5e5-4cb9-9aef-061f7600f5ac tempest-VolumesMetadataTest-283805290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:29:42 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-ea745180-e5e5-4cb9-9aef-061f7600f5ac tempest-VolumesMetadataTest-283805290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:29:42 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-ea745180-e5e5-4cb9-9aef-061f7600f5ac tempest-VolumesMetadataTest-283805290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:29:42 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-ea745180-e5e5-4cb9-9aef-061f7600f5ac tempest-VolumesMetadataTest-283805290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:42 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6fb2beb-0431-40dd-8cab-f26f4549789a]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:29:42 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-a67b9641-0171-4e3b-b5cb-6a8672e7a1a6 tempest-VolumeTypesAccessTest-139608777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3aee9e05-ff6e-4d59-92ac-53708cf853ba {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:42 devstack sudo[98368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:29:42 devstack sudo[98368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:42 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-90a3cfb2-61b5-4616-8c0f-3d05dc4ea777 tempest-VolumesTestJSON-459864983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:29:42 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-90a3cfb2-61b5-4616-8c0f-3d05dc4ea777 tempest-VolumesTestJSON-459864983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:29:42 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-90a3cfb2-61b5-4616-8c0f-3d05dc4ea777 tempest-VolumesTestJSON-459864983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:29:42 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-90a3cfb2-61b5-4616-8c0f-3d05dc4ea777 tempest-VolumesTestJSON-459864983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:29:42 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-90a3cfb2-61b5-4616-8c0f-3d05dc4ea777 tempest-VolumesTestJSON-459864983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:29:42 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-90a3cfb2-61b5-4616-8c0f-3d05dc4ea777 tempest-VolumesTestJSON-459864983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:42 devstack sudo[98371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:29:42 devstack sudo[98371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:42 devstack sudo[98369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3aee9e05-ff6e-4d59-92ac-53708cf853ba
Jul 30 20:29:42 devstack sudo[98369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:42 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-abe0295f-0b83-4afa-a73b-f7e610d97ef3 tempest-VolumesTestJSON-459864983 None] Acquiring lock "cinder-9152314f-d408-4a33-9b98-dc7fcb103f4f-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:29:42 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-abe0295f-0b83-4afa-a73b-f7e610d97ef3 tempest-VolumesTestJSON-459864983 None] Lock "cinder-9152314f-d408-4a33-9b98-dc7fcb103f4f-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:29:42 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-abe0295f-0b83-4afa-a73b-f7e610d97ef3 tempest-VolumesTestJSON-459864983 None] Acquiring lock "cinder-quobyte-9152314f-d408-4a33-9b98-dc7fcb103f4f" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:29:42 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-abe0295f-0b83-4afa-a73b-f7e610d97ef3 tempest-VolumesTestJSON-459864983 None] Lock "cinder-quobyte-9152314f-d408-4a33-9b98-dc7fcb103f4f" acquired by "delete_volume" :: waited 0.030s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:29:42 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e40a060-25d5-41fc-a897-719d272b7a54]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:29:42 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-abe0295f-0b83-4afa-a73b-f7e610d97ef3 tempest-VolumesTestJSON-459864983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-9152314f-d408-4a33-9b98-dc7fcb103f4f {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:42 devstack sudo[98371]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:42 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-90a3cfb2-61b5-4616-8c0f-3d05dc4ea777 tempest-VolumesTestJSON-459864983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.376s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:42 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-90a3cfb2-61b5-4616-8c0f-3d05dc4ea777 tempest-VolumesTestJSON-459864983 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:29:42 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-90a3cfb2-61b5-4616-8c0f-3d05dc4ea777 tempest-VolumesTestJSON-459864983 None] Deleted volume successfully.
Jul 30 20:29:42 devstack sudo[98368]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:42 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-ea745180-e5e5-4cb9-9aef-061f7600f5ac tempest-VolumesMetadataTest-283805290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.537s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:42 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-ea745180-e5e5-4cb9-9aef-061f7600f5ac tempest-VolumesMetadataTest-283805290 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:29:42 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-ea745180-e5e5-4cb9-9aef-061f7600f5ac tempest-VolumesMetadataTest-283805290 None] Deleted volume successfully.
Jul 30 20:29:42 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-90a3cfb2-61b5-4616-8c0f-3d05dc4ea777 tempest-VolumesTestJSON-459864983 None] Lock "cinder-31546941-91c8-4bad-941d-46a79c00c185-delete_volume" released by "delete_volume" :: held 1.581s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:29:42 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-ea745180-e5e5-4cb9-9aef-061f7600f5ac tempest-VolumesMetadataTest-283805290 None] Lock "cinder-3fef22d6-1e35-46b7-8a9f-150baf5e4ff5-delete_volume" released by "delete_volume" :: held 1.767s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:29:43 devstack sudo[98376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-9152314f-d408-4a33-9b98-dc7fcb103f4f
Jul 30 20:29:43 devstack sudo[98376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:43 devstack sudo[98369]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:43 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-a67b9641-0171-4e3b-b5cb-6a8672e7a1a6 tempest-VolumeTypesAccessTest-139608777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3aee9e05-ff6e-4d59-92ac-53708cf853ba" returned: 0 in 0.709s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:43 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-a67b9641-0171-4e3b-b5cb-6a8672e7a1a6 tempest-VolumeTypesAccessTest-139608777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3aee9e05-ff6e-4d59-92ac-53708cf853ba {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:43 devstack sudo[98381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3aee9e05-ff6e-4d59-92ac-53708cf853ba
Jul 30 20:29:43 devstack sudo[98381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:43 devstack sudo[98376]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:43 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-abe0295f-0b83-4afa-a73b-f7e610d97ef3 tempest-VolumesTestJSON-459864983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-9152314f-d408-4a33-9b98-dc7fcb103f4f" returned: 0 in 0.531s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:43 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-abe0295f-0b83-4afa-a73b-f7e610d97ef3 tempest-VolumesTestJSON-459864983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-9152314f-d408-4a33-9b98-dc7fcb103f4f {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:43 devstack sudo[98386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-9152314f-d408-4a33-9b98-dc7fcb103f4f
Jul 30 20:29:43 devstack sudo[98386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:43 devstack sudo[98381]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:43 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-a67b9641-0171-4e3b-b5cb-6a8672e7a1a6 tempest-VolumeTypesAccessTest-139608777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3aee9e05-ff6e-4d59-92ac-53708cf853ba" returned: 0 in 0.382s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:43 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-a67b9641-0171-4e3b-b5cb-6a8672e7a1a6 tempest-VolumeTypesAccessTest-139608777 None] Lock "cinder-quobyte-3aee9e05-ff6e-4d59-92ac-53708cf853ba" released by "delete_volume" :: held 1.176s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:29:43 devstack cinder-volume[88719]: WARNING cinder.quota [None req-a67b9641-0171-4e3b-b5cb-6a8672e7a1a6 tempest-VolumeTypesAccessTest-139608777 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1761063991 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1761063991, it is now deprecated. Please use the default quota class for default quota.
Jul 30 20:29:43 devstack cinder-volume[88719]: WARNING cinder.quota [None req-a67b9641-0171-4e3b-b5cb-6a8672e7a1a6 tempest-VolumeTypesAccessTest-139608777 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1761063991 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1761063991, it is now deprecated. Please use the default quota class for default quota.
Jul 30 20:29:43 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-a67b9641-0171-4e3b-b5cb-6a8672e7a1a6 tempest-VolumeTypesAccessTest-139608777 None] Created reservations ['744ded91-7236-4382-904b-8daa8164ad73', '8613a147-4831-44f8-9f75-a7fdb5a3a684', '9a6faa9c-26a7-41b9-99fa-c73c37386783', 'fa236f5c-c0e0-49e3-8534-bd161f2f9fe7'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:29:43 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-a67b9641-0171-4e3b-b5cb-6a8672e7a1a6 tempest-VolumeTypesAccessTest-139608777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:29:43 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-a67b9641-0171-4e3b-b5cb-6a8672e7a1a6 tempest-VolumeTypesAccessTest-139608777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:29:43 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-a67b9641-0171-4e3b-b5cb-6a8672e7a1a6 tempest-VolumeTypesAccessTest-139608777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:29:43 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-a67b9641-0171-4e3b-b5cb-6a8672e7a1a6 tempest-VolumeTypesAccessTest-139608777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:29:43 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-a67b9641-0171-4e3b-b5cb-6a8672e7a1a6 tempest-VolumeTypesAccessTest-139608777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:29:43 devstack sudo[98386]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:43 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-a67b9641-0171-4e3b-b5cb-6a8672e7a1a6 tempest-VolumeTypesAccessTest-139608777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:43 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-abe0295f-0b83-4afa-a73b-f7e610d97ef3 tempest-VolumesTestJSON-459864983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-9152314f-d408-4a33-9b98-dc7fcb103f4f" returned: 0 in 0.369s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:43 devstack sudo[98390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:29:43 devstack sudo[98390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:43 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-abe0295f-0b83-4afa-a73b-f7e610d97ef3 tempest-VolumesTestJSON-459864983 None] Lock "cinder-quobyte-9152314f-d408-4a33-9b98-dc7fcb103f4f" released by "delete_volume" :: held 0.992s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:29:43 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-abe0295f-0b83-4afa-a73b-f7e610d97ef3 tempest-VolumesTestJSON-459864983 None] Created reservations ['96c80f1d-8d3b-4bf5-a4a8-06d0f59636f6', 'bcd4f5eb-c357-4b95-877b-b1aa5e4ec5f3', 'e5937e96-9e6c-46ec-804a-38887c090415', '2c21d289-2616-40c2-83d7-7708d9ca641f'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:29:43 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-abe0295f-0b83-4afa-a73b-f7e610d97ef3 tempest-VolumesTestJSON-459864983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:29:43 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-abe0295f-0b83-4afa-a73b-f7e610d97ef3 tempest-VolumesTestJSON-459864983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:29:43 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-abe0295f-0b83-4afa-a73b-f7e610d97ef3 tempest-VolumesTestJSON-459864983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:29:43 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-abe0295f-0b83-4afa-a73b-f7e610d97ef3 tempest-VolumesTestJSON-459864983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:29:43 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-abe0295f-0b83-4afa-a73b-f7e610d97ef3 tempest-VolumesTestJSON-459864983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:29:43 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-abe0295f-0b83-4afa-a73b-f7e610d97ef3 tempest-VolumesTestJSON-459864983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:43 devstack sudo[98392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:29:43 devstack sudo[98392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:43 devstack sudo[98390]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:43 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-a67b9641-0171-4e3b-b5cb-6a8672e7a1a6 tempest-VolumeTypesAccessTest-139608777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.303s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:43 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-a67b9641-0171-4e3b-b5cb-6a8672e7a1a6 tempest-VolumeTypesAccessTest-139608777 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:29:43 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-a67b9641-0171-4e3b-b5cb-6a8672e7a1a6 tempest-VolumeTypesAccessTest-139608777 None] Deleted volume successfully.
Jul 30 20:29:44 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-a67b9641-0171-4e3b-b5cb-6a8672e7a1a6 tempest-VolumeTypesAccessTest-139608777 None] Lock "cinder-3aee9e05-ff6e-4d59-92ac-53708cf853ba-delete_volume" released by "delete_volume" :: held 1.791s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:29:44 devstack sudo[98392]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:44 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-abe0295f-0b83-4afa-a73b-f7e610d97ef3 tempest-VolumesTestJSON-459864983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.337s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:44 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-abe0295f-0b83-4afa-a73b-f7e610d97ef3 tempest-VolumesTestJSON-459864983 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:29:44 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-abe0295f-0b83-4afa-a73b-f7e610d97ef3 tempest-VolumesTestJSON-459864983 None] Deleted volume successfully.
Jul 30 20:29:44 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-abe0295f-0b83-4afa-a73b-f7e610d97ef3 tempest-VolumesTestJSON-459864983 None] Lock "cinder-9152314f-d408-4a33-9b98-dc7fcb103f4f-delete_volume" released by "delete_volume" :: held 1.626s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:29:44 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-54f6236a-7b2c-4a2b-b886-2fd15679de76 tempest-VolumesTestJSON-459864983 None] Acquiring lock "cinder-519479b1-4e45-42d5-aee5-bbf903e077f8-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:29:44 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-54f6236a-7b2c-4a2b-b886-2fd15679de76 tempest-VolumesTestJSON-459864983 None] Lock "cinder-519479b1-4e45-42d5-aee5-bbf903e077f8-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:29:45 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-54f6236a-7b2c-4a2b-b886-2fd15679de76 tempest-VolumesTestJSON-459864983 None] Acquiring lock "cinder-quobyte-519479b1-4e45-42d5-aee5-bbf903e077f8" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:29:45 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-54f6236a-7b2c-4a2b-b886-2fd15679de76 tempest-VolumesTestJSON-459864983 None] Lock "cinder-quobyte-519479b1-4e45-42d5-aee5-bbf903e077f8" acquired by "delete_volume" :: waited 0.022s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:29:45 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[819d89d7-b452-492e-bcd6-ad4cab81fbf6]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:29:45 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-54f6236a-7b2c-4a2b-b886-2fd15679de76 tempest-VolumesTestJSON-459864983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-519479b1-4e45-42d5-aee5-bbf903e077f8 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:45 devstack sudo[98397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-519479b1-4e45-42d5-aee5-bbf903e077f8
Jul 30 20:29:45 devstack sudo[98397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:45 devstack sudo[98397]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:45 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-54f6236a-7b2c-4a2b-b886-2fd15679de76 tempest-VolumesTestJSON-459864983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-519479b1-4e45-42d5-aee5-bbf903e077f8" returned: 0 in 0.459s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:45 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-54f6236a-7b2c-4a2b-b886-2fd15679de76 tempest-VolumesTestJSON-459864983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-519479b1-4e45-42d5-aee5-bbf903e077f8 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:45 devstack sudo[98403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-519479b1-4e45-42d5-aee5-bbf903e077f8
Jul 30 20:29:45 devstack sudo[98403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:45 devstack sudo[98403]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:45 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-54f6236a-7b2c-4a2b-b886-2fd15679de76 tempest-VolumesTestJSON-459864983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-519479b1-4e45-42d5-aee5-bbf903e077f8" returned: 0 in 0.365s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:45 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-54f6236a-7b2c-4a2b-b886-2fd15679de76 tempest-VolumesTestJSON-459864983 None] Lock "cinder-quobyte-519479b1-4e45-42d5-aee5-bbf903e077f8" released by "delete_volume" :: held 0.888s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:29:45 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-54f6236a-7b2c-4a2b-b886-2fd15679de76 tempest-VolumesTestJSON-459864983 None] Created reservations ['996dd1c0-1c59-415d-8c9f-779a0142c97e', 'e968015f-c837-4e6c-a019-46c25638b404', '5133eaa3-875a-43cd-be76-c4a966d09f06', 'c9052714-dc1d-4769-875b-291c3b12445e'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:29:46 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-54f6236a-7b2c-4a2b-b886-2fd15679de76 tempest-VolumesTestJSON-459864983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:29:46 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-54f6236a-7b2c-4a2b-b886-2fd15679de76 tempest-VolumesTestJSON-459864983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:29:46 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-54f6236a-7b2c-4a2b-b886-2fd15679de76 tempest-VolumesTestJSON-459864983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:29:46 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-54f6236a-7b2c-4a2b-b886-2fd15679de76 tempest-VolumesTestJSON-459864983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:29:46 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-54f6236a-7b2c-4a2b-b886-2fd15679de76 tempest-VolumesTestJSON-459864983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:29:46 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-54f6236a-7b2c-4a2b-b886-2fd15679de76 tempest-VolumesTestJSON-459864983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:46 devstack sudo[98406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:29:46 devstack sudo[98406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:46 devstack sudo[98406]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:46 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-54f6236a-7b2c-4a2b-b886-2fd15679de76 tempest-VolumesTestJSON-459864983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.265s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:46 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-54f6236a-7b2c-4a2b-b886-2fd15679de76 tempest-VolumesTestJSON-459864983 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:29:46 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-54f6236a-7b2c-4a2b-b886-2fd15679de76 tempest-VolumesTestJSON-459864983 None] Deleted volume successfully.
Jul 30 20:29:46 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-54f6236a-7b2c-4a2b-b886-2fd15679de76 tempest-VolumesTestJSON-459864983 None] Lock "cinder-519479b1-4e45-42d5-aee5-bbf903e077f8-delete_volume" released by "delete_volume" :: held 1.428s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:29:50 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-363dd840-2689-4559-8cab-d88e1485ccbd tempest-VolumesTransfersV357Test-472099000 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:29:50 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-363dd840-2689-4559-8cab-d88e1485ccbd tempest-VolumesTransfersV357Test-472099000 None] Flow 'volume_create_manager' (5e07e698-fd2f-4d3c-94e5-563579d36df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:29:50 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-363dd840-2689-4559-8cab-d88e1485ccbd tempest-VolumesTransfersV357Test-472099000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68c2edeb-dc27-4377-a598-188eb6c5215d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:50 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-363dd840-2689-4559-8cab-d88e1485ccbd tempest-VolumesTransfersV357Test-472099000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68c2edeb-dc27-4377-a598-188eb6c5215d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:29:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-698379385',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4be3db5-1e2e-4691-acfa-4d68a1d119f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d7132e285d74754b44a0260c00cf002',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:29:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:29:50Z,use_quota=True,user_id='6cd6820b3dfc4560bd2dbdd95aafda1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:50 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-363dd840-2689-4559-8cab-d88e1485ccbd tempest-VolumesTransfersV357Test-472099000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (022fd8a0-9f45-4a67-b8de-d6f8aa755eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:50 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-363dd840-2689-4559-8cab-d88e1485ccbd tempest-VolumesTransfersV357Test-472099000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (022fd8a0-9f45-4a67-b8de-d6f8aa755eb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:50 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-363dd840-2689-4559-8cab-d88e1485ccbd tempest-VolumesTransfersV357Test-472099000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f9f31c3-11ab-456b-9ba0-8fb8177867b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:50 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-363dd840-2689-4559-8cab-d88e1485ccbd tempest-VolumesTransfersV357Test-472099000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f9f31c3-11ab-456b-9ba0-8fb8177867b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4be3db5-1e2e-4691-acfa-4d68a1d119f2', 'volume_name': 'volume-e4be3db5-1e2e-4691-acfa-4d68a1d119f2', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:50 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-363dd840-2689-4559-8cab-d88e1485ccbd tempest-VolumesTransfersV357Test-472099000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf60be93-c27e-4f68-b08d-fcc236c78657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:50 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-363dd840-2689-4559-8cab-d88e1485ccbd tempest-VolumesTransfersV357Test-472099000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf60be93-c27e-4f68-b08d-fcc236c78657) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:50 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-363dd840-2689-4559-8cab-d88e1485ccbd tempest-VolumesTransfersV357Test-472099000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bd0a94f-b20e-419d-a1ed-0ecd84756acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:50 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-363dd840-2689-4559-8cab-d88e1485ccbd tempest-VolumesTransfersV357Test-472099000 None] Volume e4be3db5-1e2e-4691-acfa-4d68a1d119f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4be3db5-1e2e-4691-acfa-4d68a1d119f2', 'volume_size': 1}
Jul 30 20:29:50 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-363dd840-2689-4559-8cab-d88e1485ccbd tempest-VolumesTransfersV357Test-472099000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:29:50 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-363dd840-2689-4559-8cab-d88e1485ccbd tempest-VolumesTransfersV357Test-472099000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:29:50 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-363dd840-2689-4559-8cab-d88e1485ccbd tempest-VolumesTransfersV357Test-472099000 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:29:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-698379385',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4be3db5-1e2e-4691-acfa-4d68a1d119f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d7132e285d74754b44a0260c00cf002',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:29:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:29:50Z,use_quota=True,user_id='6cd6820b3dfc4560bd2dbdd95aafda1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:29:50 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-363dd840-2689-4559-8cab-d88e1485ccbd tempest-VolumesTransfersV357Test-472099000 None] Creating volume e4be3db5-1e2e-4691-acfa-4d68a1d119f2 {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:29:50 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-363dd840-2689-4559-8cab-d88e1485ccbd tempest-VolumesTransfersV357Test-472099000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:29:50 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-363dd840-2689-4559-8cab-d88e1485ccbd tempest-VolumesTransfersV357Test-472099000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:29:50 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-363dd840-2689-4559-8cab-d88e1485ccbd tempest-VolumesTransfersV357Test-472099000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:29:50 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-363dd840-2689-4559-8cab-d88e1485ccbd tempest-VolumesTransfersV357Test-472099000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:29:50 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-363dd840-2689-4559-8cab-d88e1485ccbd tempest-VolumesTransfersV357Test-472099000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:29:50 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-363dd840-2689-4559-8cab-d88e1485ccbd tempest-VolumesTransfersV357Test-472099000 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:29:50 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-363dd840-2689-4559-8cab-d88e1485ccbd tempest-VolumesTransfersV357Test-472099000 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:29:50 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-363dd840-2689-4559-8cab-d88e1485ccbd tempest-VolumesTransfersV357Test-472099000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-e4be3db5-1e2e-4691-acfa-4d68a1d119f2 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:50 devstack sudo[98409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-e4be3db5-1e2e-4691-acfa-4d68a1d119f2 1073741824
Jul 30 20:29:50 devstack sudo[98409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:51 devstack sudo[98409]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:51 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-363dd840-2689-4559-8cab-d88e1485ccbd tempest-VolumesTransfersV357Test-472099000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-e4be3db5-1e2e-4691-acfa-4d68a1d119f2 1073741824" returned: 0 in 0.522s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:51 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-363dd840-2689-4559-8cab-d88e1485ccbd tempest-VolumesTransfersV357Test-472099000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-e4be3db5-1e2e-4691-acfa-4d68a1d119f2 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:51 devstack sudo[98415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-e4be3db5-1e2e-4691-acfa-4d68a1d119f2
Jul 30 20:29:51 devstack sudo[98415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:51 devstack sudo[98415]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:51 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-363dd840-2689-4559-8cab-d88e1485ccbd tempest-VolumesTransfersV357Test-472099000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-e4be3db5-1e2e-4691-acfa-4d68a1d119f2" returned: 0 in 0.272s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:51 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-363dd840-2689-4559-8cab-d88e1485ccbd tempest-VolumesTransfersV357Test-472099000 None] <== create_volume: return (845ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:29:51 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-363dd840-2689-4559-8cab-d88e1485ccbd tempest-VolumesTransfersV357Test-472099000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.848s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:29:51 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-363dd840-2689-4559-8cab-d88e1485ccbd tempest-VolumesTransfersV357Test-472099000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bd0a94f-b20e-419d-a1ed-0ecd84756acf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4be3db5-1e2e-4691-acfa-4d68a1d119f2', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:51 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-363dd840-2689-4559-8cab-d88e1485ccbd tempest-VolumesTransfersV357Test-472099000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (612a8ce6-4281-4616-bcb0-465c75459b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:51 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-363dd840-2689-4559-8cab-d88e1485ccbd tempest-VolumesTransfersV357Test-472099000 None] Volume volume-e4be3db5-1e2e-4691-acfa-4d68a1d119f2 (e4be3db5-1e2e-4691-acfa-4d68a1d119f2): created successfully
Jul 30 20:29:51 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-363dd840-2689-4559-8cab-d88e1485ccbd tempest-VolumesTransfersV357Test-472099000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (612a8ce6-4281-4616-bcb0-465c75459b66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:51 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-363dd840-2689-4559-8cab-d88e1485ccbd tempest-VolumesTransfersV357Test-472099000 None] Flow 'volume_create_manager' (5e07e698-fd2f-4d3c-94e5-563579d36df9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:29:51 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-363dd840-2689-4559-8cab-d88e1485ccbd tempest-VolumesTransfersV357Test-472099000 None] Created volume successfully.
Jul 30 20:29:52 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-062f850a-f20f-4478-b94e-6dc72514901b tempest-GroupSnapshotsTest-296266448 None] Group tempest-GroupSnapshotsTest-Group-2098778911: creating
Jul 30 20:29:52 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-062f850a-f20f-4478-b94e-6dc72514901b tempest-GroupSnapshotsTest-296266448 None] Group tempest-GroupSnapshotsTest-Group-2098778911: created successfully
Jul 30 20:29:52 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-062f850a-f20f-4478-b94e-6dc72514901b tempest-GroupSnapshotsTest-296266448 None] Create group completed successfully.
Jul 30 20:29:53 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-cb3f55f2-8b2b-469b-955c-ce0b2fded6d8 tempest-VolumesTransfersV357Test-526445880 None] Transfer volume completed successfully.
Jul 30 20:29:53 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-867e9437-943a-4859-8670-6b049bff3f0b tempest-VolumesImageMetadata-2089098299 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:29:53 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-867e9437-943a-4859-8670-6b049bff3f0b tempest-VolumesImageMetadata-2089098299 None] Flow 'volume_create_manager' (ca36876b-6571-4997-af18-b5d9a861c81a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:29:53 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-867e9437-943a-4859-8670-6b049bff3f0b tempest-VolumesImageMetadata-2089098299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e1eb80e-056e-48ae-99ea-76eb5d45e532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:53 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-867e9437-943a-4859-8670-6b049bff3f0b tempest-VolumesImageMetadata-2089098299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e1eb80e-056e-48ae-99ea-76eb5d45e532) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:29:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-407580810',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e70e9e6-277b-4fdb-ac93-eed91dbc57c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0dff1af64954c9a814ddd03b3847999',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:29:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:29:54Z,use_quota=True,user_id='e6bfe517e5374ea78aafe407ea7cf2e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:53 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-867e9437-943a-4859-8670-6b049bff3f0b tempest-VolumesImageMetadata-2089098299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec4b0a0e-b231-4eb9-b94c-6dff6d41dc63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:53 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-867e9437-943a-4859-8670-6b049bff3f0b tempest-VolumesImageMetadata-2089098299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec4b0a0e-b231-4eb9-b94c-6dff6d41dc63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:53 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-867e9437-943a-4859-8670-6b049bff3f0b tempest-VolumesImageMetadata-2089098299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a315598-dec2-43a8-aacd-4d7f9b35b2c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:53 devstack cinder-volume[88719]: DEBUG cinder.image.glance [None req-867e9437-943a-4859-8670-6b049bff3f0b tempest-VolumesImageMetadata-2089098299 None] Creating Keystone auth plugin from conf {{(pid=88719) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 30 20:29:54 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-867e9437-943a-4859-8670-6b049bff3f0b tempest-VolumesImageMetadata-2089098299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a315598-dec2-43a8-aacd-4d7f9b35b2c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4e70e9e6-277b-4fdb-ac93-eed91dbc57c6', 'volume_name': 'volume-4e70e9e6-277b-4fdb-ac93-eed91dbc57c6', 'volume_size': 1, 'image_id': '1ed21181-aca9-4608-89cf-131c66236dc1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1ed21181-aca9-4608-89cf-131c66236dc1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ec1eaae7620840deac2e426a7e923b06', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1ed21181-aca9-4608-89cf-131c66236dc1', 'created_at': datetime.datetime(2026, 7, 30, 18, 17, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 18, 17, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1ed21181-aca9-4608-89cf-131c66236dc1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x786884a8bec0>}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:54 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-867e9437-943a-4859-8670-6b049bff3f0b tempest-VolumesImageMetadata-2089098299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cfc93bc-52ff-48da-a863-6582e6a51c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:54 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-867e9437-943a-4859-8670-6b049bff3f0b tempest-VolumesImageMetadata-2089098299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cfc93bc-52ff-48da-a863-6582e6a51c2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:54 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-867e9437-943a-4859-8670-6b049bff3f0b tempest-VolumesImageMetadata-2089098299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04dbb451-1317-4218-b687-2378f7c251eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:54 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-867e9437-943a-4859-8670-6b049bff3f0b tempest-VolumesImageMetadata-2089098299 None] Volume 4e70e9e6-277b-4fdb-ac93-eed91dbc57c6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4e70e9e6-277b-4fdb-ac93-eed91dbc57c6', 'volume_size': 1, 'image_id': '1ed21181-aca9-4608-89cf-131c66236dc1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1ed21181-aca9-4608-89cf-131c66236dc1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ec1eaae7620840deac2e426a7e923b06', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1ed21181-aca9-4608-89cf-131c66236dc1', 'created_at': datetime.datetime(2026, 7, 30, 18, 17, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 18, 17, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1ed21181-aca9-4608-89cf-131c66236dc1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x786884a8bec0>}
Jul 30 20:29:54 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-867e9437-943a-4859-8670-6b049bff3f0b tempest-VolumesImageMetadata-2089098299 None] Trying to clone 4e70e9e6-277b-4fdb-ac93-eed91dbc57c6 from image 1ed21181-aca9-4608-89cf-131c66236dc1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/1ed21181-aca9-4608-89cf-131c66236dc1', 'metadata': {}}]). {{(pid=88719) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 30 20:29:54 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c5396e9-112d-45e3-9c7b-87cb5390e116 tempest-GroupSnapshotsTest-296266448 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:29:54 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-8c5396e9-112d-45e3-9c7b-87cb5390e116 tempest-GroupSnapshotsTest-296266448 None] Flow 'volume_create_manager' (95f297ff-06df-40b4-87e7-6e941362a599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:29:54 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-8c5396e9-112d-45e3-9c7b-87cb5390e116 tempest-GroupSnapshotsTest-296266448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a65facc7-a74c-427e-9e32-de524b59b5be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:54 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-86b6fff3-49cb-4857-959a-b2975bcab959 tempest-VolumesTransfersV357Test-2175376 None] Acquiring lock "cinder-e4be3db5-1e2e-4691-acfa-4d68a1d119f2-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:29:54 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-8c5396e9-112d-45e3-9c7b-87cb5390e116 tempest-GroupSnapshotsTest-296266448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a65facc7-a74c-427e-9e32-de524b59b5be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:29:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1887023360',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=dd8900a2-39ae-4574-bc8c-9a74c1fa84d9,host='devstack@QuobyteHD#QuobyteHD',id=2a5791b9-0c39-4f8b-8f58-ee90cac4a9e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9a30efeb6fe428bbf6b21c25f0e9ae2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:29:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:29:54Z,use_quota=True,user_id='b7501c2b5cc547a8b7d91d86c5d9f3ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5344d89e-f6ae-44e2-aec0-be8019310fae),volume_type_id=5344d89e-f6ae-44e2-aec0-be8019310fae)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:54 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-8c5396e9-112d-45e3-9c7b-87cb5390e116 tempest-GroupSnapshotsTest-296266448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a5f1cd2-ce29-4627-a370-ab47d35db80a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:54 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-8c5396e9-112d-45e3-9c7b-87cb5390e116 tempest-GroupSnapshotsTest-296266448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a5f1cd2-ce29-4627-a370-ab47d35db80a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:54 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-8c5396e9-112d-45e3-9c7b-87cb5390e116 tempest-GroupSnapshotsTest-296266448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71e0d392-740e-4e76-8fec-e1c4c8497dfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:54 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-8c5396e9-112d-45e3-9c7b-87cb5390e116 tempest-GroupSnapshotsTest-296266448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71e0d392-740e-4e76-8fec-e1c4c8497dfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a5791b9-0c39-4f8b-8f58-ee90cac4a9e8', 'volume_name': 'volume-2a5791b9-0c39-4f8b-8f58-ee90cac4a9e8', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:54 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-8c5396e9-112d-45e3-9c7b-87cb5390e116 tempest-GroupSnapshotsTest-296266448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78922093-6861-4e08-80f3-591bb4ba1d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:54 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-8c5396e9-112d-45e3-9c7b-87cb5390e116 tempest-GroupSnapshotsTest-296266448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78922093-6861-4e08-80f3-591bb4ba1d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:54 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-8c5396e9-112d-45e3-9c7b-87cb5390e116 tempest-GroupSnapshotsTest-296266448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27df77f0-9ce1-4b20-a6a9-fe5707e34507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:54 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-8c5396e9-112d-45e3-9c7b-87cb5390e116 tempest-GroupSnapshotsTest-296266448 None] Volume 2a5791b9-0c39-4f8b-8f58-ee90cac4a9e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a5791b9-0c39-4f8b-8f58-ee90cac4a9e8', 'volume_size': 1}
Jul 30 20:29:54 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-8c5396e9-112d-45e3-9c7b-87cb5390e116 tempest-GroupSnapshotsTest-296266448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:29:54 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-8c5396e9-112d-45e3-9c7b-87cb5390e116 tempest-GroupSnapshotsTest-296266448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:29:54 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-8c5396e9-112d-45e3-9c7b-87cb5390e116 tempest-GroupSnapshotsTest-296266448 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=dd8900a2-39ae-4574-bc8c-9a74c1fa84d9,created_at=2026-07-30T18:29:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1887023360',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=dd8900a2-39ae-4574-bc8c-9a74c1fa84d9,host='devstack@QuobyteHD#QuobyteHD',id=2a5791b9-0c39-4f8b-8f58-ee90cac4a9e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9a30efeb6fe428bbf6b21c25f0e9ae2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:29:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:29:54Z,use_quota=True,user_id='b7501c2b5cc547a8b7d91d86c5d9f3ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5344d89e-f6ae-44e2-aec0-be8019310fae),volume_type_id=5344d89e-f6ae-44e2-aec0-be8019310fae)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:29:54 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-8c5396e9-112d-45e3-9c7b-87cb5390e116 tempest-GroupSnapshotsTest-296266448 None] Creating volume 2a5791b9-0c39-4f8b-8f58-ee90cac4a9e8 {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:29:54 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-8c5396e9-112d-45e3-9c7b-87cb5390e116 tempest-GroupSnapshotsTest-296266448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:29:54 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-8c5396e9-112d-45e3-9c7b-87cb5390e116 tempest-GroupSnapshotsTest-296266448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:29:54 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-8c5396e9-112d-45e3-9c7b-87cb5390e116 tempest-GroupSnapshotsTest-296266448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:29:54 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-8c5396e9-112d-45e3-9c7b-87cb5390e116 tempest-GroupSnapshotsTest-296266448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:29:54 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-8c5396e9-112d-45e3-9c7b-87cb5390e116 tempest-GroupSnapshotsTest-296266448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:29:54 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-8c5396e9-112d-45e3-9c7b-87cb5390e116 tempest-GroupSnapshotsTest-296266448 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:29:54 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-8c5396e9-112d-45e3-9c7b-87cb5390e116 tempest-GroupSnapshotsTest-296266448 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:29:54 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8c5396e9-112d-45e3-9c7b-87cb5390e116 tempest-GroupSnapshotsTest-296266448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2a5791b9-0c39-4f8b-8f58-ee90cac4a9e8 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:54 devstack sudo[98439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2a5791b9-0c39-4f8b-8f58-ee90cac4a9e8 1073741824
Jul 30 20:29:54 devstack sudo[98439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:54 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-86b6fff3-49cb-4857-959a-b2975bcab959 tempest-VolumesTransfersV357Test-2175376 None] Lock "cinder-e4be3db5-1e2e-4691-acfa-4d68a1d119f2-delete_volume" acquired by "delete_volume" :: waited 0.112s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:29:54 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-86b6fff3-49cb-4857-959a-b2975bcab959 tempest-VolumesTransfersV357Test-2175376 None] Acquiring lock "cinder-quobyte-e4be3db5-1e2e-4691-acfa-4d68a1d119f2" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:29:54 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-86b6fff3-49cb-4857-959a-b2975bcab959 tempest-VolumesTransfersV357Test-2175376 None] Lock "cinder-quobyte-e4be3db5-1e2e-4691-acfa-4d68a1d119f2" acquired by "delete_volume" :: waited 0.037s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:29:54 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b2ec52f-c969-4e77-be0b-8b9a584d5bca]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:29:54 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-86b6fff3-49cb-4857-959a-b2975bcab959 tempest-VolumesTransfersV357Test-2175376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-e4be3db5-1e2e-4691-acfa-4d68a1d119f2 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:54 devstack cinder-volume[88719]: DEBUG cinder.image.image_utils [None req-867e9437-943a-4859-8670-6b049bff3f0b tempest-VolumesImageMetadata-2089098299 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1ed21181-aca9-4608-89cf-131c66236dc1_6iiefy28devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88719) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 30 20:29:54 devstack cinder-volume[88719]: INFO cinder.image.image_utils [None req-867e9437-943a-4859-8670-6b049bff3f0b tempest-VolumesImageMetadata-2089098299 None] Image download 20.69 MB at 20.69 MB/s
Jul 30 20:29:54 devstack sudo[98442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-e4be3db5-1e2e-4691-acfa-4d68a1d119f2
Jul 30 20:29:54 devstack sudo[98442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:54 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c125138-829e-4136-ad21-4d16fd670f60]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:29:54 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-867e9437-943a-4859-8670-6b049bff3f0b tempest-VolumesImageMetadata-2089098299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1ed21181-aca9-4608-89cf-131c66236dc1_6iiefy28devstack@QuobyteHD {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:54 devstack sudo[98447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1ed21181-aca9-4608-89cf-131c66236dc1_6iiefy28devstack@QuobyteHD
Jul 30 20:29:54 devstack sudo[98447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:54 devstack sudo[98439]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:54 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8c5396e9-112d-45e3-9c7b-87cb5390e116 tempest-GroupSnapshotsTest-296266448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2a5791b9-0c39-4f8b-8f58-ee90cac4a9e8 1073741824" returned: 0 in 0.546s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:55 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8c5396e9-112d-45e3-9c7b-87cb5390e116 tempest-GroupSnapshotsTest-296266448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2a5791b9-0c39-4f8b-8f58-ee90cac4a9e8 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:55 devstack sudo[98452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2a5791b9-0c39-4f8b-8f58-ee90cac4a9e8
Jul 30 20:29:55 devstack sudo[98452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:55 devstack sudo[98442]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:55 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-86b6fff3-49cb-4857-959a-b2975bcab959 tempest-VolumesTransfersV357Test-2175376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-e4be3db5-1e2e-4691-acfa-4d68a1d119f2" returned: 0 in 0.466s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:55 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-86b6fff3-49cb-4857-959a-b2975bcab959 tempest-VolumesTransfersV357Test-2175376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-e4be3db5-1e2e-4691-acfa-4d68a1d119f2 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:55 devstack sudo[98455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-e4be3db5-1e2e-4691-acfa-4d68a1d119f2
Jul 30 20:29:55 devstack sudo[98455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:55 devstack sudo[98447]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:55 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-867e9437-943a-4859-8670-6b049bff3f0b tempest-VolumesImageMetadata-2089098299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1ed21181-aca9-4608-89cf-131c66236dc1_6iiefy28devstack@QuobyteHD" returned: 0 in 0.376s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:55 devstack cinder-volume[88719]: DEBUG cinder.image.image_utils [None req-867e9437-943a-4859-8670-6b049bff3f0b tempest-VolumesImageMetadata-2089098299 None] Temporary image 1ed21181-aca9-4608-89cf-131c66236dc1 is fetched for user e6bfe517e5374ea78aafe407ea7cf2e8. {{(pid=88719) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 30 20:29:55 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[7508d962-4670-44b8-b633-2ea7ee0aea15]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:29:55 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-867e9437-943a-4859-8670-6b049bff3f0b tempest-VolumesImageMetadata-2089098299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1ed21181-aca9-4608-89cf-131c66236dc1_6iiefy28devstack@QuobyteHD {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:55 devstack sudo[98452]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:55 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8c5396e9-112d-45e3-9c7b-87cb5390e116 tempest-GroupSnapshotsTest-296266448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2a5791b9-0c39-4f8b-8f58-ee90cac4a9e8" returned: 0 in 0.277s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:55 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-8c5396e9-112d-45e3-9c7b-87cb5390e116 tempest-GroupSnapshotsTest-296266448 None] <== create_volume: return (885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:29:55 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-8c5396e9-112d-45e3-9c7b-87cb5390e116 tempest-GroupSnapshotsTest-296266448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.888s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:29:55 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-8c5396e9-112d-45e3-9c7b-87cb5390e116 tempest-GroupSnapshotsTest-296266448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27df77f0-9ce1-4b20-a6a9-fe5707e34507) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a5791b9-0c39-4f8b-8f58-ee90cac4a9e8', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:55 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-8c5396e9-112d-45e3-9c7b-87cb5390e116 tempest-GroupSnapshotsTest-296266448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0794aa4d-57fd-4d74-95ea-91ec1c7ac02b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:55 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-8c5396e9-112d-45e3-9c7b-87cb5390e116 tempest-GroupSnapshotsTest-296266448 None] Volume volume-2a5791b9-0c39-4f8b-8f58-ee90cac4a9e8 (2a5791b9-0c39-4f8b-8f58-ee90cac4a9e8): created successfully
Jul 30 20:29:55 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-8c5396e9-112d-45e3-9c7b-87cb5390e116 tempest-GroupSnapshotsTest-296266448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0794aa4d-57fd-4d74-95ea-91ec1c7ac02b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:55 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-8c5396e9-112d-45e3-9c7b-87cb5390e116 tempest-GroupSnapshotsTest-296266448 None] Flow 'volume_create_manager' (95f297ff-06df-40b4-87e7-6e941362a599) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:29:55 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-8c5396e9-112d-45e3-9c7b-87cb5390e116 tempest-GroupSnapshotsTest-296266448 None] Created volume successfully.
Jul 30 20:29:55 devstack sudo[98462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1ed21181-aca9-4608-89cf-131c66236dc1_6iiefy28devstack@QuobyteHD
Jul 30 20:29:55 devstack sudo[98462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:55 devstack sudo[98455]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:55 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-86b6fff3-49cb-4857-959a-b2975bcab959 tempest-VolumesTransfersV357Test-2175376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-e4be3db5-1e2e-4691-acfa-4d68a1d119f2" returned: 0 in 0.337s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:55 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-86b6fff3-49cb-4857-959a-b2975bcab959 tempest-VolumesTransfersV357Test-2175376 None] Lock "cinder-quobyte-e4be3db5-1e2e-4691-acfa-4d68a1d119f2" released by "delete_volume" :: held 0.882s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:29:55 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-86b6fff3-49cb-4857-959a-b2975bcab959 tempest-VolumesTransfersV357Test-2175376 None] Created reservations ['db3c5fe5-fbf2-438f-8070-02d368f3e26b', '68a100f9-3097-49a2-9d15-595af7d5c6b1', '43b48e5c-0a41-452f-ae53-ed3e3369ba25', '0a8a9058-23b2-47bd-b076-6841b87f5902'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:29:55 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-86b6fff3-49cb-4857-959a-b2975bcab959 tempest-VolumesTransfersV357Test-2175376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:29:55 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-86b6fff3-49cb-4857-959a-b2975bcab959 tempest-VolumesTransfersV357Test-2175376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:29:55 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-86b6fff3-49cb-4857-959a-b2975bcab959 tempest-VolumesTransfersV357Test-2175376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:29:55 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-86b6fff3-49cb-4857-959a-b2975bcab959 tempest-VolumesTransfersV357Test-2175376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:29:55 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-86b6fff3-49cb-4857-959a-b2975bcab959 tempest-VolumesTransfersV357Test-2175376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:29:55 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-86b6fff3-49cb-4857-959a-b2975bcab959 tempest-VolumesTransfersV357Test-2175376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:55 devstack sudo[98465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:29:55 devstack sudo[98465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:55 devstack sudo[98462]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:55 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-867e9437-943a-4859-8670-6b049bff3f0b tempest-VolumesImageMetadata-2089098299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1ed21181-aca9-4608-89cf-131c66236dc1_6iiefy28devstack@QuobyteHD" returned: 0 in 0.411s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:55 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-867e9437-943a-4859-8670-6b049bff3f0b tempest-VolumesImageMetadata-2089098299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:29:55 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-867e9437-943a-4859-8670-6b049bff3f0b tempest-VolumesImageMetadata-2089098299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:29:55 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-867e9437-943a-4859-8670-6b049bff3f0b tempest-VolumesImageMetadata-2089098299 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:29:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-407580810',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e70e9e6-277b-4fdb-ac93-eed91dbc57c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0dff1af64954c9a814ddd03b3847999',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:29:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:29:54Z,use_quota=True,user_id='e6bfe517e5374ea78aafe407ea7cf2e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:29:55 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-867e9437-943a-4859-8670-6b049bff3f0b tempest-VolumesImageMetadata-2089098299 None] Creating volume 4e70e9e6-277b-4fdb-ac93-eed91dbc57c6 {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:29:55 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-867e9437-943a-4859-8670-6b049bff3f0b tempest-VolumesImageMetadata-2089098299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:29:55 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-867e9437-943a-4859-8670-6b049bff3f0b tempest-VolumesImageMetadata-2089098299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:29:55 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-867e9437-943a-4859-8670-6b049bff3f0b tempest-VolumesImageMetadata-2089098299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:29:55 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-867e9437-943a-4859-8670-6b049bff3f0b tempest-VolumesImageMetadata-2089098299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:29:55 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-867e9437-943a-4859-8670-6b049bff3f0b tempest-VolumesImageMetadata-2089098299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:29:55 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-867e9437-943a-4859-8670-6b049bff3f0b tempest-VolumesImageMetadata-2089098299 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:29:55 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-867e9437-943a-4859-8670-6b049bff3f0b tempest-VolumesImageMetadata-2089098299 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:29:55 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-867e9437-943a-4859-8670-6b049bff3f0b tempest-VolumesImageMetadata-2089098299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-4e70e9e6-277b-4fdb-ac93-eed91dbc57c6 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:55 devstack sudo[98471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-4e70e9e6-277b-4fdb-ac93-eed91dbc57c6 1073741824
Jul 30 20:29:55 devstack sudo[98471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:55 devstack sudo[98465]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:55 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-86b6fff3-49cb-4857-959a-b2975bcab959 tempest-VolumesTransfersV357Test-2175376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.313s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:55 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-86b6fff3-49cb-4857-959a-b2975bcab959 tempest-VolumesTransfersV357Test-2175376 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:29:55 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-86b6fff3-49cb-4857-959a-b2975bcab959 tempest-VolumesTransfersV357Test-2175376 None] Deleted volume successfully.
Jul 30 20:29:55 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-86b6fff3-49cb-4857-959a-b2975bcab959 tempest-VolumesTransfersV357Test-2175376 None] Lock "cinder-e4be3db5-1e2e-4691-acfa-4d68a1d119f2-delete_volume" released by "delete_volume" :: held 1.494s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:29:56 devstack sudo[98471]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:56 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-867e9437-943a-4859-8670-6b049bff3f0b tempest-VolumesImageMetadata-2089098299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-4e70e9e6-277b-4fdb-ac93-eed91dbc57c6 1073741824" returned: 0 in 0.530s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:56 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-867e9437-943a-4859-8670-6b049bff3f0b tempest-VolumesImageMetadata-2089098299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-4e70e9e6-277b-4fdb-ac93-eed91dbc57c6 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:56 devstack sudo[98480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-4e70e9e6-277b-4fdb-ac93-eed91dbc57c6
Jul 30 20:29:56 devstack sudo[98480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:56 devstack sudo[98480]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:56 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-867e9437-943a-4859-8670-6b049bff3f0b tempest-VolumesImageMetadata-2089098299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-4e70e9e6-277b-4fdb-ac93-eed91dbc57c6" returned: 0 in 0.265s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:56 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-867e9437-943a-4859-8670-6b049bff3f0b tempest-VolumesImageMetadata-2089098299 None] <== create_volume: return (847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:29:56 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-867e9437-943a-4859-8670-6b049bff3f0b tempest-VolumesImageMetadata-2089098299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.852s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:29:56 devstack cinder-volume[88719]: DEBUG cinder.volume.volume_utils [None req-867e9437-943a-4859-8670-6b049bff3f0b tempest-VolumesImageMetadata-2089098299 None] Attempting download of 1ed21181-aca9-4608-89cf-131c66236dc1 ((None, [{'url': 'file:///opt/stack/data/glance/images/1ed21181-aca9-4608-89cf-131c66236dc1', 'metadata': {}}])) to volume 4e70e9e6-277b-4fdb-ac93-eed91dbc57c6. {{(pid=88719) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 30 20:29:56 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[700c4c1e-7126-430b-9e21-8f56fa290786]: (4, 'raw') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:29:56 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-867e9437-943a-4859-8670-6b049bff3f0b tempest-VolumesImageMetadata-2089098299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1ed21181-aca9-4608-89cf-131c66236dc1_8hys6s3l {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:56 devstack sudo[98483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1ed21181-aca9-4608-89cf-131c66236dc1_8hys6s3l
Jul 30 20:29:56 devstack sudo[98483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:57 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-fb3e53b3-4b3c-4e56-9946-2c2286ddb786 tempest-GroupSnapshotsTest-296266448 None] GroupSnapshot 0377a266-6c5b-4df6-836d-914df0fd9c11: creating.
Jul 30 20:29:57 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-fb3e53b3-4b3c-4e56-9946-2c2286ddb786 tempest-GroupSnapshotsTest-296266448 None] Group snapshot 0377a266-6c5b-4df6-836d-914df0fd9c11: creating. {{(pid=88719) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jul 30 20:29:57 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-fb3e53b3-4b3c-4e56-9946-2c2286ddb786 tempest-GroupSnapshotsTest-296266448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:29:57 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-fb3e53b3-4b3c-4e56-9946-2c2286ddb786 tempest-GroupSnapshotsTest-296266448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:29:57 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-fb3e53b3-4b3c-4e56-9946-2c2286ddb786 tempest-GroupSnapshotsTest-296266448 None] Creating offline snapshot 2342999d-315f-4428-b2d3-80e6310f7c69 of volume 2a5791b9-0c39-4f8b-8f58-ee90cac4a9e8 {{(pid=88719) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 30 20:29:57 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e5c0e34-3aea-4afa-a9c0-e5db69c6e9ab]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:29:57 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-fb3e53b3-4b3c-4e56-9946-2c2286ddb786 tempest-GroupSnapshotsTest-296266448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2a5791b9-0c39-4f8b-8f58-ee90cac4a9e8 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:57 devstack sudo[98483]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:57 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-867e9437-943a-4859-8670-6b049bff3f0b tempest-VolumesImageMetadata-2089098299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1ed21181-aca9-4608-89cf-131c66236dc1_8hys6s3l" returned: 0 in 0.518s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:57 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-867e9437-943a-4859-8670-6b049bff3f0b tempest-VolumesImageMetadata-2089098299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1ed21181-aca9-4608-89cf-131c66236dc1_8hys6s3l {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:57 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-3eef9afc-62c7-46be-bacb-327c044e6f7b tempest-VolumesTransfersV357Test-472099000 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:29:57 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-3eef9afc-62c7-46be-bacb-327c044e6f7b tempest-VolumesTransfersV357Test-472099000 None] Flow 'volume_create_manager' (64b8eea0-2a8d-45be-b0ae-8968d4050a47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:29:57 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-3eef9afc-62c7-46be-bacb-327c044e6f7b tempest-VolumesTransfersV357Test-472099000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f507a007-cb00-4538-9834-a3a9be6770a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:57 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-3eef9afc-62c7-46be-bacb-327c044e6f7b tempest-VolumesTransfersV357Test-472099000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f507a007-cb00-4538-9834-a3a9be6770a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:29:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-523887399',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54f2ee87-5cbf-4930-8dc4-b25dd6777645,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d7132e285d74754b44a0260c00cf002',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:29:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:29:57Z,use_quota=True,user_id='6cd6820b3dfc4560bd2dbdd95aafda1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:57 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-3eef9afc-62c7-46be-bacb-327c044e6f7b tempest-VolumesTransfersV357Test-472099000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df28e01b-a8a4-454b-86a0-d312027c237a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:57 devstack sudo[98493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2a5791b9-0c39-4f8b-8f58-ee90cac4a9e8
Jul 30 20:29:57 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-3eef9afc-62c7-46be-bacb-327c044e6f7b tempest-VolumesTransfersV357Test-472099000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df28e01b-a8a4-454b-86a0-d312027c237a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:57 devstack sudo[98493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:57 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-3eef9afc-62c7-46be-bacb-327c044e6f7b tempest-VolumesTransfersV357Test-472099000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66d19561-5d95-4cb4-97b0-4f301805949e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:57 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-3eef9afc-62c7-46be-bacb-327c044e6f7b tempest-VolumesTransfersV357Test-472099000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66d19561-5d95-4cb4-97b0-4f301805949e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54f2ee87-5cbf-4930-8dc4-b25dd6777645', 'volume_name': 'volume-54f2ee87-5cbf-4930-8dc4-b25dd6777645', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:57 devstack sudo[98499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1ed21181-aca9-4608-89cf-131c66236dc1_8hys6s3l
Jul 30 20:29:57 devstack sudo[98499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:57 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-3eef9afc-62c7-46be-bacb-327c044e6f7b tempest-VolumesTransfersV357Test-472099000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b54a02ee-759b-4a0a-aa1a-6f07859c5f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:57 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-3eef9afc-62c7-46be-bacb-327c044e6f7b tempest-VolumesTransfersV357Test-472099000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b54a02ee-759b-4a0a-aa1a-6f07859c5f5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:29:57 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-3eef9afc-62c7-46be-bacb-327c044e6f7b tempest-VolumesTransfersV357Test-472099000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (034e2ecc-4cac-4109-b5aa-ae5aa3bac56b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:29:57 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-3eef9afc-62c7-46be-bacb-327c044e6f7b tempest-VolumesTransfersV357Test-472099000 None] Volume 54f2ee87-5cbf-4930-8dc4-b25dd6777645: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54f2ee87-5cbf-4930-8dc4-b25dd6777645', 'volume_size': 1}
Jul 30 20:29:57 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-3eef9afc-62c7-46be-bacb-327c044e6f7b tempest-VolumesTransfersV357Test-472099000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:29:57 devstack sudo[98493]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:57 devstack sudo[98499]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:57 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-867e9437-943a-4859-8670-6b049bff3f0b tempest-VolumesImageMetadata-2089098299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1ed21181-aca9-4608-89cf-131c66236dc1_8hys6s3l" returned: 1 in 0.444s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:57 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-867e9437-943a-4859-8670-6b049bff3f0b tempest-VolumesImageMetadata-2089098299 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1ed21181-aca9-4608-89cf-131c66236dc1_8hys6s3l' failed. Not Retrying. {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 30 20:29:57 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-fb3e53b3-4b3c-4e56-9946-2c2286ddb786 tempest-GroupSnapshotsTest-296266448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2a5791b9-0c39-4f8b-8f58-ee90cac4a9e8" returned: 0 in 0.467s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:57 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-fb3e53b3-4b3c-4e56-9946-2c2286ddb786 tempest-GroupSnapshotsTest-296266448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2a5791b9-0c39-4f8b-8f58-ee90cac4a9e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2a5791b9-0c39-4f8b-8f58-ee90cac4a9e8.2342999d-315f-4428-b2d3-80e6310f7c69 1G {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:57 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[67de66f4-bde0-4507-87a0-f6ad517d3ae5]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:29:57 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-867e9437-943a-4859-8670-6b049bff3f0b tempest-VolumesImageMetadata-2089098299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1ed21181-aca9-4608-89cf-131c66236dc1_6iiefy28devstack@QuobyteHD {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:57 devstack sudo[98533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2a5791b9-0c39-4f8b-8f58-ee90cac4a9e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2a5791b9-0c39-4f8b-8f58-ee90cac4a9e8.2342999d-315f-4428-b2d3-80e6310f7c69 1G
Jul 30 20:29:57 devstack sudo[98533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:57 devstack sudo[98534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1ed21181-aca9-4608-89cf-131c66236dc1_6iiefy28devstack@QuobyteHD
Jul 30 20:29:57 devstack sudo[98534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:58 devstack sudo[98534]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-867e9437-943a-4859-8670-6b049bff3f0b tempest-VolumesImageMetadata-2089098299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1ed21181-aca9-4608-89cf-131c66236dc1_6iiefy28devstack@QuobyteHD" returned: 0 in 0.374s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:58 devstack cinder-volume[88719]: DEBUG cinder.image.image_utils [None req-867e9437-943a-4859-8670-6b049bff3f0b tempest-VolumesImageMetadata-2089098299 None] 1ed21181-aca9-4608-89cf-131c66236dc1 was qcow2, converting to qcow2 {{(pid=88719) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 30 20:29:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-867e9437-943a-4859-8670-6b049bff3f0b tempest-VolumesImageMetadata-2089098299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1ed21181-aca9-4608-89cf-131c66236dc1_6iiefy28devstack@QuobyteHD /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-4e70e9e6-277b-4fdb-ac93-eed91dbc57c6 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:58 devstack sudo[98544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1ed21181-aca9-4608-89cf-131c66236dc1_6iiefy28devstack@QuobyteHD /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-4e70e9e6-277b-4fdb-ac93-eed91dbc57c6
Jul 30 20:29:58 devstack sudo[98544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:58 devstack sudo[98533]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-fb3e53b3-4b3c-4e56-9946-2c2286ddb786 tempest-GroupSnapshotsTest-296266448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2a5791b9-0c39-4f8b-8f58-ee90cac4a9e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2a5791b9-0c39-4f8b-8f58-ee90cac4a9e8.2342999d-315f-4428-b2d3-80e6310f7c69 1G" returned: 0 in 0.518s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-fb3e53b3-4b3c-4e56-9946-2c2286ddb786 tempest-GroupSnapshotsTest-296266448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a5791b9-0c39-4f8b-8f58-ee90cac4a9e8 -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2a5791b9-0c39-4f8b-8f58-ee90cac4a9e8.2342999d-315f-4428-b2d3-80e6310f7c69 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:58 devstack sudo[98546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a5791b9-0c39-4f8b-8f58-ee90cac4a9e8 -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2a5791b9-0c39-4f8b-8f58-ee90cac4a9e8.2342999d-315f-4428-b2d3-80e6310f7c69
Jul 30 20:29:58 devstack sudo[98546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:58 devstack sudo[98546]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-fb3e53b3-4b3c-4e56-9946-2c2286ddb786 tempest-GroupSnapshotsTest-296266448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a5791b9-0c39-4f8b-8f58-ee90cac4a9e8 -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2a5791b9-0c39-4f8b-8f58-ee90cac4a9e8.2342999d-315f-4428-b2d3-80e6310f7c69" returned: 0 in 0.322s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:58 devstack cinder-volume[88719]: WARNING cinder.volume.drivers.remotefs [None req-fb3e53b3-4b3c-4e56-9946-2c2286ddb786 tempest-GroupSnapshotsTest-296266448 None] /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2a5791b9-0c39-4f8b-8f58-ee90cac4a9e8.2342999d-315f-4428-b2d3-80e6310f7c69 is being set with open permissions: ugo+rw: NotImplementedError
Jul 30 20:29:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-fb3e53b3-4b3c-4e56-9946-2c2286ddb786 tempest-GroupSnapshotsTest-296266448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2a5791b9-0c39-4f8b-8f58-ee90cac4a9e8.2342999d-315f-4428-b2d3-80e6310f7c69 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:58 devstack sudo[98555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2a5791b9-0c39-4f8b-8f58-ee90cac4a9e8.2342999d-315f-4428-b2d3-80e6310f7c69
Jul 30 20:29:58 devstack sudo[98555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:58 devstack sudo[98555]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-fb3e53b3-4b3c-4e56-9946-2c2286ddb786 tempest-GroupSnapshotsTest-296266448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2a5791b9-0c39-4f8b-8f58-ee90cac4a9e8.2342999d-315f-4428-b2d3-80e6310f7c69" returned: 0 in 0.277s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-fb3e53b3-4b3c-4e56-9946-2c2286ddb786 tempest-GroupSnapshotsTest-296266448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2a5791b9-0c39-4f8b-8f58-ee90cac4a9e8.info {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:58 devstack sudo[98563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2a5791b9-0c39-4f8b-8f58-ee90cac4a9e8.info
Jul 30 20:29:58 devstack sudo[98563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:59 devstack sudo[98563]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:59 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-fb3e53b3-4b3c-4e56-9946-2c2286ddb786 tempest-GroupSnapshotsTest-296266448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2a5791b9-0c39-4f8b-8f58-ee90cac4a9e8.info" returned: 0 in 0.349s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:59 devstack cinder-volume[88719]: WARNING cinder.volume.drivers.remotefs [None req-fb3e53b3-4b3c-4e56-9946-2c2286ddb786 tempest-GroupSnapshotsTest-296266448 None] /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2a5791b9-0c39-4f8b-8f58-ee90cac4a9e8.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 30 20:29:59 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-fb3e53b3-4b3c-4e56-9946-2c2286ddb786 tempest-GroupSnapshotsTest-296266448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2a5791b9-0c39-4f8b-8f58-ee90cac4a9e8.info {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:59 devstack sudo[98566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2a5791b9-0c39-4f8b-8f58-ee90cac4a9e8.info
Jul 30 20:29:59 devstack sudo[98566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:59 devstack sudo[98566]: pam_unix(sudo:session): session closed for user root
Jul 30 20:29:59 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-fb3e53b3-4b3c-4e56-9946-2c2286ddb786 tempest-GroupSnapshotsTest-296266448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2a5791b9-0c39-4f8b-8f58-ee90cac4a9e8.info" returned: 0 in 0.290s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:29:59 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-fb3e53b3-4b3c-4e56-9946-2c2286ddb786 tempest-GroupSnapshotsTest-296266448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.341s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:29:59 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-3eef9afc-62c7-46be-bacb-327c044e6f7b tempest-VolumesTransfersV357Test-472099000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.094s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:29:59 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-3eef9afc-62c7-46be-bacb-327c044e6f7b tempest-VolumesTransfersV357Test-472099000 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:29:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-523887399',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54f2ee87-5cbf-4930-8dc4-b25dd6777645,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d7132e285d74754b44a0260c00cf002',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:29:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:29:57Z,use_quota=True,user_id='6cd6820b3dfc4560bd2dbdd95aafda1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:29:59 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-3eef9afc-62c7-46be-bacb-327c044e6f7b tempest-VolumesTransfersV357Test-472099000 None] Creating volume 54f2ee87-5cbf-4930-8dc4-b25dd6777645 {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:29:59 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-3eef9afc-62c7-46be-bacb-327c044e6f7b tempest-VolumesTransfersV357Test-472099000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:29:59 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-3eef9afc-62c7-46be-bacb-327c044e6f7b tempest-VolumesTransfersV357Test-472099000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:29:59 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-3eef9afc-62c7-46be-bacb-327c044e6f7b tempest-VolumesTransfersV357Test-472099000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:29:59 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-3eef9afc-62c7-46be-bacb-327c044e6f7b tempest-VolumesTransfersV357Test-472099000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:29:59 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-3eef9afc-62c7-46be-bacb-327c044e6f7b tempest-VolumesTransfersV357Test-472099000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:29:59 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-3eef9afc-62c7-46be-bacb-327c044e6f7b tempest-VolumesTransfersV357Test-472099000 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:29:59 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-3eef9afc-62c7-46be-bacb-327c044e6f7b tempest-VolumesTransfersV357Test-472099000 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:29:59 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3eef9afc-62c7-46be-bacb-327c044e6f7b tempest-VolumesTransfersV357Test-472099000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-54f2ee87-5cbf-4930-8dc4-b25dd6777645 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:29:59 devstack sudo[98569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-54f2ee87-5cbf-4930-8dc4-b25dd6777645 1073741824
Jul 30 20:29:59 devstack sudo[98569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:29:59 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-fb3e53b3-4b3c-4e56-9946-2c2286ddb786 tempest-GroupSnapshotsTest-296266448 None] group_snapshot 0377a266-6c5b-4df6-836d-914df0fd9c11: created successfully
Jul 30 20:30:00 devstack sudo[98569]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:00 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3eef9afc-62c7-46be-bacb-327c044e6f7b tempest-VolumesTransfersV357Test-472099000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-54f2ee87-5cbf-4930-8dc4-b25dd6777645 1073741824" returned: 0 in 0.534s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:00 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3eef9afc-62c7-46be-bacb-327c044e6f7b tempest-VolumesTransfersV357Test-472099000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-54f2ee87-5cbf-4930-8dc4-b25dd6777645 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:00 devstack sudo[98575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-54f2ee87-5cbf-4930-8dc4-b25dd6777645
Jul 30 20:30:00 devstack sudo[98575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:00 devstack sudo[98544]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:00 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-867e9437-943a-4859-8670-6b049bff3f0b tempest-VolumesImageMetadata-2089098299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1ed21181-aca9-4608-89cf-131c66236dc1_6iiefy28devstack@QuobyteHD /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-4e70e9e6-277b-4fdb-ac93-eed91dbc57c6" returned: 0 in 2.100s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:00 devstack cinder-volume[88719]: DEBUG cinder.image.image_utils [None req-867e9437-943a-4859-8670-6b049bff3f0b tempest-VolumesImageMetadata-2089098299 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1ed21181-aca9-4608-89cf-131c66236dc1_6iiefy28devstack@QuobyteHD, size 112.00 MB, duration 2.10 sec, destination /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-4e70e9e6-277b-4fdb-ac93-eed91dbc57c6 {{(pid=88719) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 30 20:30:00 devstack cinder-volume[88719]: INFO cinder.image.image_utils [None req-867e9437-943a-4859-8670-6b049bff3f0b tempest-VolumesImageMetadata-2089098299 None] Converted 112.00 MB image at 53.30 MB/s
Jul 30 20:30:00 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-867e9437-943a-4859-8670-6b049bff3f0b tempest-VolumesImageMetadata-2089098299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-4e70e9e6-277b-4fdb-ac93-eed91dbc57c6 1G {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:00 devstack sudo[98577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-4e70e9e6-277b-4fdb-ac93-eed91dbc57c6 1G
Jul 30 20:30:00 devstack sudo[98577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:00 devstack sudo[98575]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:00 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3eef9afc-62c7-46be-bacb-327c044e6f7b tempest-VolumesTransfersV357Test-472099000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-54f2ee87-5cbf-4930-8dc4-b25dd6777645" returned: 0 in 0.318s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:00 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-3eef9afc-62c7-46be-bacb-327c044e6f7b tempest-VolumesTransfersV357Test-472099000 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:30:00 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-3eef9afc-62c7-46be-bacb-327c044e6f7b tempest-VolumesTransfersV357Test-472099000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:30:00 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-3eef9afc-62c7-46be-bacb-327c044e6f7b tempest-VolumesTransfersV357Test-472099000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (034e2ecc-4cac-4109-b5aa-ae5aa3bac56b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54f2ee87-5cbf-4930-8dc4-b25dd6777645', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:30:00 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-3eef9afc-62c7-46be-bacb-327c044e6f7b tempest-VolumesTransfersV357Test-472099000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9213b957-fc8f-422f-88b0-d727bb34b268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:30:00 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-3eef9afc-62c7-46be-bacb-327c044e6f7b tempest-VolumesTransfersV357Test-472099000 None] Volume volume-54f2ee87-5cbf-4930-8dc4-b25dd6777645 (54f2ee87-5cbf-4930-8dc4-b25dd6777645): created successfully
Jul 30 20:30:00 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-3eef9afc-62c7-46be-bacb-327c044e6f7b tempest-VolumesTransfersV357Test-472099000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9213b957-fc8f-422f-88b0-d727bb34b268) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:30:00 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-3eef9afc-62c7-46be-bacb-327c044e6f7b tempest-VolumesTransfersV357Test-472099000 None] Flow 'volume_create_manager' (64b8eea0-2a8d-45be-b0ae-8968d4050a47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:30:00 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-3eef9afc-62c7-46be-bacb-327c044e6f7b tempest-VolumesTransfersV357Test-472099000 None] Created volume successfully.
Jul 30 20:30:00 devstack sudo[98577]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:00 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-867e9437-943a-4859-8670-6b049bff3f0b tempest-VolumesImageMetadata-2089098299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-4e70e9e6-277b-4fdb-ac93-eed91dbc57c6 1G" returned: 0 in 0.410s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:00 devstack cinder-volume[88719]: DEBUG cinder.volume.volume_utils [None req-867e9437-943a-4859-8670-6b049bff3f0b tempest-VolumesImageMetadata-2089098299 None] Downloaded image 1ed21181-aca9-4608-89cf-131c66236dc1 ((None, [{'url': 'file:///opt/stack/data/glance/images/1ed21181-aca9-4608-89cf-131c66236dc1', 'metadata': {}}])) to volume 4e70e9e6-277b-4fdb-ac93-eed91dbc57c6 successfully. {{(pid=88719) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 30 20:30:00 devstack cinder-volume[88719]: DEBUG cinder.image.image_utils [None req-867e9437-943a-4859-8670-6b049bff3f0b tempest-VolumesImageMetadata-2089098299 None] Temporary image 1ed21181-aca9-4608-89cf-131c66236dc1 for user e6bfe517e5374ea78aafe407ea7cf2e8 is deleted. {{(pid=88719) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 30 20:30:00 devstack cinder-volume[88719]: DEBUG cinder.volume.volume_utils [None req-867e9437-943a-4859-8670-6b049bff3f0b tempest-VolumesImageMetadata-2089098299 None] Marking volume 4e70e9e6-277b-4fdb-ac93-eed91dbc57c6 as bootable. {{(pid=88719) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 30 20:30:00 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-867e9437-943a-4859-8670-6b049bff3f0b tempest-VolumesImageMetadata-2089098299 None] Copying metadata from image 1ed21181-aca9-4608-89cf-131c66236dc1 to 4e70e9e6-277b-4fdb-ac93-eed91dbc57c6. {{(pid=88719) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 30 20:30:00 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-867e9437-943a-4859-8670-6b049bff3f0b tempest-VolumesImageMetadata-2089098299 None] Creating volume glance metadata for volume 4e70e9e6-277b-4fdb-ac93-eed91dbc57c6 backed by image 1ed21181-aca9-4608-89cf-131c66236dc1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '1ed21181-aca9-4608-89cf-131c66236dc1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88719) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 30 20:30:00 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-867e9437-943a-4859-8670-6b049bff3f0b tempest-VolumesImageMetadata-2089098299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04dbb451-1317-4218-b687-2378f7c251eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e70e9e6-277b-4fdb-ac93-eed91dbc57c6', 'volume_size': 1, 'image_id': '1ed21181-aca9-4608-89cf-131c66236dc1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1ed21181-aca9-4608-89cf-131c66236dc1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ec1eaae7620840deac2e426a7e923b06', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1ed21181-aca9-4608-89cf-131c66236dc1', 'created_at': datetime.datetime(2026, 7, 30, 18, 17, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 18, 17, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1ed21181-aca9-4608-89cf-131c66236dc1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x786884a8bec0>}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:30:00 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-867e9437-943a-4859-8670-6b049bff3f0b tempest-VolumesImageMetadata-2089098299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5849dd8-e0a3-4501-9db0-8ef104d5cffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:30:00 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-867e9437-943a-4859-8670-6b049bff3f0b tempest-VolumesImageMetadata-2089098299 None] Volume volume-4e70e9e6-277b-4fdb-ac93-eed91dbc57c6 (4e70e9e6-277b-4fdb-ac93-eed91dbc57c6): created successfully
Jul 30 20:30:00 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-867e9437-943a-4859-8670-6b049bff3f0b tempest-VolumesImageMetadata-2089098299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5849dd8-e0a3-4501-9db0-8ef104d5cffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:30:00 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-867e9437-943a-4859-8670-6b049bff3f0b tempest-VolumesImageMetadata-2089098299 None] Flow 'volume_create_manager' (ca36876b-6571-4997-af18-b5d9a861c81a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:30:00 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-867e9437-943a-4859-8670-6b049bff3f0b tempest-VolumesImageMetadata-2089098299 None] Created volume successfully.
Jul 30 20:30:01 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-335a4d8f-f087-4b60-aec8-3abc2014d8d3 tempest-GroupSnapshotsTest-296266448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:30:01 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-335a4d8f-f087-4b60-aec8-3abc2014d8d3 tempest-GroupSnapshotsTest-296266448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:30:01 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-335a4d8f-f087-4b60-aec8-3abc2014d8d3 tempest-GroupSnapshotsTest-296266448 None] Acquiring lock "cinder-quobyte-2342999d-315f-4428-b2d3-80e6310f7c69-c1ff535a-75f1-43b5-8db5-b1d8141ab274" by "_create_volume_from_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:30:01 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-335a4d8f-f087-4b60-aec8-3abc2014d8d3 tempest-GroupSnapshotsTest-296266448 None] Lock "cinder-quobyte-2342999d-315f-4428-b2d3-80e6310f7c69-c1ff535a-75f1-43b5-8db5-b1d8141ab274" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:30:01 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-335a4d8f-f087-4b60-aec8-3abc2014d8d3 tempest-GroupSnapshotsTest-296266448 None] Creating volume c1ff535a-75f1-43b5-8db5-b1d8141ab274 from snapshot 2342999d-315f-4428-b2d3-80e6310f7c69 {{(pid=88719) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Jul 30 20:30:01 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-335a4d8f-f087-4b60-aec8-3abc2014d8d3 tempest-GroupSnapshotsTest-296266448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:30:01 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-335a4d8f-f087-4b60-aec8-3abc2014d8d3 tempest-GroupSnapshotsTest-296266448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:30:01 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-335a4d8f-f087-4b60-aec8-3abc2014d8d3 tempest-GroupSnapshotsTest-296266448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:30:01 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-335a4d8f-f087-4b60-aec8-3abc2014d8d3 tempest-GroupSnapshotsTest-296266448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:30:01 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-335a4d8f-f087-4b60-aec8-3abc2014d8d3 tempest-GroupSnapshotsTest-296266448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:30:01 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-335a4d8f-f087-4b60-aec8-3abc2014d8d3 tempest-GroupSnapshotsTest-296266448 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:30:01 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-335a4d8f-f087-4b60-aec8-3abc2014d8d3 tempest-GroupSnapshotsTest-296266448 None] Acquiring lock "cinder-quobyte-c1ff535a-75f1-43b5-8db5-b1d8141ab274" by "_copy_volume_from_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:30:01 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-335a4d8f-f087-4b60-aec8-3abc2014d8d3 tempest-GroupSnapshotsTest-296266448 None] Lock "cinder-quobyte-c1ff535a-75f1-43b5-8db5-b1d8141ab274" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:30:01 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-335a4d8f-f087-4b60-aec8-3abc2014d8d3 tempest-GroupSnapshotsTest-296266448 None] snapshot: 2342999d-315f-4428-b2d3-80e6310f7c69, volume: c1ff535a-75f1-43b5-8db5-b1d8141ab274,  {{(pid=88719) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}}
Jul 30 20:30:01 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-335a4d8f-f087-4b60-aec8-3abc2014d8d3 tempest-GroupSnapshotsTest-296266448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:30:01 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-335a4d8f-f087-4b60-aec8-3abc2014d8d3 tempest-GroupSnapshotsTest-296266448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:30:01 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-335a4d8f-f087-4b60-aec8-3abc2014d8d3 tempest-GroupSnapshotsTest-296266448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:30:01 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-335a4d8f-f087-4b60-aec8-3abc2014d8d3 tempest-GroupSnapshotsTest-296266448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:30:01 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-335a4d8f-f087-4b60-aec8-3abc2014d8d3 tempest-GroupSnapshotsTest-296266448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:30:01 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[02dcfdc8-9588-4be9-8d90-72325cb7dc83]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:30:01 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-335a4d8f-f087-4b60-aec8-3abc2014d8d3 tempest-GroupSnapshotsTest-296266448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2a5791b9-0c39-4f8b-8f58-ee90cac4a9e8.2342999d-315f-4428-b2d3-80e6310f7c69 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:01 devstack sudo[98584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2a5791b9-0c39-4f8b-8f58-ee90cac4a9e8.2342999d-315f-4428-b2d3-80e6310f7c69
Jul 30 20:30:01 devstack sudo[98584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:01 devstack sudo[98584]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:01 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-335a4d8f-f087-4b60-aec8-3abc2014d8d3 tempest-GroupSnapshotsTest-296266448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2a5791b9-0c39-4f8b-8f58-ee90cac4a9e8.2342999d-315f-4428-b2d3-80e6310f7c69" returned: 0 in 0.471s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:01 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-335a4d8f-f087-4b60-aec8-3abc2014d8d3 tempest-GroupSnapshotsTest-296266448 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2a5791b9-0c39-4f8b-8f58-ee90cac4a9e8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88719) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 30 20:30:01 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a3197e7-e387-4edc-9aa7-73407d310868]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:30:01 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-335a4d8f-f087-4b60-aec8-3abc2014d8d3 tempest-GroupSnapshotsTest-296266448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2a5791b9-0c39-4f8b-8f58-ee90cac4a9e8 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:01 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-12ae854f-a6a8-46c3-8a9a-8e98ade2bf09 tempest-VolumesImageMetadata-2089098299 None] Acquiring lock "cinder-4e70e9e6-277b-4fdb-ac93-eed91dbc57c6-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:30:01 devstack sudo[98590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2a5791b9-0c39-4f8b-8f58-ee90cac4a9e8
Jul 30 20:30:01 devstack sudo[98590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:01 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-12ae854f-a6a8-46c3-8a9a-8e98ade2bf09 tempest-VolumesImageMetadata-2089098299 None] Lock "cinder-4e70e9e6-277b-4fdb-ac93-eed91dbc57c6-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:30:01 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-12ae854f-a6a8-46c3-8a9a-8e98ade2bf09 tempest-VolumesImageMetadata-2089098299 None] Acquiring lock "cinder-quobyte-4e70e9e6-277b-4fdb-ac93-eed91dbc57c6" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:30:01 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-12ae854f-a6a8-46c3-8a9a-8e98ade2bf09 tempest-VolumesImageMetadata-2089098299 None] Lock "cinder-quobyte-4e70e9e6-277b-4fdb-ac93-eed91dbc57c6" acquired by "delete_volume" :: waited 0.017s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:30:01 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[cea9c859-2dbe-42c3-9ef6-9ed631d71d37]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:30:01 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-12ae854f-a6a8-46c3-8a9a-8e98ade2bf09 tempest-VolumesImageMetadata-2089098299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-4e70e9e6-277b-4fdb-ac93-eed91dbc57c6 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:01 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-ad6abbbe-2a34-41d3-9b4e-eac4b4477742 tempest-VolumesTransfersV357Test-2175376 None] Acquiring lock "cinder-54f2ee87-5cbf-4930-8dc4-b25dd6777645-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:30:01 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-ad6abbbe-2a34-41d3-9b4e-eac4b4477742 tempest-VolumesTransfersV357Test-2175376 None] Lock "cinder-54f2ee87-5cbf-4930-8dc4-b25dd6777645-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:30:02 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-ad6abbbe-2a34-41d3-9b4e-eac4b4477742 tempest-VolumesTransfersV357Test-2175376 None] Acquiring lock "cinder-quobyte-54f2ee87-5cbf-4930-8dc4-b25dd6777645" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:30:02 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-ad6abbbe-2a34-41d3-9b4e-eac4b4477742 tempest-VolumesTransfersV357Test-2175376 None] Lock "cinder-quobyte-54f2ee87-5cbf-4930-8dc4-b25dd6777645" acquired by "delete_volume" :: waited 0.019s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:30:02 devstack sudo[98590]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:02 devstack sudo[98592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-4e70e9e6-277b-4fdb-ac93-eed91dbc57c6
Jul 30 20:30:02 devstack sudo[98592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:02 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-335a4d8f-f087-4b60-aec8-3abc2014d8d3 tempest-GroupSnapshotsTest-296266448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2a5791b9-0c39-4f8b-8f58-ee90cac4a9e8" returned: 0 in 0.454s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:02 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-335a4d8f-f087-4b60-aec8-3abc2014d8d3 tempest-GroupSnapshotsTest-296266448 None] will copy from snapshot at /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2a5791b9-0c39-4f8b-8f58-ee90cac4a9e8 {{(pid=88719) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}}
Jul 30 20:30:02 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-335a4d8f-f087-4b60-aec8-3abc2014d8d3 tempest-GroupSnapshotsTest-296266448 None] Creating direct copy from snapshot {{(pid=88719) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}}
Jul 30 20:30:02 devstack cinder-volume[88719]: DEBUG cinder.utils [None req-335a4d8f-f087-4b60-aec8-3abc2014d8d3 tempest-GroupSnapshotsTest-296266448 None] Path /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c1ff535a-75f1-43b5-8db5-b1d8141ab274 not found in is_blk_device check {{(pid=88719) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 30 20:30:02 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-335a4d8f-f087-4b60-aec8-3abc2014d8d3 tempest-GroupSnapshotsTest-296266448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2a5791b9-0c39-4f8b-8f58-ee90cac4a9e8 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c1ff535a-75f1-43b5-8db5-b1d8141ab274 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:02 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae527133-1eee-41ac-bdd9-5590c117089d]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:30:02 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-ad6abbbe-2a34-41d3-9b4e-eac4b4477742 tempest-VolumesTransfersV357Test-2175376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-54f2ee87-5cbf-4930-8dc4-b25dd6777645 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:02 devstack sudo[98598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2a5791b9-0c39-4f8b-8f58-ee90cac4a9e8 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c1ff535a-75f1-43b5-8db5-b1d8141ab274
Jul 30 20:30:02 devstack sudo[98598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:02 devstack sudo[98599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-54f2ee87-5cbf-4930-8dc4-b25dd6777645
Jul 30 20:30:02 devstack sudo[98599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:02 devstack sudo[98592]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:02 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-12ae854f-a6a8-46c3-8a9a-8e98ade2bf09 tempest-VolumesImageMetadata-2089098299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-4e70e9e6-277b-4fdb-ac93-eed91dbc57c6" returned: 0 in 0.528s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:02 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-12ae854f-a6a8-46c3-8a9a-8e98ade2bf09 tempest-VolumesImageMetadata-2089098299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-4e70e9e6-277b-4fdb-ac93-eed91dbc57c6 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:02 devstack sudo[98609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-4e70e9e6-277b-4fdb-ac93-eed91dbc57c6
Jul 30 20:30:02 devstack sudo[98609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:02 devstack sudo[98599]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:02 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-ad6abbbe-2a34-41d3-9b4e-eac4b4477742 tempest-VolumesTransfersV357Test-2175376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-54f2ee87-5cbf-4930-8dc4-b25dd6777645" returned: 0 in 0.440s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:02 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-ad6abbbe-2a34-41d3-9b4e-eac4b4477742 tempest-VolumesTransfersV357Test-2175376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-54f2ee87-5cbf-4930-8dc4-b25dd6777645 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:02 devstack sudo[98614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-54f2ee87-5cbf-4930-8dc4-b25dd6777645
Jul 30 20:30:02 devstack sudo[98614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:02 devstack sudo[98609]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:02 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-12ae854f-a6a8-46c3-8a9a-8e98ade2bf09 tempest-VolumesImageMetadata-2089098299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-4e70e9e6-277b-4fdb-ac93-eed91dbc57c6" returned: 0 in 0.435s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:02 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-12ae854f-a6a8-46c3-8a9a-8e98ade2bf09 tempest-VolumesImageMetadata-2089098299 None] Lock "cinder-quobyte-4e70e9e6-277b-4fdb-ac93-eed91dbc57c6" released by "delete_volume" :: held 1.051s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:30:03 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-12ae854f-a6a8-46c3-8a9a-8e98ade2bf09 tempest-VolumesImageMetadata-2089098299 None] Created reservations ['ed50a14b-484b-4a46-a2df-4f7719d2a2e9', '797586b5-0b39-44c9-9b5a-f127f0ca1d48', '8514cc77-4749-49c7-8703-16227a7367cb', '6260e45a-b0a9-4c12-94fc-b4aa57aeca8e'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:30:03 devstack sudo[98614]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:03 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-ad6abbbe-2a34-41d3-9b4e-eac4b4477742 tempest-VolumesTransfersV357Test-2175376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-54f2ee87-5cbf-4930-8dc4-b25dd6777645" returned: 0 in 0.770s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:03 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-ad6abbbe-2a34-41d3-9b4e-eac4b4477742 tempest-VolumesTransfersV357Test-2175376 None] Lock "cinder-quobyte-54f2ee87-5cbf-4930-8dc4-b25dd6777645" released by "delete_volume" :: held 1.318s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:30:03 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-12ae854f-a6a8-46c3-8a9a-8e98ade2bf09 tempest-VolumesImageMetadata-2089098299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:30:03 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-12ae854f-a6a8-46c3-8a9a-8e98ade2bf09 tempest-VolumesImageMetadata-2089098299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:30:03 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-12ae854f-a6a8-46c3-8a9a-8e98ade2bf09 tempest-VolumesImageMetadata-2089098299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:30:03 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-12ae854f-a6a8-46c3-8a9a-8e98ade2bf09 tempest-VolumesImageMetadata-2089098299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:30:03 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-12ae854f-a6a8-46c3-8a9a-8e98ade2bf09 tempest-VolumesImageMetadata-2089098299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:30:03 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-12ae854f-a6a8-46c3-8a9a-8e98ade2bf09 tempest-VolumesImageMetadata-2089098299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:03 devstack sudo[98627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:30:03 devstack sudo[98627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:03 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-ad6abbbe-2a34-41d3-9b4e-eac4b4477742 tempest-VolumesTransfersV357Test-2175376 None] Created reservations ['a0b21953-cee2-4ab0-a184-3bb8119819c5', '8d53c0fd-fdde-4d2d-99f3-2aad29aab113', '98973a79-ada3-4f09-b2c3-2112326a9652', '8cf4e31b-175c-4b3a-bd40-e46f0fa789cf'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:30:03 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-ad6abbbe-2a34-41d3-9b4e-eac4b4477742 tempest-VolumesTransfersV357Test-2175376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:30:03 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-ad6abbbe-2a34-41d3-9b4e-eac4b4477742 tempest-VolumesTransfersV357Test-2175376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:30:03 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-ad6abbbe-2a34-41d3-9b4e-eac4b4477742 tempest-VolumesTransfersV357Test-2175376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:30:03 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-ad6abbbe-2a34-41d3-9b4e-eac4b4477742 tempest-VolumesTransfersV357Test-2175376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:30:03 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-ad6abbbe-2a34-41d3-9b4e-eac4b4477742 tempest-VolumesTransfersV357Test-2175376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:30:03 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-ad6abbbe-2a34-41d3-9b4e-eac4b4477742 tempest-VolumesTransfersV357Test-2175376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:04 devstack sudo[98629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:30:04 devstack sudo[98629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:04 devstack sudo[98627]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:04 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-12ae854f-a6a8-46c3-8a9a-8e98ade2bf09 tempest-VolumesImageMetadata-2089098299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.681s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:04 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-12ae854f-a6a8-46c3-8a9a-8e98ade2bf09 tempest-VolumesImageMetadata-2089098299 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:30:04 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-12ae854f-a6a8-46c3-8a9a-8e98ade2bf09 tempest-VolumesImageMetadata-2089098299 None] Deleted volume successfully.
Jul 30 20:30:04 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-12ae854f-a6a8-46c3-8a9a-8e98ade2bf09 tempest-VolumesImageMetadata-2089098299 None] Lock "cinder-4e70e9e6-277b-4fdb-ac93-eed91dbc57c6-delete_volume" released by "delete_volume" :: held 2.431s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:30:04 devstack sudo[98629]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:04 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-ad6abbbe-2a34-41d3-9b4e-eac4b4477742 tempest-VolumesTransfersV357Test-2175376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.574s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:04 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-ad6abbbe-2a34-41d3-9b4e-eac4b4477742 tempest-VolumesTransfersV357Test-2175376 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:30:04 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-ad6abbbe-2a34-41d3-9b4e-eac4b4477742 tempest-VolumesTransfersV357Test-2175376 None] Deleted volume successfully.
Jul 30 20:30:04 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-ad6abbbe-2a34-41d3-9b4e-eac4b4477742 tempest-VolumesTransfersV357Test-2175376 None] Lock "cinder-54f2ee87-5cbf-4930-8dc4-b25dd6777645-delete_volume" released by "delete_volume" :: held 2.550s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:30:08 devstack sudo[98598]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:08 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-335a4d8f-f087-4b60-aec8-3abc2014d8d3 tempest-GroupSnapshotsTest-296266448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2a5791b9-0c39-4f8b-8f58-ee90cac4a9e8 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c1ff535a-75f1-43b5-8db5-b1d8141ab274" returned: 0 in 6.175s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:08 devstack cinder-volume[88719]: DEBUG cinder.image.image_utils [None req-335a4d8f-f087-4b60-aec8-3abc2014d8d3 tempest-GroupSnapshotsTest-296266448 None] Image conversion details: src /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2a5791b9-0c39-4f8b-8f58-ee90cac4a9e8, size 1024.00 MB, duration 6.18 sec, destination /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c1ff535a-75f1-43b5-8db5-b1d8141ab274 {{(pid=88719) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 30 20:30:08 devstack cinder-volume[88719]: INFO cinder.image.image_utils [None req-335a4d8f-f087-4b60-aec8-3abc2014d8d3 tempest-GroupSnapshotsTest-296266448 None] Converted 1024.00 MB image at 165.81 MB/s
Jul 30 20:30:08 devstack cinder-volume[88719]: WARNING cinder.volume.drivers.remotefs [None req-335a4d8f-f087-4b60-aec8-3abc2014d8d3 tempest-GroupSnapshotsTest-296266448 None] /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c1ff535a-75f1-43b5-8db5-b1d8141ab274 is being set with open permissions: ugo+rw: NotImplementedError
Jul 30 20:30:08 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-335a4d8f-f087-4b60-aec8-3abc2014d8d3 tempest-GroupSnapshotsTest-296266448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c1ff535a-75f1-43b5-8db5-b1d8141ab274 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:08 devstack sudo[98642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c1ff535a-75f1-43b5-8db5-b1d8141ab274
Jul 30 20:30:08 devstack sudo[98642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:08 devstack sudo[98642]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:08 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-335a4d8f-f087-4b60-aec8-3abc2014d8d3 tempest-GroupSnapshotsTest-296266448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c1ff535a-75f1-43b5-8db5-b1d8141ab274" returned: 0 in 0.309s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:08 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-335a4d8f-f087-4b60-aec8-3abc2014d8d3 tempest-GroupSnapshotsTest-296266448 None] Lock "cinder-quobyte-c1ff535a-75f1-43b5-8db5-b1d8141ab274" released by "_copy_volume_from_snapshot" :: held 7.513s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:30:08 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-335a4d8f-f087-4b60-aec8-3abc2014d8d3 tempest-GroupSnapshotsTest-296266448 None] Lock "cinder-quobyte-2342999d-315f-4428-b2d3-80e6310f7c69-c1ff535a-75f1-43b5-8db5-b1d8141ab274" released by "_create_volume_from_snapshot" :: held 7.595s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:30:08 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-335a4d8f-f087-4b60-aec8-3abc2014d8d3 tempest-GroupSnapshotsTest-296266448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.616s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:30:08 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-335a4d8f-f087-4b60-aec8-3abc2014d8d3 tempest-GroupSnapshotsTest-296266448 None] Create group from source-snapshot-0377a266-6c5b-4df6-836d-914df0fd9c11 completed successfully.
Jul 30 20:30:10 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-68f4e646-f98d-4977-90c6-6a0d65ea110a tempest-GroupSnapshotsTest-296266448 None] Acquiring lock "cinder-quobyte-c1ff535a-75f1-43b5-8db5-b1d8141ab274" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:30:10 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-68f4e646-f98d-4977-90c6-6a0d65ea110a tempest-GroupSnapshotsTest-296266448 None] Lock "cinder-quobyte-c1ff535a-75f1-43b5-8db5-b1d8141ab274" acquired by "delete_volume" :: waited 0.032s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:30:10 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[08056bbe-2cc0-4ee2-9072-87a5388f8603]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:30:10 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-68f4e646-f98d-4977-90c6-6a0d65ea110a tempest-GroupSnapshotsTest-296266448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c1ff535a-75f1-43b5-8db5-b1d8141ab274 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:10 devstack sudo[98646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c1ff535a-75f1-43b5-8db5-b1d8141ab274
Jul 30 20:30:10 devstack sudo[98646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:10 devstack sudo[98646]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:10 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-68f4e646-f98d-4977-90c6-6a0d65ea110a tempest-GroupSnapshotsTest-296266448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c1ff535a-75f1-43b5-8db5-b1d8141ab274" returned: 0 in 0.475s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:10 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-68f4e646-f98d-4977-90c6-6a0d65ea110a tempest-GroupSnapshotsTest-296266448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c1ff535a-75f1-43b5-8db5-b1d8141ab274 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:10 devstack sudo[98651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c1ff535a-75f1-43b5-8db5-b1d8141ab274
Jul 30 20:30:10 devstack sudo[98651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:11 devstack sudo[98651]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:11 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-68f4e646-f98d-4977-90c6-6a0d65ea110a tempest-GroupSnapshotsTest-296266448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c1ff535a-75f1-43b5-8db5-b1d8141ab274" returned: 0 in 0.382s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:11 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-68f4e646-f98d-4977-90c6-6a0d65ea110a tempest-GroupSnapshotsTest-296266448 None] Lock "cinder-quobyte-c1ff535a-75f1-43b5-8db5-b1d8141ab274" released by "delete_volume" :: held 0.946s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:30:11 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-68f4e646-f98d-4977-90c6-6a0d65ea110a tempest-GroupSnapshotsTest-296266448 None] Created reservations ['5a16733c-1422-4d4d-8ae9-f93bdd821b5b'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:30:11 devstack cinder-volume[88719]: WARNING cinder.quota [None req-68f4e646-f98d-4977-90c6-6a0d65ea110a tempest-GroupSnapshotsTest-296266448 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1295903257 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1295903257, it is now deprecated. Please use the default quota class for default quota.
Jul 30 20:30:11 devstack cinder-volume[88719]: WARNING cinder.quota [None req-68f4e646-f98d-4977-90c6-6a0d65ea110a tempest-GroupSnapshotsTest-296266448 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1295903257 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1295903257, it is now deprecated. Please use the default quota class for default quota.
Jul 30 20:30:11 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-68f4e646-f98d-4977-90c6-6a0d65ea110a tempest-GroupSnapshotsTest-296266448 None] Created reservations ['eb39c417-dce0-4b4c-9382-3512079473c0', 'edcc96db-82fe-4d5d-b9f3-b86f180b8139', '7e23a948-ef0c-4f13-bfd3-b2cffb419398', '91b456a0-1b90-47f8-846f-a462f8df415c'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:30:11 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-e738aa43-dec5-4ee3-a794-9c24700c5705 tempest-AbsoluteLimitsTests-879341940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:30:11 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e738aa43-dec5-4ee3-a794-9c24700c5705 tempest-AbsoluteLimitsTests-879341940 None] Flow 'volume_create_manager' (d126deb8-438b-449d-87ee-673a41501bcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:30:11 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e738aa43-dec5-4ee3-a794-9c24700c5705 tempest-AbsoluteLimitsTests-879341940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b168882d-ce77-463e-9e89-d290a7c312a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:30:11 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e738aa43-dec5-4ee3-a794-9c24700c5705 tempest-AbsoluteLimitsTests-879341940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b168882d-ce77-463e-9e89-d290a7c312a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:30:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1003514300',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acb064e3-4310-49c1-b631-cfba93e6424e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abd4f00ebbf34be1a59ceac1151a7eb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:30:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:30:11Z,use_quota=True,user_id='771dba3823e34bd8b941c56e0bb61c7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:30:11 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e738aa43-dec5-4ee3-a794-9c24700c5705 tempest-AbsoluteLimitsTests-879341940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7addeff0-02bf-405c-91df-4835de7c3337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:30:11 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e738aa43-dec5-4ee3-a794-9c24700c5705 tempest-AbsoluteLimitsTests-879341940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7addeff0-02bf-405c-91df-4835de7c3337) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:30:11 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e738aa43-dec5-4ee3-a794-9c24700c5705 tempest-AbsoluteLimitsTests-879341940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5476f094-e506-4693-925a-f9843009ceee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:30:11 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e738aa43-dec5-4ee3-a794-9c24700c5705 tempest-AbsoluteLimitsTests-879341940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5476f094-e506-4693-925a-f9843009ceee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'acb064e3-4310-49c1-b631-cfba93e6424e', 'volume_name': 'volume-acb064e3-4310-49c1-b631-cfba93e6424e', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:30:11 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e738aa43-dec5-4ee3-a794-9c24700c5705 tempest-AbsoluteLimitsTests-879341940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d67202a5-a7ea-41bb-bc4f-508af7a18b3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:30:11 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e738aa43-dec5-4ee3-a794-9c24700c5705 tempest-AbsoluteLimitsTests-879341940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d67202a5-a7ea-41bb-bc4f-508af7a18b3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:30:11 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e738aa43-dec5-4ee3-a794-9c24700c5705 tempest-AbsoluteLimitsTests-879341940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c3e9f54-df6e-46fc-b24a-60c37bfbef90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:30:11 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-e738aa43-dec5-4ee3-a794-9c24700c5705 tempest-AbsoluteLimitsTests-879341940 None] Volume acb064e3-4310-49c1-b631-cfba93e6424e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-acb064e3-4310-49c1-b631-cfba93e6424e', 'volume_size': 1}
Jul 30 20:30:11 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-e738aa43-dec5-4ee3-a794-9c24700c5705 tempest-AbsoluteLimitsTests-879341940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:30:11 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-e738aa43-dec5-4ee3-a794-9c24700c5705 tempest-AbsoluteLimitsTests-879341940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:30:11 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-e738aa43-dec5-4ee3-a794-9c24700c5705 tempest-AbsoluteLimitsTests-879341940 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:30:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1003514300',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acb064e3-4310-49c1-b631-cfba93e6424e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abd4f00ebbf34be1a59ceac1151a7eb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:30:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:30:11Z,use_quota=True,user_id='771dba3823e34bd8b941c56e0bb61c7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:30:11 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-e738aa43-dec5-4ee3-a794-9c24700c5705 tempest-AbsoluteLimitsTests-879341940 None] Creating volume acb064e3-4310-49c1-b631-cfba93e6424e {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:30:11 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-e738aa43-dec5-4ee3-a794-9c24700c5705 tempest-AbsoluteLimitsTests-879341940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:30:11 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-e738aa43-dec5-4ee3-a794-9c24700c5705 tempest-AbsoluteLimitsTests-879341940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:30:11 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-e738aa43-dec5-4ee3-a794-9c24700c5705 tempest-AbsoluteLimitsTests-879341940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:30:11 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-e738aa43-dec5-4ee3-a794-9c24700c5705 tempest-AbsoluteLimitsTests-879341940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:30:11 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-e738aa43-dec5-4ee3-a794-9c24700c5705 tempest-AbsoluteLimitsTests-879341940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:30:11 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-e738aa43-dec5-4ee3-a794-9c24700c5705 tempest-AbsoluteLimitsTests-879341940 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:30:11 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-e738aa43-dec5-4ee3-a794-9c24700c5705 tempest-AbsoluteLimitsTests-879341940 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:30:11 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-e738aa43-dec5-4ee3-a794-9c24700c5705 tempest-AbsoluteLimitsTests-879341940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-acb064e3-4310-49c1-b631-cfba93e6424e 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:11 devstack sudo[98655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-acb064e3-4310-49c1-b631-cfba93e6424e 1073741824
Jul 30 20:30:11 devstack sudo[98655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:11 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-68f4e646-f98d-4977-90c6-6a0d65ea110a tempest-GroupSnapshotsTest-296266448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:30:11 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-68f4e646-f98d-4977-90c6-6a0d65ea110a tempest-GroupSnapshotsTest-296266448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:30:11 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-68f4e646-f98d-4977-90c6-6a0d65ea110a tempest-GroupSnapshotsTest-296266448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:30:11 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-68f4e646-f98d-4977-90c6-6a0d65ea110a tempest-GroupSnapshotsTest-296266448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:30:11 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-68f4e646-f98d-4977-90c6-6a0d65ea110a tempest-GroupSnapshotsTest-296266448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:30:11 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-68f4e646-f98d-4977-90c6-6a0d65ea110a tempest-GroupSnapshotsTest-296266448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:11 devstack sudo[98657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:30:11 devstack sudo[98657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:11 devstack sudo[98657]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:11 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-68f4e646-f98d-4977-90c6-6a0d65ea110a tempest-GroupSnapshotsTest-296266448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.385s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:11 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-68f4e646-f98d-4977-90c6-6a0d65ea110a tempest-GroupSnapshotsTest-296266448 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:30:11 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-68f4e646-f98d-4977-90c6-6a0d65ea110a tempest-GroupSnapshotsTest-296266448 None] Delete group completed successfully.
Jul 30 20:30:11 devstack sudo[98655]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:11 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-e738aa43-dec5-4ee3-a794-9c24700c5705 tempest-AbsoluteLimitsTests-879341940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-acb064e3-4310-49c1-b631-cfba93e6424e 1073741824" returned: 0 in 0.596s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:12 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-e738aa43-dec5-4ee3-a794-9c24700c5705 tempest-AbsoluteLimitsTests-879341940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-acb064e3-4310-49c1-b631-cfba93e6424e {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:12 devstack sudo[98664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-acb064e3-4310-49c1-b631-cfba93e6424e
Jul 30 20:30:12 devstack sudo[98664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:12 devstack sudo[98664]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:12 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-e738aa43-dec5-4ee3-a794-9c24700c5705 tempest-AbsoluteLimitsTests-879341940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-acb064e3-4310-49c1-b631-cfba93e6424e" returned: 0 in 0.270s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:12 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-e738aa43-dec5-4ee3-a794-9c24700c5705 tempest-AbsoluteLimitsTests-879341940 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:30:12 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-e738aa43-dec5-4ee3-a794-9c24700c5705 tempest-AbsoluteLimitsTests-879341940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:30:12 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e738aa43-dec5-4ee3-a794-9c24700c5705 tempest-AbsoluteLimitsTests-879341940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c3e9f54-df6e-46fc-b24a-60c37bfbef90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-acb064e3-4310-49c1-b631-cfba93e6424e', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:30:12 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e738aa43-dec5-4ee3-a794-9c24700c5705 tempest-AbsoluteLimitsTests-879341940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a0d2027-85bf-4d72-9cf9-9874f1252891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:30:12 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-e738aa43-dec5-4ee3-a794-9c24700c5705 tempest-AbsoluteLimitsTests-879341940 None] Volume volume-acb064e3-4310-49c1-b631-cfba93e6424e (acb064e3-4310-49c1-b631-cfba93e6424e): created successfully
Jul 30 20:30:12 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e738aa43-dec5-4ee3-a794-9c24700c5705 tempest-AbsoluteLimitsTests-879341940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a0d2027-85bf-4d72-9cf9-9874f1252891) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:30:12 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e738aa43-dec5-4ee3-a794-9c24700c5705 tempest-AbsoluteLimitsTests-879341940 None] Flow 'volume_create_manager' (d126deb8-438b-449d-87ee-673a41501bcd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:30:12 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-e738aa43-dec5-4ee3-a794-9c24700c5705 tempest-AbsoluteLimitsTests-879341940 None] Created volume successfully.
Jul 30 20:30:12 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e81992a-debf-43b7-9150-b39f8e09d9ee tempest-VolumesTransfersV355Test-1436137063 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:30:12 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-3e81992a-debf-43b7-9150-b39f8e09d9ee tempest-VolumesTransfersV355Test-1436137063 None] Flow 'volume_create_manager' (fdaf720b-e6ea-4a7d-9153-1fb1a5776dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:30:12 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-3e81992a-debf-43b7-9150-b39f8e09d9ee tempest-VolumesTransfersV355Test-1436137063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61eece83-a3dc-4c47-ab7c-ec6cea28420d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:30:12 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-ffab0ad3-a5f8-4f8d-88ee-421092894f38 tempest-GroupSnapshotsTest-296266448 None] group_snapshot 0377a266-6c5b-4df6-836d-914df0fd9c11: deleting
Jul 30 20:30:12 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-3e81992a-debf-43b7-9150-b39f8e09d9ee tempest-VolumesTransfersV355Test-1436137063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61eece83-a3dc-4c47-ab7c-ec6cea28420d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:30:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-500239889',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac03ba54-2134-4a4d-a536-f45471095a34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf2dd81621f5417196b64294ffc7f780',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:30:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:30:13Z,use_quota=True,user_id='620b76d142604a8ebcf40f0c81725c49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:30:12 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-3e81992a-debf-43b7-9150-b39f8e09d9ee tempest-VolumesTransfersV355Test-1436137063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f13dabb-e493-441c-879d-363afc433627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:30:12 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-3e81992a-debf-43b7-9150-b39f8e09d9ee tempest-VolumesTransfersV355Test-1436137063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f13dabb-e493-441c-879d-363afc433627) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:30:12 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-3e81992a-debf-43b7-9150-b39f8e09d9ee tempest-VolumesTransfersV355Test-1436137063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e076bb2-327e-42f5-ad84-3c9154c55a86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:30:12 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-3e81992a-debf-43b7-9150-b39f8e09d9ee tempest-VolumesTransfersV355Test-1436137063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e076bb2-327e-42f5-ad84-3c9154c55a86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac03ba54-2134-4a4d-a536-f45471095a34', 'volume_name': 'volume-ac03ba54-2134-4a4d-a536-f45471095a34', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:30:12 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-3e81992a-debf-43b7-9150-b39f8e09d9ee tempest-VolumesTransfersV355Test-1436137063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95e10132-e938-4fe2-acd5-77581207687d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:30:12 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-3e81992a-debf-43b7-9150-b39f8e09d9ee tempest-VolumesTransfersV355Test-1436137063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95e10132-e938-4fe2-acd5-77581207687d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:30:12 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-3e81992a-debf-43b7-9150-b39f8e09d9ee tempest-VolumesTransfersV355Test-1436137063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6ee5ddf-73d3-4828-90f3-499588f5ea31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:30:12 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-3e81992a-debf-43b7-9150-b39f8e09d9ee tempest-VolumesTransfersV355Test-1436137063 None] Volume ac03ba54-2134-4a4d-a536-f45471095a34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac03ba54-2134-4a4d-a536-f45471095a34', 'volume_size': 1}
Jul 30 20:30:12 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-3e81992a-debf-43b7-9150-b39f8e09d9ee tempest-VolumesTransfersV355Test-1436137063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:30:12 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-3e81992a-debf-43b7-9150-b39f8e09d9ee tempest-VolumesTransfersV355Test-1436137063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:30:12 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-3e81992a-debf-43b7-9150-b39f8e09d9ee tempest-VolumesTransfersV355Test-1436137063 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:30:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-500239889',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac03ba54-2134-4a4d-a536-f45471095a34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf2dd81621f5417196b64294ffc7f780',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:30:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:30:13Z,use_quota=True,user_id='620b76d142604a8ebcf40f0c81725c49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:30:12 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-3e81992a-debf-43b7-9150-b39f8e09d9ee tempest-VolumesTransfersV355Test-1436137063 None] Creating volume ac03ba54-2134-4a4d-a536-f45471095a34 {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:30:12 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-3e81992a-debf-43b7-9150-b39f8e09d9ee tempest-VolumesTransfersV355Test-1436137063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:30:12 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-3e81992a-debf-43b7-9150-b39f8e09d9ee tempest-VolumesTransfersV355Test-1436137063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:30:12 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-3e81992a-debf-43b7-9150-b39f8e09d9ee tempest-VolumesTransfersV355Test-1436137063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:30:12 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-3e81992a-debf-43b7-9150-b39f8e09d9ee tempest-VolumesTransfersV355Test-1436137063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:30:12 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-3e81992a-debf-43b7-9150-b39f8e09d9ee tempest-VolumesTransfersV355Test-1436137063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:30:12 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-3e81992a-debf-43b7-9150-b39f8e09d9ee tempest-VolumesTransfersV355Test-1436137063 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:30:12 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-3e81992a-debf-43b7-9150-b39f8e09d9ee tempest-VolumesTransfersV355Test-1436137063 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:30:12 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3e81992a-debf-43b7-9150-b39f8e09d9ee tempest-VolumesTransfersV355Test-1436137063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-ac03ba54-2134-4a4d-a536-f45471095a34 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:12 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-ffab0ad3-a5f8-4f8d-88ee-421092894f38 tempest-GroupSnapshotsTest-296266448 None] group_snapshot 0377a266-6c5b-4df6-836d-914df0fd9c11: deleting {{(pid=88719) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jul 30 20:30:12 devstack sudo[98667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-ac03ba54-2134-4a4d-a536-f45471095a34 1073741824
Jul 30 20:30:12 devstack sudo[98667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:12 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-ffab0ad3-a5f8-4f8d-88ee-421092894f38 tempest-GroupSnapshotsTest-296266448 None] Acquiring lock "cinder-quobyte-2a5791b9-0c39-4f8b-8f58-ee90cac4a9e8" by "delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:30:12 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-ffab0ad3-a5f8-4f8d-88ee-421092894f38 tempest-GroupSnapshotsTest-296266448 None] Lock "cinder-quobyte-2a5791b9-0c39-4f8b-8f58-ee90cac4a9e8" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:30:12 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-ffab0ad3-a5f8-4f8d-88ee-421092894f38 tempest-GroupSnapshotsTest-296266448 None] Acquiring lock "cinder-quobyte-2342999d-315f-4428-b2d3-80e6310f7c69" by "_delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:30:12 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-ffab0ad3-a5f8-4f8d-88ee-421092894f38 tempest-GroupSnapshotsTest-296266448 None] Lock "cinder-quobyte-2342999d-315f-4428-b2d3-80e6310f7c69" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:30:12 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-ffab0ad3-a5f8-4f8d-88ee-421092894f38 tempest-GroupSnapshotsTest-296266448 None] Deleting offline snapshot 2342999d-315f-4428-b2d3-80e6310f7c69 of volume 2a5791b9-0c39-4f8b-8f58-ee90cac4a9e8 {{(pid=88719) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 30 20:30:12 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-ffab0ad3-a5f8-4f8d-88ee-421092894f38 tempest-GroupSnapshotsTest-296266448 None] snapshot_file for this snap is: volume-2a5791b9-0c39-4f8b-8f58-ee90cac4a9e8.2342999d-315f-4428-b2d3-80e6310f7c69 {{(pid=88719) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 30 20:30:12 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[0520dff0-6ae4-45b6-ab51-cda988987bb5]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:30:12 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-ffab0ad3-a5f8-4f8d-88ee-421092894f38 tempest-GroupSnapshotsTest-296266448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2a5791b9-0c39-4f8b-8f58-ee90cac4a9e8.2342999d-315f-4428-b2d3-80e6310f7c69 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:13 devstack sudo[98669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2a5791b9-0c39-4f8b-8f58-ee90cac4a9e8.2342999d-315f-4428-b2d3-80e6310f7c69
Jul 30 20:30:13 devstack sudo[98669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:13 devstack sudo[98669]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:13 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-ffab0ad3-a5f8-4f8d-88ee-421092894f38 tempest-GroupSnapshotsTest-296266448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2a5791b9-0c39-4f8b-8f58-ee90cac4a9e8.2342999d-315f-4428-b2d3-80e6310f7c69" returned: 0 in 0.385s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:13 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-ffab0ad3-a5f8-4f8d-88ee-421092894f38 tempest-GroupSnapshotsTest-296266448 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2a5791b9-0c39-4f8b-8f58-ee90cac4a9e8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88719) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 30 20:30:13 devstack sudo[98667]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:13 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3e81992a-debf-43b7-9150-b39f8e09d9ee tempest-VolumesTransfersV355Test-1436137063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-ac03ba54-2134-4a4d-a536-f45471095a34 1073741824" returned: 0 in 0.547s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:13 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[4387c17f-d20d-46b9-bc3f-b6a4275095db]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:30:13 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-ffab0ad3-a5f8-4f8d-88ee-421092894f38 tempest-GroupSnapshotsTest-296266448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2a5791b9-0c39-4f8b-8f58-ee90cac4a9e8 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:13 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3e81992a-debf-43b7-9150-b39f8e09d9ee tempest-VolumesTransfersV355Test-1436137063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-ac03ba54-2134-4a4d-a536-f45471095a34 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:13 devstack sudo[98679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-ac03ba54-2134-4a4d-a536-f45471095a34
Jul 30 20:30:13 devstack sudo[98679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:13 devstack sudo[98678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2a5791b9-0c39-4f8b-8f58-ee90cac4a9e8
Jul 30 20:30:13 devstack sudo[98678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:13 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-f6eeb8bf-2738-4544-a97a-a3a138784a32 tempest-AbsoluteLimitsTests-879341940 None] Acquiring lock "cinder-acb064e3-4310-49c1-b631-cfba93e6424e-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:30:13 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-f6eeb8bf-2738-4544-a97a-a3a138784a32 tempest-AbsoluteLimitsTests-879341940 None] Lock "cinder-acb064e3-4310-49c1-b631-cfba93e6424e-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:30:13 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-f6eeb8bf-2738-4544-a97a-a3a138784a32 tempest-AbsoluteLimitsTests-879341940 None] Acquiring lock "cinder-quobyte-acb064e3-4310-49c1-b631-cfba93e6424e" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:30:13 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-f6eeb8bf-2738-4544-a97a-a3a138784a32 tempest-AbsoluteLimitsTests-879341940 None] Lock "cinder-quobyte-acb064e3-4310-49c1-b631-cfba93e6424e" acquired by "delete_volume" :: waited 0.022s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:30:13 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[08822501-6023-48be-b931-80df4325b1ab]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:30:13 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f6eeb8bf-2738-4544-a97a-a3a138784a32 tempest-AbsoluteLimitsTests-879341940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-acb064e3-4310-49c1-b631-cfba93e6424e {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:13 devstack sudo[98679]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:13 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3e81992a-debf-43b7-9150-b39f8e09d9ee tempest-VolumesTransfersV355Test-1436137063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-ac03ba54-2134-4a4d-a536-f45471095a34" returned: 0 in 0.344s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:13 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-3e81992a-debf-43b7-9150-b39f8e09d9ee tempest-VolumesTransfersV355Test-1436137063 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:30:13 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-3e81992a-debf-43b7-9150-b39f8e09d9ee tempest-VolumesTransfersV355Test-1436137063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.990s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:30:13 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-3e81992a-debf-43b7-9150-b39f8e09d9ee tempest-VolumesTransfersV355Test-1436137063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6ee5ddf-73d3-4828-90f3-499588f5ea31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac03ba54-2134-4a4d-a536-f45471095a34', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:30:13 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-3e81992a-debf-43b7-9150-b39f8e09d9ee tempest-VolumesTransfersV355Test-1436137063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd5befe2-cc4b-4b2f-ae01-87cfd11bf267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:30:13 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-3e81992a-debf-43b7-9150-b39f8e09d9ee tempest-VolumesTransfersV355Test-1436137063 None] Volume volume-ac03ba54-2134-4a4d-a536-f45471095a34 (ac03ba54-2134-4a4d-a536-f45471095a34): created successfully
Jul 30 20:30:13 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-3e81992a-debf-43b7-9150-b39f8e09d9ee tempest-VolumesTransfersV355Test-1436137063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd5befe2-cc4b-4b2f-ae01-87cfd11bf267) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:30:13 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-3e81992a-debf-43b7-9150-b39f8e09d9ee tempest-VolumesTransfersV355Test-1436137063 None] Flow 'volume_create_manager' (fdaf720b-e6ea-4a7d-9153-1fb1a5776dd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:30:13 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-3e81992a-debf-43b7-9150-b39f8e09d9ee tempest-VolumesTransfersV355Test-1436137063 None] Created volume successfully.
Jul 30 20:30:13 devstack sudo[98683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-acb064e3-4310-49c1-b631-cfba93e6424e
Jul 30 20:30:13 devstack sudo[98683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:14 devstack sudo[98678]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:14 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-ffab0ad3-a5f8-4f8d-88ee-421092894f38 tempest-GroupSnapshotsTest-296266448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2a5791b9-0c39-4f8b-8f58-ee90cac4a9e8" returned: 0 in 0.687s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:14 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-ffab0ad3-a5f8-4f8d-88ee-421092894f38 tempest-GroupSnapshotsTest-296266448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2a5791b9-0c39-4f8b-8f58-ee90cac4a9e8.2342999d-315f-4428-b2d3-80e6310f7c69 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:14 devstack sudo[98688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2a5791b9-0c39-4f8b-8f58-ee90cac4a9e8.2342999d-315f-4428-b2d3-80e6310f7c69
Jul 30 20:30:14 devstack sudo[98688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:14 devstack sudo[98683]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:14 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f6eeb8bf-2738-4544-a97a-a3a138784a32 tempest-AbsoluteLimitsTests-879341940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-acb064e3-4310-49c1-b631-cfba93e6424e" returned: 0 in 0.434s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:14 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f6eeb8bf-2738-4544-a97a-a3a138784a32 tempest-AbsoluteLimitsTests-879341940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-acb064e3-4310-49c1-b631-cfba93e6424e {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:14 devstack sudo[98693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-acb064e3-4310-49c1-b631-cfba93e6424e
Jul 30 20:30:14 devstack sudo[98693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:14 devstack sudo[98688]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:14 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-ffab0ad3-a5f8-4f8d-88ee-421092894f38 tempest-GroupSnapshotsTest-296266448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2a5791b9-0c39-4f8b-8f58-ee90cac4a9e8.2342999d-315f-4428-b2d3-80e6310f7c69" returned: 0 in 0.365s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:14 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-ffab0ad3-a5f8-4f8d-88ee-421092894f38 tempest-GroupSnapshotsTest-296266448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2a5791b9-0c39-4f8b-8f58-ee90cac4a9e8.2342999d-315f-4428-b2d3-80e6310f7c69 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:14 devstack sudo[98700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2a5791b9-0c39-4f8b-8f58-ee90cac4a9e8.2342999d-315f-4428-b2d3-80e6310f7c69
Jul 30 20:30:14 devstack sudo[98700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:14 devstack sudo[98693]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:14 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f6eeb8bf-2738-4544-a97a-a3a138784a32 tempest-AbsoluteLimitsTests-879341940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-acb064e3-4310-49c1-b631-cfba93e6424e" returned: 0 in 0.327s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:14 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-f6eeb8bf-2738-4544-a97a-a3a138784a32 tempest-AbsoluteLimitsTests-879341940 None] Lock "cinder-quobyte-acb064e3-4310-49c1-b631-cfba93e6424e" released by "delete_volume" :: held 0.830s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:30:14 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-f6eeb8bf-2738-4544-a97a-a3a138784a32 tempest-AbsoluteLimitsTests-879341940 None] Created reservations ['90e0f6f1-fd6c-459b-bd25-7b80ebf2a3a7', '3b60b344-72d4-4cd6-adcb-788558bb7d6d', '0c3f1028-b147-483a-8729-7956b6aafc55', '996d3ad0-f64b-461f-b8d8-7dd0151afb02'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:30:14 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-f6eeb8bf-2738-4544-a97a-a3a138784a32 tempest-AbsoluteLimitsTests-879341940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:30:14 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-f6eeb8bf-2738-4544-a97a-a3a138784a32 tempest-AbsoluteLimitsTests-879341940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:30:14 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-f6eeb8bf-2738-4544-a97a-a3a138784a32 tempest-AbsoluteLimitsTests-879341940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:30:14 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-f6eeb8bf-2738-4544-a97a-a3a138784a32 tempest-AbsoluteLimitsTests-879341940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:30:14 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-f6eeb8bf-2738-4544-a97a-a3a138784a32 tempest-AbsoluteLimitsTests-879341940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:30:14 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f6eeb8bf-2738-4544-a97a-a3a138784a32 tempest-AbsoluteLimitsTests-879341940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:14 devstack sudo[98703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:30:14 devstack sudo[98700]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:14 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-ffab0ad3-a5f8-4f8d-88ee-421092894f38 tempest-GroupSnapshotsTest-296266448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2a5791b9-0c39-4f8b-8f58-ee90cac4a9e8.2342999d-315f-4428-b2d3-80e6310f7c69" returned: 0 in 0.353s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:14 devstack sudo[98703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:14 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-ffab0ad3-a5f8-4f8d-88ee-421092894f38 tempest-GroupSnapshotsTest-296266448 None] Lock "cinder-quobyte-2342999d-315f-4428-b2d3-80e6310f7c69" released by "_delete_snapshot" :: held 1.952s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:30:14 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-ffab0ad3-a5f8-4f8d-88ee-421092894f38 tempest-GroupSnapshotsTest-296266448 None] Lock "cinder-quobyte-2a5791b9-0c39-4f8b-8f58-ee90cac4a9e8" released by "delete_snapshot" :: held 1.994s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:30:14 devstack cinder-volume[88719]: WARNING cinder.quota [None req-ffab0ad3-a5f8-4f8d-88ee-421092894f38 tempest-GroupSnapshotsTest-296266448 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1295903257 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1295903257, it is now deprecated. Please use the default quota class for default quota.
Jul 30 20:30:15 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-ffab0ad3-a5f8-4f8d-88ee-421092894f38 tempest-GroupSnapshotsTest-296266448 None] Created reservations ['e589c11f-49fa-4851-bed5-8e24d5d170c7', '4c2d5385-f770-4128-af8e-105590397307', '1c2399b4-bbd5-4135-84e2-1de38b677e02', 'b55694c6-a138-4975-8870-a04bc689f795'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:30:15 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-ffab0ad3-a5f8-4f8d-88ee-421092894f38 tempest-GroupSnapshotsTest-296266448 None] group_snapshot 0377a266-6c5b-4df6-836d-914df0fd9c11: deleted successfully
Jul 30 20:30:15 devstack sudo[98703]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:15 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f6eeb8bf-2738-4544-a97a-a3a138784a32 tempest-AbsoluteLimitsTests-879341940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.457s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:15 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-f6eeb8bf-2738-4544-a97a-a3a138784a32 tempest-AbsoluteLimitsTests-879341940 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:30:15 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-f6eeb8bf-2738-4544-a97a-a3a138784a32 tempest-AbsoluteLimitsTests-879341940 None] Deleted volume successfully.
Jul 30 20:30:15 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-f6eeb8bf-2738-4544-a97a-a3a138784a32 tempest-AbsoluteLimitsTests-879341940 None] Lock "cinder-acb064e3-4310-49c1-b631-cfba93e6424e-delete_volume" released by "delete_volume" :: held 1.599s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:30:15 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-d2e031f7-b96d-41ba-a051-a106149e4119 tempest-VolumesTransfersV355Test-1188691023 None] Transfer volume completed successfully.
Jul 30 20:30:16 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-a9d37964-00c7-4fe2-bca9-1badf018be90 tempest-GroupSnapshotsTest-296266448 None] Acquiring lock "cinder-quobyte-2a5791b9-0c39-4f8b-8f58-ee90cac4a9e8" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:30:16 devstack cinder-volume[88719]: DEBUG oslo_service.periodic_task [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88719) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 30 20:30:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:30:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:30:16 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:30:16 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:30:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:30:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:16 devstack sudo[98706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:30:16 devstack sudo[98706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:16 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-a9d37964-00c7-4fe2-bca9-1badf018be90 tempest-GroupSnapshotsTest-296266448 None] Lock "cinder-quobyte-2a5791b9-0c39-4f8b-8f58-ee90cac4a9e8" acquired by "delete_volume" :: waited 0.061s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:30:16 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[c11edf34-e940-4593-96d5-e3907a32ac25]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:30:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-a9d37964-00c7-4fe2-bca9-1badf018be90 tempest-GroupSnapshotsTest-296266448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2a5791b9-0c39-4f8b-8f58-ee90cac4a9e8 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:16 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-edf649e5-60b7-4213-be6f-c6dfde4ce22e tempest-VolumesTransfersV355Test-751772463 None] Acquiring lock "cinder-ac03ba54-2134-4a4d-a536-f45471095a34-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:30:16 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-edf649e5-60b7-4213-be6f-c6dfde4ce22e tempest-VolumesTransfersV355Test-751772463 None] Lock "cinder-ac03ba54-2134-4a4d-a536-f45471095a34-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:30:16 devstack sudo[98708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2a5791b9-0c39-4f8b-8f58-ee90cac4a9e8
Jul 30 20:30:16 devstack sudo[98708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:16 devstack sudo[98706]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.414s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:16 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:30:16 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-edf649e5-60b7-4213-be6f-c6dfde4ce22e tempest-VolumesTransfersV355Test-751772463 None] Acquiring lock "cinder-quobyte-ac03ba54-2134-4a4d-a536-f45471095a34" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:30:16 devstack cinder-volume[88719]: DEBUG oslo_service.periodic_task [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Running periodic task VolumeManager._thread_info {{(pid=88719) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 30 20:30:16 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] thread count: 28 {{(pid=88719) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 30 20:30:16 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] thread info: [<_MainThread(MainThread, started 132390416908416)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132390306497536)>, <Thread(Thread-3 (stat_writer), started daemon 132390304471680)>, <Thread(Rabbit-heartbeat, started daemon 132390303393408)>, <Thread(Thread-5 (_runner), started daemon 132390303543168)>, <Thread(Thread-7 (_runner), started daemon 132390303563392)>, <Thread(fd_logger, started daemon 132390301344640)>, <Thread(privsep_reader, started daemon 132390301560640)>, <Thread(tpool_thread_0, started daemon 132390291470016)>, <Thread(tpool_thread_1, started daemon 132390283077312)>, <Thread(tpool_thread_2, started daemon 132390274684608)>, <Thread(tpool_thread_3, started daemon 132390266291904)>, <Thread(tpool_thread_4, started daemon 132390257899200)>, <Thread(tpool_thread_5, started daemon 132390249506496)>, <Thread(tpool_thread_6, started daemon 132390241113792)>, <Thread(tpool_thread_7, started daemon 132390232721088)>, <Thread(tpool_thread_8, started daemon 132390224328384)>, <Thread(tpool_thread_9, started daemon 132390215919296)>, <Thread(tpool_thread_10, started daemon 132390207510208)>, <Thread(tpool_thread_11, started daemon 132390199101120)>, <Thread(tpool_thread_12, started daemon 132390190692032)>, <Thread(tpool_thread_13, started daemon 132390182282944)>, <Thread(tpool_thread_14, started daemon 132390173873856)>, <Thread(tpool_thread_15, started daemon 132390165464768)>, <Thread(tpool_thread_16, started daemon 132390157055680)>, <Thread(tpool_thread_17, started daemon 132390148646592)>, <Thread(tpool_thread_18, started daemon 132390140237504)>, <Thread(tpool_thread_19, started daemon 132390131828416)>] {{(pid=88719) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 30 20:30:16 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-edf649e5-60b7-4213-be6f-c6dfde4ce22e tempest-VolumesTransfersV355Test-751772463 None] Lock "cinder-quobyte-ac03ba54-2134-4a4d-a536-f45471095a34" acquired by "delete_volume" :: waited 0.017s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:30:16 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[622bf1ca-65e9-4318-8958-06ad71080e44]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:30:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-edf649e5-60b7-4213-be6f-c6dfde4ce22e tempest-VolumesTransfersV355Test-751772463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-ac03ba54-2134-4a4d-a536-f45471095a34 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:17 devstack sudo[98711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-ac03ba54-2134-4a4d-a536-f45471095a34
Jul 30 20:30:17 devstack sudo[98711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:17 devstack sudo[98708]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:17 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-a9d37964-00c7-4fe2-bca9-1badf018be90 tempest-GroupSnapshotsTest-296266448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2a5791b9-0c39-4f8b-8f58-ee90cac4a9e8" returned: 0 in 0.612s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:17 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-a9d37964-00c7-4fe2-bca9-1badf018be90 tempest-GroupSnapshotsTest-296266448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2a5791b9-0c39-4f8b-8f58-ee90cac4a9e8 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:17 devstack sudo[98716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2a5791b9-0c39-4f8b-8f58-ee90cac4a9e8
Jul 30 20:30:17 devstack sudo[98716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:17 devstack sudo[98711]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:17 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-edf649e5-60b7-4213-be6f-c6dfde4ce22e tempest-VolumesTransfersV355Test-751772463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-ac03ba54-2134-4a4d-a536-f45471095a34" returned: 0 in 0.502s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:17 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-edf649e5-60b7-4213-be6f-c6dfde4ce22e tempest-VolumesTransfersV355Test-751772463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-ac03ba54-2134-4a4d-a536-f45471095a34 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:17 devstack sudo[98722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-ac03ba54-2134-4a4d-a536-f45471095a34
Jul 30 20:30:17 devstack sudo[98722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:17 devstack sudo[98716]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:17 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-a9d37964-00c7-4fe2-bca9-1badf018be90 tempest-GroupSnapshotsTest-296266448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2a5791b9-0c39-4f8b-8f58-ee90cac4a9e8" returned: 0 in 0.334s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:17 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-a9d37964-00c7-4fe2-bca9-1badf018be90 tempest-GroupSnapshotsTest-296266448 None] Lock "cinder-quobyte-2a5791b9-0c39-4f8b-8f58-ee90cac4a9e8" released by "delete_volume" :: held 1.050s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:30:17 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-a9d37964-00c7-4fe2-bca9-1badf018be90 tempest-GroupSnapshotsTest-296266448 None] Created reservations ['1738800a-3bf8-443c-939e-4685a2d644f1'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:30:17 devstack cinder-volume[88719]: WARNING cinder.db.api [None req-a9d37964-00c7-4fe2-bca9-1badf018be90 tempest-GroupSnapshotsTest-296266448 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1295903257']
Jul 30 20:30:17 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-a9d37964-00c7-4fe2-bca9-1badf018be90 tempest-GroupSnapshotsTest-296266448 None] Created reservations ['74cc6926-db02-4ce2-9c40-3ca024806450', '9d125e08-a0ff-4b2e-b3c3-f2ec9469d7ed', '455bc23c-1b72-46cc-8ddb-327a70241d7d', 'a1e92e2c-1e7b-4321-ab49-9862d826952c'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:30:17 devstack sudo[98722]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:17 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-edf649e5-60b7-4213-be6f-c6dfde4ce22e tempest-VolumesTransfersV355Test-751772463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-ac03ba54-2134-4a4d-a536-f45471095a34" returned: 0 in 0.388s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:17 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-edf649e5-60b7-4213-be6f-c6dfde4ce22e tempest-VolumesTransfersV355Test-751772463 None] Lock "cinder-quobyte-ac03ba54-2134-4a4d-a536-f45471095a34" released by "delete_volume" :: held 0.961s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:30:17 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-a9d37964-00c7-4fe2-bca9-1badf018be90 tempest-GroupSnapshotsTest-296266448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:30:17 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-a9d37964-00c7-4fe2-bca9-1badf018be90 tempest-GroupSnapshotsTest-296266448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:30:17 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-a9d37964-00c7-4fe2-bca9-1badf018be90 tempest-GroupSnapshotsTest-296266448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:30:17 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-a9d37964-00c7-4fe2-bca9-1badf018be90 tempest-GroupSnapshotsTest-296266448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:30:17 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-a9d37964-00c7-4fe2-bca9-1badf018be90 tempest-GroupSnapshotsTest-296266448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:30:17 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-a9d37964-00c7-4fe2-bca9-1badf018be90 tempest-GroupSnapshotsTest-296266448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:17 devstack sudo[98726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:30:17 devstack sudo[98726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:18 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-edf649e5-60b7-4213-be6f-c6dfde4ce22e tempest-VolumesTransfersV355Test-751772463 None] Created reservations ['4ce5c565-a112-4b8a-98ed-919922c68822', '96a1843f-b795-4a8d-b5b3-ba9ca0cac968', '55c2039b-9167-4b3d-891c-593a7937b13e', '11db2d79-aeae-49d5-b6b0-bb9966c14293'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:30:18 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-edf649e5-60b7-4213-be6f-c6dfde4ce22e tempest-VolumesTransfersV355Test-751772463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:30:18 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-edf649e5-60b7-4213-be6f-c6dfde4ce22e tempest-VolumesTransfersV355Test-751772463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:30:18 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-edf649e5-60b7-4213-be6f-c6dfde4ce22e tempest-VolumesTransfersV355Test-751772463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:30:18 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-edf649e5-60b7-4213-be6f-c6dfde4ce22e tempest-VolumesTransfersV355Test-751772463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:30:18 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-edf649e5-60b7-4213-be6f-c6dfde4ce22e tempest-VolumesTransfersV355Test-751772463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:30:18 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-edf649e5-60b7-4213-be6f-c6dfde4ce22e tempest-VolumesTransfersV355Test-751772463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:18 devstack sudo[98728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:30:18 devstack sudo[98728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:18 devstack sudo[98726]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:18 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-a9d37964-00c7-4fe2-bca9-1badf018be90 tempest-GroupSnapshotsTest-296266448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.454s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:18 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-a9d37964-00c7-4fe2-bca9-1badf018be90 tempest-GroupSnapshotsTest-296266448 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:30:18 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-a9d37964-00c7-4fe2-bca9-1badf018be90 tempest-GroupSnapshotsTest-296266448 None] Delete group completed successfully.
Jul 30 20:30:18 devstack sudo[98728]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:18 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-edf649e5-60b7-4213-be6f-c6dfde4ce22e tempest-VolumesTransfersV355Test-751772463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.355s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:18 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-edf649e5-60b7-4213-be6f-c6dfde4ce22e tempest-VolumesTransfersV355Test-751772463 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:30:18 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-edf649e5-60b7-4213-be6f-c6dfde4ce22e tempest-VolumesTransfersV355Test-751772463 None] Deleted volume successfully.
Jul 30 20:30:18 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-edf649e5-60b7-4213-be6f-c6dfde4ce22e tempest-VolumesTransfersV355Test-751772463 None] Lock "cinder-ac03ba54-2134-4a4d-a536-f45471095a34-delete_volume" released by "delete_volume" :: held 1.678s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:30:18 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-9cb27486-9c2c-4a56-9dce-3ac6a4168cf5 tempest-GroupSnapshotsTest-296266448 None] Group tempest-GroupSnapshotsTest-Group-57862151: creating
Jul 30 20:30:18 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-9cb27486-9c2c-4a56-9dce-3ac6a4168cf5 tempest-GroupSnapshotsTest-296266448 None] Group tempest-GroupSnapshotsTest-Group-57862151: created successfully
Jul 30 20:30:18 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-9cb27486-9c2c-4a56-9dce-3ac6a4168cf5 tempest-GroupSnapshotsTest-296266448 None] Create group completed successfully.
Jul 30 20:30:19 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-853478e4-7d80-498f-995e-114735bd280e tempest-VolumesTransfersV355Test-1436137063 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:30:19 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-853478e4-7d80-498f-995e-114735bd280e tempest-VolumesTransfersV355Test-1436137063 None] Flow 'volume_create_manager' (181b2a91-6344-450e-954e-63317b336c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:30:19 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-853478e4-7d80-498f-995e-114735bd280e tempest-VolumesTransfersV355Test-1436137063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6ba3256-fade-42fa-a96b-ef9a506dacca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:30:19 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-853478e4-7d80-498f-995e-114735bd280e tempest-VolumesTransfersV355Test-1436137063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6ba3256-fade-42fa-a96b-ef9a506dacca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:30:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-531080649',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc06cdd8-3d59-40e3-84d6-6dbb68f7f5cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf2dd81621f5417196b64294ffc7f780',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:30:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:30:20Z,use_quota=True,user_id='620b76d142604a8ebcf40f0c81725c49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:30:19 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-853478e4-7d80-498f-995e-114735bd280e tempest-VolumesTransfersV355Test-1436137063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (948c0ac4-5d24-4199-b002-355d3c7b89df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:30:19 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-853478e4-7d80-498f-995e-114735bd280e tempest-VolumesTransfersV355Test-1436137063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (948c0ac4-5d24-4199-b002-355d3c7b89df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:30:19 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-853478e4-7d80-498f-995e-114735bd280e tempest-VolumesTransfersV355Test-1436137063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4936ed37-7bdc-4d60-9689-bc97840ba517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:30:19 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-853478e4-7d80-498f-995e-114735bd280e tempest-VolumesTransfersV355Test-1436137063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4936ed37-7bdc-4d60-9689-bc97840ba517) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc06cdd8-3d59-40e3-84d6-6dbb68f7f5cc', 'volume_name': 'volume-dc06cdd8-3d59-40e3-84d6-6dbb68f7f5cc', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:30:19 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-853478e4-7d80-498f-995e-114735bd280e tempest-VolumesTransfersV355Test-1436137063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78a511b4-ea94-47b3-8d80-cac52825f47d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:30:19 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-853478e4-7d80-498f-995e-114735bd280e tempest-VolumesTransfersV355Test-1436137063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78a511b4-ea94-47b3-8d80-cac52825f47d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:30:19 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-853478e4-7d80-498f-995e-114735bd280e tempest-VolumesTransfersV355Test-1436137063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cf760e1-cdbb-4ea5-9940-2d9753da732b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:30:19 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-853478e4-7d80-498f-995e-114735bd280e tempest-VolumesTransfersV355Test-1436137063 None] Volume dc06cdd8-3d59-40e3-84d6-6dbb68f7f5cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc06cdd8-3d59-40e3-84d6-6dbb68f7f5cc', 'volume_size': 1}
Jul 30 20:30:19 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-853478e4-7d80-498f-995e-114735bd280e tempest-VolumesTransfersV355Test-1436137063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:30:19 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-853478e4-7d80-498f-995e-114735bd280e tempest-VolumesTransfersV355Test-1436137063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:30:19 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-853478e4-7d80-498f-995e-114735bd280e tempest-VolumesTransfersV355Test-1436137063 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:30:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-531080649',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc06cdd8-3d59-40e3-84d6-6dbb68f7f5cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf2dd81621f5417196b64294ffc7f780',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:30:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:30:20Z,use_quota=True,user_id='620b76d142604a8ebcf40f0c81725c49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:30:19 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-853478e4-7d80-498f-995e-114735bd280e tempest-VolumesTransfersV355Test-1436137063 None] Creating volume dc06cdd8-3d59-40e3-84d6-6dbb68f7f5cc {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:30:19 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-853478e4-7d80-498f-995e-114735bd280e tempest-VolumesTransfersV355Test-1436137063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:30:19 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-853478e4-7d80-498f-995e-114735bd280e tempest-VolumesTransfersV355Test-1436137063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:30:19 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-853478e4-7d80-498f-995e-114735bd280e tempest-VolumesTransfersV355Test-1436137063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:30:19 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-853478e4-7d80-498f-995e-114735bd280e tempest-VolumesTransfersV355Test-1436137063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:30:19 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-853478e4-7d80-498f-995e-114735bd280e tempest-VolumesTransfersV355Test-1436137063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:30:19 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-853478e4-7d80-498f-995e-114735bd280e tempest-VolumesTransfersV355Test-1436137063 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:30:19 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-853478e4-7d80-498f-995e-114735bd280e tempest-VolumesTransfersV355Test-1436137063 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:30:19 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-853478e4-7d80-498f-995e-114735bd280e tempest-VolumesTransfersV355Test-1436137063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-dc06cdd8-3d59-40e3-84d6-6dbb68f7f5cc 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:19 devstack sudo[98732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-dc06cdd8-3d59-40e3-84d6-6dbb68f7f5cc 1073741824
Jul 30 20:30:20 devstack sudo[98732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:20 devstack sudo[98732]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:20 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-853478e4-7d80-498f-995e-114735bd280e tempest-VolumesTransfersV355Test-1436137063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-dc06cdd8-3d59-40e3-84d6-6dbb68f7f5cc 1073741824" returned: 0 in 0.626s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:20 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-853478e4-7d80-498f-995e-114735bd280e tempest-VolumesTransfersV355Test-1436137063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-dc06cdd8-3d59-40e3-84d6-6dbb68f7f5cc {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:20 devstack sudo[98739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-dc06cdd8-3d59-40e3-84d6-6dbb68f7f5cc
Jul 30 20:30:20 devstack sudo[98739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:20 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-88bad8fd-4783-4bd0-95c0-2ddaae7b5999 tempest-VolumesDeleteCascade-438274212 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:30:20 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-88bad8fd-4783-4bd0-95c0-2ddaae7b5999 tempest-VolumesDeleteCascade-438274212 None] Flow 'volume_create_manager' (58138ae2-5919-4940-8ff6-52816b92c5d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:30:20 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-88bad8fd-4783-4bd0-95c0-2ddaae7b5999 tempest-VolumesDeleteCascade-438274212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35d07979-7707-41c9-b53f-eeb2e0c52ef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:30:20 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-97f13edc-d28d-4b1e-8017-ea682040b391 tempest-GroupSnapshotsTest-296266448 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:30:20 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-97f13edc-d28d-4b1e-8017-ea682040b391 tempest-GroupSnapshotsTest-296266448 None] Flow 'volume_create_manager' (033ac622-5494-4066-b588-d3ddebb83716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:30:20 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-97f13edc-d28d-4b1e-8017-ea682040b391 tempest-GroupSnapshotsTest-296266448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f369948-e342-4a6b-b2d0-2aae3b080f70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:30:20 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-97f13edc-d28d-4b1e-8017-ea682040b391 tempest-GroupSnapshotsTest-296266448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f369948-e342-4a6b-b2d0-2aae3b080f70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:30:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1451917657',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=7a183bf6-b36e-44d9-8a45-2609e00793d2,host='devstack@QuobyteHD#QuobyteHD',id=0b103f9e-78b8-40aa-adee-57742d868c4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9a30efeb6fe428bbf6b21c25f0e9ae2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:30:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:30:21Z,use_quota=True,user_id='b7501c2b5cc547a8b7d91d86c5d9f3ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8feee10-48ae-4999-ae08-875de409a59f),volume_type_id=a8feee10-48ae-4999-ae08-875de409a59f)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:30:20 devstack sudo[98739]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:20 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-97f13edc-d28d-4b1e-8017-ea682040b391 tempest-GroupSnapshotsTest-296266448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c1c7750-b26e-481f-96dd-008c7185eb89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:30:20 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-97f13edc-d28d-4b1e-8017-ea682040b391 tempest-GroupSnapshotsTest-296266448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c1c7750-b26e-481f-96dd-008c7185eb89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:30:20 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-97f13edc-d28d-4b1e-8017-ea682040b391 tempest-GroupSnapshotsTest-296266448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ed10ca3-73c7-41e7-8df2-ec2bdfb30c78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:30:20 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-97f13edc-d28d-4b1e-8017-ea682040b391 tempest-GroupSnapshotsTest-296266448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ed10ca3-73c7-41e7-8df2-ec2bdfb30c78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b103f9e-78b8-40aa-adee-57742d868c4e', 'volume_name': 'volume-0b103f9e-78b8-40aa-adee-57742d868c4e', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:30:20 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-97f13edc-d28d-4b1e-8017-ea682040b391 tempest-GroupSnapshotsTest-296266448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61e3b395-62a5-45ff-a554-1a94cd4daeee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:30:20 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-97f13edc-d28d-4b1e-8017-ea682040b391 tempest-GroupSnapshotsTest-296266448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61e3b395-62a5-45ff-a554-1a94cd4daeee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:30:20 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-97f13edc-d28d-4b1e-8017-ea682040b391 tempest-GroupSnapshotsTest-296266448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d799eb14-0efd-400c-a22d-e63aa91885ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:30:20 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-97f13edc-d28d-4b1e-8017-ea682040b391 tempest-GroupSnapshotsTest-296266448 None] Volume 0b103f9e-78b8-40aa-adee-57742d868c4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b103f9e-78b8-40aa-adee-57742d868c4e', 'volume_size': 1}
Jul 30 20:30:20 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-97f13edc-d28d-4b1e-8017-ea682040b391 tempest-GroupSnapshotsTest-296266448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:30:20 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-88bad8fd-4783-4bd0-95c0-2ddaae7b5999 tempest-VolumesDeleteCascade-438274212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35d07979-7707-41c9-b53f-eeb2e0c52ef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:30:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-767934923',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5114076-2d30-417c-b0e6-98dc4caceb53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec939d2f3e854a7d8479d12e4c5984ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:30:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:30:21Z,use_quota=True,user_id='6336fb776b644caeac64c0cf9b4da35a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:30:20 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-88bad8fd-4783-4bd0-95c0-2ddaae7b5999 tempest-VolumesDeleteCascade-438274212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b42c16e-40dd-42d1-bc7c-0aa3913059f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:30:21 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-88bad8fd-4783-4bd0-95c0-2ddaae7b5999 tempest-VolumesDeleteCascade-438274212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b42c16e-40dd-42d1-bc7c-0aa3913059f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:30:21 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-88bad8fd-4783-4bd0-95c0-2ddaae7b5999 tempest-VolumesDeleteCascade-438274212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae37d4c4-018e-46a6-ace2-3b367956e9e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:30:21 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-88bad8fd-4783-4bd0-95c0-2ddaae7b5999 tempest-VolumesDeleteCascade-438274212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae37d4c4-018e-46a6-ace2-3b367956e9e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5114076-2d30-417c-b0e6-98dc4caceb53', 'volume_name': 'volume-b5114076-2d30-417c-b0e6-98dc4caceb53', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:30:21 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-88bad8fd-4783-4bd0-95c0-2ddaae7b5999 tempest-VolumesDeleteCascade-438274212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6613dfe2-a47f-4e35-943a-633c87e390b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:30:21 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-88bad8fd-4783-4bd0-95c0-2ddaae7b5999 tempest-VolumesDeleteCascade-438274212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6613dfe2-a47f-4e35-943a-633c87e390b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:30:21 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-88bad8fd-4783-4bd0-95c0-2ddaae7b5999 tempest-VolumesDeleteCascade-438274212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68e6b57e-000a-421a-8975-8d7e7a56b978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:30:21 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-88bad8fd-4783-4bd0-95c0-2ddaae7b5999 tempest-VolumesDeleteCascade-438274212 None] Volume b5114076-2d30-417c-b0e6-98dc4caceb53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5114076-2d30-417c-b0e6-98dc4caceb53', 'volume_size': 1}
Jul 30 20:30:21 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-88bad8fd-4783-4bd0-95c0-2ddaae7b5999 tempest-VolumesDeleteCascade-438274212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:30:21 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-853478e4-7d80-498f-995e-114735bd280e tempest-VolumesTransfersV355Test-1436137063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-dc06cdd8-3d59-40e3-84d6-6dbb68f7f5cc" returned: 0 in 0.406s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:21 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-853478e4-7d80-498f-995e-114735bd280e tempest-VolumesTransfersV355Test-1436137063 None] <== create_volume: return (1107ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:30:21 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-853478e4-7d80-498f-995e-114735bd280e tempest-VolumesTransfersV355Test-1436137063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.111s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:30:21 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-97f13edc-d28d-4b1e-8017-ea682040b391 tempest-GroupSnapshotsTest-296266448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.054s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:30:21 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-97f13edc-d28d-4b1e-8017-ea682040b391 tempest-GroupSnapshotsTest-296266448 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=7a183bf6-b36e-44d9-8a45-2609e00793d2,created_at=2026-07-30T18:30:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1451917657',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=7a183bf6-b36e-44d9-8a45-2609e00793d2,host='devstack@QuobyteHD#QuobyteHD',id=0b103f9e-78b8-40aa-adee-57742d868c4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9a30efeb6fe428bbf6b21c25f0e9ae2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:30:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:30:21Z,use_quota=True,user_id='b7501c2b5cc547a8b7d91d86c5d9f3ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8feee10-48ae-4999-ae08-875de409a59f),volume_type_id=a8feee10-48ae-4999-ae08-875de409a59f)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:30:21 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-97f13edc-d28d-4b1e-8017-ea682040b391 tempest-GroupSnapshotsTest-296266448 None] Creating volume 0b103f9e-78b8-40aa-adee-57742d868c4e {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:30:21 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-97f13edc-d28d-4b1e-8017-ea682040b391 tempest-GroupSnapshotsTest-296266448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:30:21 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-97f13edc-d28d-4b1e-8017-ea682040b391 tempest-GroupSnapshotsTest-296266448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:30:21 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-97f13edc-d28d-4b1e-8017-ea682040b391 tempest-GroupSnapshotsTest-296266448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:30:21 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-97f13edc-d28d-4b1e-8017-ea682040b391 tempest-GroupSnapshotsTest-296266448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:30:21 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-97f13edc-d28d-4b1e-8017-ea682040b391 tempest-GroupSnapshotsTest-296266448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:30:21 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-97f13edc-d28d-4b1e-8017-ea682040b391 tempest-GroupSnapshotsTest-296266448 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:30:21 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-97f13edc-d28d-4b1e-8017-ea682040b391 tempest-GroupSnapshotsTest-296266448 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:30:21 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-97f13edc-d28d-4b1e-8017-ea682040b391 tempest-GroupSnapshotsTest-296266448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0b103f9e-78b8-40aa-adee-57742d868c4e 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:21 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-853478e4-7d80-498f-995e-114735bd280e tempest-VolumesTransfersV355Test-1436137063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cf760e1-cdbb-4ea5-9940-2d9753da732b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc06cdd8-3d59-40e3-84d6-6dbb68f7f5cc', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:30:21 devstack sudo[98743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0b103f9e-78b8-40aa-adee-57742d868c4e 1073741824
Jul 30 20:30:21 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-853478e4-7d80-498f-995e-114735bd280e tempest-VolumesTransfersV355Test-1436137063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f53e77a5-1aef-481d-af7b-70582a03c9c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:30:21 devstack sudo[98743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:21 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-853478e4-7d80-498f-995e-114735bd280e tempest-VolumesTransfersV355Test-1436137063 None] Volume volume-dc06cdd8-3d59-40e3-84d6-6dbb68f7f5cc (dc06cdd8-3d59-40e3-84d6-6dbb68f7f5cc): created successfully
Jul 30 20:30:21 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-853478e4-7d80-498f-995e-114735bd280e tempest-VolumesTransfersV355Test-1436137063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f53e77a5-1aef-481d-af7b-70582a03c9c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:30:21 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-853478e4-7d80-498f-995e-114735bd280e tempest-VolumesTransfersV355Test-1436137063 None] Flow 'volume_create_manager' (181b2a91-6344-450e-954e-63317b336c94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:30:21 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-853478e4-7d80-498f-995e-114735bd280e tempest-VolumesTransfersV355Test-1436137063 None] Created volume successfully.
Jul 30 20:30:21 devstack sudo[98743]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:21 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-97f13edc-d28d-4b1e-8017-ea682040b391 tempest-GroupSnapshotsTest-296266448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0b103f9e-78b8-40aa-adee-57742d868c4e 1073741824" returned: 0 in 0.564s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:21 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-97f13edc-d28d-4b1e-8017-ea682040b391 tempest-GroupSnapshotsTest-296266448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0b103f9e-78b8-40aa-adee-57742d868c4e {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:21 devstack sudo[98749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0b103f9e-78b8-40aa-adee-57742d868c4e
Jul 30 20:30:21 devstack sudo[98749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:21 devstack sudo[98749]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:21 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-97f13edc-d28d-4b1e-8017-ea682040b391 tempest-GroupSnapshotsTest-296266448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0b103f9e-78b8-40aa-adee-57742d868c4e" returned: 0 in 0.292s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:21 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-97f13edc-d28d-4b1e-8017-ea682040b391 tempest-GroupSnapshotsTest-296266448 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:30:21 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-97f13edc-d28d-4b1e-8017-ea682040b391 tempest-GroupSnapshotsTest-296266448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:30:21 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-88bad8fd-4783-4bd0-95c0-2ddaae7b5999 tempest-VolumesDeleteCascade-438274212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.914s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:30:21 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-88bad8fd-4783-4bd0-95c0-2ddaae7b5999 tempest-VolumesDeleteCascade-438274212 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:30:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-767934923',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5114076-2d30-417c-b0e6-98dc4caceb53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec939d2f3e854a7d8479d12e4c5984ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:30:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:30:21Z,use_quota=True,user_id='6336fb776b644caeac64c0cf9b4da35a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:30:21 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-88bad8fd-4783-4bd0-95c0-2ddaae7b5999 tempest-VolumesDeleteCascade-438274212 None] Creating volume b5114076-2d30-417c-b0e6-98dc4caceb53 {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:30:21 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-88bad8fd-4783-4bd0-95c0-2ddaae7b5999 tempest-VolumesDeleteCascade-438274212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:30:21 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-88bad8fd-4783-4bd0-95c0-2ddaae7b5999 tempest-VolumesDeleteCascade-438274212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:30:21 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-88bad8fd-4783-4bd0-95c0-2ddaae7b5999 tempest-VolumesDeleteCascade-438274212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:30:21 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-88bad8fd-4783-4bd0-95c0-2ddaae7b5999 tempest-VolumesDeleteCascade-438274212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:30:21 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-88bad8fd-4783-4bd0-95c0-2ddaae7b5999 tempest-VolumesDeleteCascade-438274212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:30:21 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-88bad8fd-4783-4bd0-95c0-2ddaae7b5999 tempest-VolumesDeleteCascade-438274212 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:30:21 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-88bad8fd-4783-4bd0-95c0-2ddaae7b5999 tempest-VolumesDeleteCascade-438274212 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:30:21 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-88bad8fd-4783-4bd0-95c0-2ddaae7b5999 tempest-VolumesDeleteCascade-438274212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b5114076-2d30-417c-b0e6-98dc4caceb53 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:22 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-97f13edc-d28d-4b1e-8017-ea682040b391 tempest-GroupSnapshotsTest-296266448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d799eb14-0efd-400c-a22d-e63aa91885ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b103f9e-78b8-40aa-adee-57742d868c4e', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:30:22 devstack sudo[98752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b5114076-2d30-417c-b0e6-98dc4caceb53 1073741824
Jul 30 20:30:22 devstack sudo[98752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:22 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-97f13edc-d28d-4b1e-8017-ea682040b391 tempest-GroupSnapshotsTest-296266448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38eca4e1-da2e-4012-b95b-42f220440f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:30:22 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-97f13edc-d28d-4b1e-8017-ea682040b391 tempest-GroupSnapshotsTest-296266448 None] Volume volume-0b103f9e-78b8-40aa-adee-57742d868c4e (0b103f9e-78b8-40aa-adee-57742d868c4e): created successfully
Jul 30 20:30:22 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-97f13edc-d28d-4b1e-8017-ea682040b391 tempest-GroupSnapshotsTest-296266448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38eca4e1-da2e-4012-b95b-42f220440f66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:30:22 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-97f13edc-d28d-4b1e-8017-ea682040b391 tempest-GroupSnapshotsTest-296266448 None] Flow 'volume_create_manager' (033ac622-5494-4066-b588-d3ddebb83716) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:30:22 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-97f13edc-d28d-4b1e-8017-ea682040b391 tempest-GroupSnapshotsTest-296266448 None] Created volume successfully.
Jul 30 20:30:22 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-76dbed86-47e6-4cca-bf34-df590865caeb tempest-VolumesTransfersV355Test-751772463 None] Acquiring lock "cinder-dc06cdd8-3d59-40e3-84d6-6dbb68f7f5cc-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:30:22 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-76dbed86-47e6-4cca-bf34-df590865caeb tempest-VolumesTransfersV355Test-751772463 None] Lock "cinder-dc06cdd8-3d59-40e3-84d6-6dbb68f7f5cc-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:30:22 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-76dbed86-47e6-4cca-bf34-df590865caeb tempest-VolumesTransfersV355Test-751772463 None] Acquiring lock "cinder-quobyte-dc06cdd8-3d59-40e3-84d6-6dbb68f7f5cc" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:30:22 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-76dbed86-47e6-4cca-bf34-df590865caeb tempest-VolumesTransfersV355Test-751772463 None] Lock "cinder-quobyte-dc06cdd8-3d59-40e3-84d6-6dbb68f7f5cc" acquired by "delete_volume" :: waited 0.026s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:30:22 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a26049f-97d7-4687-81f8-a96f084ddc64]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:30:22 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-76dbed86-47e6-4cca-bf34-df590865caeb tempest-VolumesTransfersV355Test-751772463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-dc06cdd8-3d59-40e3-84d6-6dbb68f7f5cc {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:22 devstack sudo[98757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-dc06cdd8-3d59-40e3-84d6-6dbb68f7f5cc
Jul 30 20:30:22 devstack sudo[98757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:22 devstack sudo[98752]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:22 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-88bad8fd-4783-4bd0-95c0-2ddaae7b5999 tempest-VolumesDeleteCascade-438274212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b5114076-2d30-417c-b0e6-98dc4caceb53 1073741824" returned: 0 in 0.632s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:22 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-88bad8fd-4783-4bd0-95c0-2ddaae7b5999 tempest-VolumesDeleteCascade-438274212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b5114076-2d30-417c-b0e6-98dc4caceb53 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:22 devstack sudo[98760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b5114076-2d30-417c-b0e6-98dc4caceb53
Jul 30 20:30:22 devstack sudo[98760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:22 devstack sudo[98757]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:22 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-76dbed86-47e6-4cca-bf34-df590865caeb tempest-VolumesTransfersV355Test-751772463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-dc06cdd8-3d59-40e3-84d6-6dbb68f7f5cc" returned: 0 in 0.557s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:22 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-76dbed86-47e6-4cca-bf34-df590865caeb tempest-VolumesTransfersV355Test-751772463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-dc06cdd8-3d59-40e3-84d6-6dbb68f7f5cc {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:22 devstack sudo[98760]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:22 devstack sudo[98767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-dc06cdd8-3d59-40e3-84d6-6dbb68f7f5cc
Jul 30 20:30:22 devstack sudo[98767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:22 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-88bad8fd-4783-4bd0-95c0-2ddaae7b5999 tempest-VolumesDeleteCascade-438274212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b5114076-2d30-417c-b0e6-98dc4caceb53" returned: 0 in 0.347s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:22 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-88bad8fd-4783-4bd0-95c0-2ddaae7b5999 tempest-VolumesDeleteCascade-438274212 None] <== create_volume: return (1036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:30:22 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-88bad8fd-4783-4bd0-95c0-2ddaae7b5999 tempest-VolumesDeleteCascade-438274212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.038s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:30:23 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-88bad8fd-4783-4bd0-95c0-2ddaae7b5999 tempest-VolumesDeleteCascade-438274212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68e6b57e-000a-421a-8975-8d7e7a56b978) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5114076-2d30-417c-b0e6-98dc4caceb53', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:30:23 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-88bad8fd-4783-4bd0-95c0-2ddaae7b5999 tempest-VolumesDeleteCascade-438274212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8ae4d04-5375-4eb4-beb2-b116d4a1305b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:30:23 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-88bad8fd-4783-4bd0-95c0-2ddaae7b5999 tempest-VolumesDeleteCascade-438274212 None] Volume volume-b5114076-2d30-417c-b0e6-98dc4caceb53 (b5114076-2d30-417c-b0e6-98dc4caceb53): created successfully
Jul 30 20:30:23 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-88bad8fd-4783-4bd0-95c0-2ddaae7b5999 tempest-VolumesDeleteCascade-438274212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8ae4d04-5375-4eb4-beb2-b116d4a1305b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:30:23 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-88bad8fd-4783-4bd0-95c0-2ddaae7b5999 tempest-VolumesDeleteCascade-438274212 None] Flow 'volume_create_manager' (58138ae2-5919-4940-8ff6-52816b92c5d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:30:23 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-88bad8fd-4783-4bd0-95c0-2ddaae7b5999 tempest-VolumesDeleteCascade-438274212 None] Created volume successfully.
Jul 30 20:30:23 devstack sudo[98767]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:23 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-76dbed86-47e6-4cca-bf34-df590865caeb tempest-VolumesTransfersV355Test-751772463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-dc06cdd8-3d59-40e3-84d6-6dbb68f7f5cc" returned: 0 in 0.271s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:23 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-76dbed86-47e6-4cca-bf34-df590865caeb tempest-VolumesTransfersV355Test-751772463 None] Lock "cinder-quobyte-dc06cdd8-3d59-40e3-84d6-6dbb68f7f5cc" released by "delete_volume" :: held 0.879s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:30:23 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-76dbed86-47e6-4cca-bf34-df590865caeb tempest-VolumesTransfersV355Test-751772463 None] Created reservations ['b142c662-c88f-4abf-9cb1-19b8ae1fd79b', 'c8678a1c-0b48-43b2-aa58-d41b7ef72e4b', '0256415f-1fdd-42a0-b19f-1e8376cd3e76', 'f476ade9-04b1-4223-b413-275b8a6e2173'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:30:23 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-76dbed86-47e6-4cca-bf34-df590865caeb tempest-VolumesTransfersV355Test-751772463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:30:23 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-76dbed86-47e6-4cca-bf34-df590865caeb tempest-VolumesTransfersV355Test-751772463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:30:23 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-76dbed86-47e6-4cca-bf34-df590865caeb tempest-VolumesTransfersV355Test-751772463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:30:23 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-76dbed86-47e6-4cca-bf34-df590865caeb tempest-VolumesTransfersV355Test-751772463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:30:23 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-76dbed86-47e6-4cca-bf34-df590865caeb tempest-VolumesTransfersV355Test-751772463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:30:23 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-76dbed86-47e6-4cca-bf34-df590865caeb tempest-VolumesTransfersV355Test-751772463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:23 devstack sudo[98770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:30:23 devstack sudo[98770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:23 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc809b52-bdcd-4a76-9691-17f1647310ad tempest-GroupSnapshotsTest-296266448 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:30:23 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-fc809b52-bdcd-4a76-9691-17f1647310ad tempest-GroupSnapshotsTest-296266448 None] Flow 'volume_create_manager' (0956cb02-bc3d-4309-95ea-37666ae51ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:30:23 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-fc809b52-bdcd-4a76-9691-17f1647310ad tempest-GroupSnapshotsTest-296266448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf80a784-c9ad-434a-acd5-38fc4efab53a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:30:23 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-fc809b52-bdcd-4a76-9691-17f1647310ad tempest-GroupSnapshotsTest-296266448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf80a784-c9ad-434a-acd5-38fc4efab53a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:30:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1275183121',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=7a183bf6-b36e-44d9-8a45-2609e00793d2,host='devstack@QuobyteHD#QuobyteHD',id=443ae94e-9a94-4ee8-883b-c4b0216646e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9a30efeb6fe428bbf6b21c25f0e9ae2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:30:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:30:24Z,use_quota=True,user_id='b7501c2b5cc547a8b7d91d86c5d9f3ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8feee10-48ae-4999-ae08-875de409a59f),volume_type_id=a8feee10-48ae-4999-ae08-875de409a59f)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:30:23 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-fc809b52-bdcd-4a76-9691-17f1647310ad tempest-GroupSnapshotsTest-296266448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42b8f5f3-accb-4d25-a1d9-4b192340666a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:30:23 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-fc809b52-bdcd-4a76-9691-17f1647310ad tempest-GroupSnapshotsTest-296266448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42b8f5f3-accb-4d25-a1d9-4b192340666a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:30:23 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-fc809b52-bdcd-4a76-9691-17f1647310ad tempest-GroupSnapshotsTest-296266448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11b8f4dc-c1c7-4fe6-b8f3-df06c795d076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:30:23 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-fc809b52-bdcd-4a76-9691-17f1647310ad tempest-GroupSnapshotsTest-296266448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11b8f4dc-c1c7-4fe6-b8f3-df06c795d076) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '443ae94e-9a94-4ee8-883b-c4b0216646e5', 'volume_name': 'volume-443ae94e-9a94-4ee8-883b-c4b0216646e5', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:30:23 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-fc809b52-bdcd-4a76-9691-17f1647310ad tempest-GroupSnapshotsTest-296266448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (313b57da-83b9-4c10-b28a-2be5adad7315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:30:23 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-fc809b52-bdcd-4a76-9691-17f1647310ad tempest-GroupSnapshotsTest-296266448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (313b57da-83b9-4c10-b28a-2be5adad7315) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:30:23 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-fc809b52-bdcd-4a76-9691-17f1647310ad tempest-GroupSnapshotsTest-296266448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9df99d98-af12-4c97-88a1-206c24431eb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:30:23 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-fc809b52-bdcd-4a76-9691-17f1647310ad tempest-GroupSnapshotsTest-296266448 None] Volume 443ae94e-9a94-4ee8-883b-c4b0216646e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-443ae94e-9a94-4ee8-883b-c4b0216646e5', 'volume_size': 1}
Jul 30 20:30:23 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-fc809b52-bdcd-4a76-9691-17f1647310ad tempest-GroupSnapshotsTest-296266448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:30:23 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-fc809b52-bdcd-4a76-9691-17f1647310ad tempest-GroupSnapshotsTest-296266448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:30:23 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-fc809b52-bdcd-4a76-9691-17f1647310ad tempest-GroupSnapshotsTest-296266448 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=7a183bf6-b36e-44d9-8a45-2609e00793d2,created_at=2026-07-30T18:30:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1275183121',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=7a183bf6-b36e-44d9-8a45-2609e00793d2,host='devstack@QuobyteHD#QuobyteHD',id=443ae94e-9a94-4ee8-883b-c4b0216646e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9a30efeb6fe428bbf6b21c25f0e9ae2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:30:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:30:24Z,use_quota=True,user_id='b7501c2b5cc547a8b7d91d86c5d9f3ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8feee10-48ae-4999-ae08-875de409a59f),volume_type_id=a8feee10-48ae-4999-ae08-875de409a59f)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:30:23 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-fc809b52-bdcd-4a76-9691-17f1647310ad tempest-GroupSnapshotsTest-296266448 None] Creating volume 443ae94e-9a94-4ee8-883b-c4b0216646e5 {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:30:23 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-fc809b52-bdcd-4a76-9691-17f1647310ad tempest-GroupSnapshotsTest-296266448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:30:23 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-fc809b52-bdcd-4a76-9691-17f1647310ad tempest-GroupSnapshotsTest-296266448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:30:23 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-fc809b52-bdcd-4a76-9691-17f1647310ad tempest-GroupSnapshotsTest-296266448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:30:23 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-fc809b52-bdcd-4a76-9691-17f1647310ad tempest-GroupSnapshotsTest-296266448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:30:23 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-fc809b52-bdcd-4a76-9691-17f1647310ad tempest-GroupSnapshotsTest-296266448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:30:23 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-fc809b52-bdcd-4a76-9691-17f1647310ad tempest-GroupSnapshotsTest-296266448 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:30:23 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-fc809b52-bdcd-4a76-9691-17f1647310ad tempest-GroupSnapshotsTest-296266448 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:30:23 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-fc809b52-bdcd-4a76-9691-17f1647310ad tempest-GroupSnapshotsTest-296266448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-443ae94e-9a94-4ee8-883b-c4b0216646e5 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:23 devstack sudo[98770]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:23 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-76dbed86-47e6-4cca-bf34-df590865caeb tempest-VolumesTransfersV355Test-751772463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.532s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:23 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-76dbed86-47e6-4cca-bf34-df590865caeb tempest-VolumesTransfersV355Test-751772463 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:30:23 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-76dbed86-47e6-4cca-bf34-df590865caeb tempest-VolumesTransfersV355Test-751772463 None] Deleted volume successfully.
Jul 30 20:30:23 devstack sudo[98773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-443ae94e-9a94-4ee8-883b-c4b0216646e5 1073741824
Jul 30 20:30:23 devstack sudo[98773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:24 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-76dbed86-47e6-4cca-bf34-df590865caeb tempest-VolumesTransfersV355Test-751772463 None] Lock "cinder-dc06cdd8-3d59-40e3-84d6-6dbb68f7f5cc-delete_volume" released by "delete_volume" :: held 1.737s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:30:24 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-083acb69-22f7-4a23-aed5-baae9f88f762 tempest-VolumesDeleteCascade-438274212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:30:24 devstack sudo[98773]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:24 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-fc809b52-bdcd-4a76-9691-17f1647310ad tempest-GroupSnapshotsTest-296266448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-443ae94e-9a94-4ee8-883b-c4b0216646e5 1073741824" returned: 0 in 0.596s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:24 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-fc809b52-bdcd-4a76-9691-17f1647310ad tempest-GroupSnapshotsTest-296266448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-443ae94e-9a94-4ee8-883b-c4b0216646e5 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:24 devstack sudo[98780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-443ae94e-9a94-4ee8-883b-c4b0216646e5
Jul 30 20:30:24 devstack sudo[98780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:24 devstack sudo[98780]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:24 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-fc809b52-bdcd-4a76-9691-17f1647310ad tempest-GroupSnapshotsTest-296266448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-443ae94e-9a94-4ee8-883b-c4b0216646e5" returned: 0 in 0.301s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:24 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-fc809b52-bdcd-4a76-9691-17f1647310ad tempest-GroupSnapshotsTest-296266448 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:30:24 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-fc809b52-bdcd-4a76-9691-17f1647310ad tempest-GroupSnapshotsTest-296266448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.954s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:30:24 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-083acb69-22f7-4a23-aed5-baae9f88f762 tempest-VolumesDeleteCascade-438274212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.806s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:30:24 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-fc809b52-bdcd-4a76-9691-17f1647310ad tempest-GroupSnapshotsTest-296266448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9df99d98-af12-4c97-88a1-206c24431eb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-443ae94e-9a94-4ee8-883b-c4b0216646e5', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:30:24 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-fc809b52-bdcd-4a76-9691-17f1647310ad tempest-GroupSnapshotsTest-296266448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ef5be7f-201a-448d-8081-241c73dc0cbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:30:24 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-083acb69-22f7-4a23-aed5-baae9f88f762 tempest-VolumesDeleteCascade-438274212 None] Creating offline snapshot 86cdaa74-7209-4b56-bc8d-5a9f97d978d1 of volume b5114076-2d30-417c-b0e6-98dc4caceb53 {{(pid=88719) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 30 20:30:24 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5755e4c-2ea3-448e-b11a-b07ea81c4ce0]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:30:24 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-083acb69-22f7-4a23-aed5-baae9f88f762 tempest-VolumesDeleteCascade-438274212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b5114076-2d30-417c-b0e6-98dc4caceb53 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:24 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-fc809b52-bdcd-4a76-9691-17f1647310ad tempest-GroupSnapshotsTest-296266448 None] Volume volume-443ae94e-9a94-4ee8-883b-c4b0216646e5 (443ae94e-9a94-4ee8-883b-c4b0216646e5): created successfully
Jul 30 20:30:24 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-fc809b52-bdcd-4a76-9691-17f1647310ad tempest-GroupSnapshotsTest-296266448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ef5be7f-201a-448d-8081-241c73dc0cbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:30:24 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-fc809b52-bdcd-4a76-9691-17f1647310ad tempest-GroupSnapshotsTest-296266448 None] Flow 'volume_create_manager' (0956cb02-bc3d-4309-95ea-37666ae51ab0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:30:24 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-3156f944-7d81-4216-a0e2-904971dc190c tempest-VolumesActionsTest-1221656799 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:30:24 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-3156f944-7d81-4216-a0e2-904971dc190c tempest-VolumesActionsTest-1221656799 None] Flow 'volume_create_manager' (ff427ee7-b13d-4494-b6d3-3bd907caab8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:30:25 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-3156f944-7d81-4216-a0e2-904971dc190c tempest-VolumesActionsTest-1221656799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (472f899e-5df3-40c3-9325-0c4df557e88f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:30:25 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-fc809b52-bdcd-4a76-9691-17f1647310ad tempest-GroupSnapshotsTest-296266448 None] Created volume successfully.
Jul 30 20:30:25 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-3156f944-7d81-4216-a0e2-904971dc190c tempest-VolumesActionsTest-1221656799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (472f899e-5df3-40c3-9325-0c4df557e88f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:30:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1191431714',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2246a04e-ffb2-4da5-80e1-68fdc8d88bc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d549173757fb4ae6a997f839ba9a228f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:30:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:30:25Z,use_quota=True,user_id='8f0215a916da4440990d607d27e60bec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:30:25 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-3156f944-7d81-4216-a0e2-904971dc190c tempest-VolumesActionsTest-1221656799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e01414f6-52af-4d16-8a34-14edde43d2d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:30:25 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-3156f944-7d81-4216-a0e2-904971dc190c tempest-VolumesActionsTest-1221656799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e01414f6-52af-4d16-8a34-14edde43d2d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:30:25 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-3156f944-7d81-4216-a0e2-904971dc190c tempest-VolumesActionsTest-1221656799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18483ce8-c4fe-492d-bccb-47205a272cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:30:25 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-3156f944-7d81-4216-a0e2-904971dc190c tempest-VolumesActionsTest-1221656799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18483ce8-c4fe-492d-bccb-47205a272cbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2246a04e-ffb2-4da5-80e1-68fdc8d88bc4', 'volume_name': 'volume-2246a04e-ffb2-4da5-80e1-68fdc8d88bc4', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:30:25 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-3156f944-7d81-4216-a0e2-904971dc190c tempest-VolumesActionsTest-1221656799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b93e426-1f63-4f69-8a6f-2fdda48b3a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:30:25 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-3156f944-7d81-4216-a0e2-904971dc190c tempest-VolumesActionsTest-1221656799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b93e426-1f63-4f69-8a6f-2fdda48b3a4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:30:25 devstack sudo[98783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b5114076-2d30-417c-b0e6-98dc4caceb53
Jul 30 20:30:25 devstack sudo[98783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:25 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-3156f944-7d81-4216-a0e2-904971dc190c tempest-VolumesActionsTest-1221656799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e456df7-8e44-4aef-adee-eed3de948d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:30:25 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-3156f944-7d81-4216-a0e2-904971dc190c tempest-VolumesActionsTest-1221656799 None] Volume 2246a04e-ffb2-4da5-80e1-68fdc8d88bc4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2246a04e-ffb2-4da5-80e1-68fdc8d88bc4', 'volume_size': 1}
Jul 30 20:30:25 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-3156f944-7d81-4216-a0e2-904971dc190c tempest-VolumesActionsTest-1221656799 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:30:25 devstack sudo[98783]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:25 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-083acb69-22f7-4a23-aed5-baae9f88f762 tempest-VolumesDeleteCascade-438274212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b5114076-2d30-417c-b0e6-98dc4caceb53" returned: 0 in 0.423s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:25 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-083acb69-22f7-4a23-aed5-baae9f88f762 tempest-VolumesDeleteCascade-438274212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b5114076-2d30-417c-b0e6-98dc4caceb53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b5114076-2d30-417c-b0e6-98dc4caceb53.86cdaa74-7209-4b56-bc8d-5a9f97d978d1 1G {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:25 devstack sudo[98788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b5114076-2d30-417c-b0e6-98dc4caceb53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b5114076-2d30-417c-b0e6-98dc4caceb53.86cdaa74-7209-4b56-bc8d-5a9f97d978d1 1G
Jul 30 20:30:25 devstack sudo[98788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:25 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-78a8f59b-8399-44fc-9f82-57344781e191 tempest-GroupSnapshotsTest-296266448 None] Update group completed successfully.
Jul 30 20:30:25 devstack sudo[98788]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:25 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-083acb69-22f7-4a23-aed5-baae9f88f762 tempest-VolumesDeleteCascade-438274212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b5114076-2d30-417c-b0e6-98dc4caceb53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b5114076-2d30-417c-b0e6-98dc4caceb53.86cdaa74-7209-4b56-bc8d-5a9f97d978d1 1G" returned: 0 in 0.410s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:25 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-083acb69-22f7-4a23-aed5-baae9f88f762 tempest-VolumesDeleteCascade-438274212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5114076-2d30-417c-b0e6-98dc4caceb53 -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b5114076-2d30-417c-b0e6-98dc4caceb53.86cdaa74-7209-4b56-bc8d-5a9f97d978d1 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:25 devstack sudo[98794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5114076-2d30-417c-b0e6-98dc4caceb53 -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b5114076-2d30-417c-b0e6-98dc4caceb53.86cdaa74-7209-4b56-bc8d-5a9f97d978d1
Jul 30 20:30:25 devstack sudo[98794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:26 devstack sudo[98794]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:26 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-083acb69-22f7-4a23-aed5-baae9f88f762 tempest-VolumesDeleteCascade-438274212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5114076-2d30-417c-b0e6-98dc4caceb53 -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b5114076-2d30-417c-b0e6-98dc4caceb53.86cdaa74-7209-4b56-bc8d-5a9f97d978d1" returned: 0 in 0.312s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:26 devstack cinder-volume[88719]: WARNING cinder.volume.drivers.remotefs [None req-083acb69-22f7-4a23-aed5-baae9f88f762 tempest-VolumesDeleteCascade-438274212 None] /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b5114076-2d30-417c-b0e6-98dc4caceb53.86cdaa74-7209-4b56-bc8d-5a9f97d978d1 is being set with open permissions: ugo+rw
Jul 30 20:30:26 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-083acb69-22f7-4a23-aed5-baae9f88f762 tempest-VolumesDeleteCascade-438274212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b5114076-2d30-417c-b0e6-98dc4caceb53.86cdaa74-7209-4b56-bc8d-5a9f97d978d1 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:26 devstack sudo[98800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b5114076-2d30-417c-b0e6-98dc4caceb53.86cdaa74-7209-4b56-bc8d-5a9f97d978d1
Jul 30 20:30:26 devstack sudo[98800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:26 devstack sudo[98800]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:26 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-083acb69-22f7-4a23-aed5-baae9f88f762 tempest-VolumesDeleteCascade-438274212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b5114076-2d30-417c-b0e6-98dc4caceb53.86cdaa74-7209-4b56-bc8d-5a9f97d978d1" returned: 0 in 0.293s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:26 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-083acb69-22f7-4a23-aed5-baae9f88f762 tempest-VolumesDeleteCascade-438274212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b5114076-2d30-417c-b0e6-98dc4caceb53.info {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:26 devstack sudo[98803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b5114076-2d30-417c-b0e6-98dc4caceb53.info
Jul 30 20:30:26 devstack sudo[98803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:26 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-25cf0bd5-4c39-40ae-9cc0-71f51d5d2379 tempest-GroupSnapshotsTest-296266448 None] Update group completed successfully.
Jul 30 20:30:26 devstack sudo[98803]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:26 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-083acb69-22f7-4a23-aed5-baae9f88f762 tempest-VolumesDeleteCascade-438274212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b5114076-2d30-417c-b0e6-98dc4caceb53.info" returned: 0 in 0.309s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:26 devstack cinder-volume[88719]: WARNING cinder.volume.drivers.remotefs [None req-083acb69-22f7-4a23-aed5-baae9f88f762 tempest-VolumesDeleteCascade-438274212 None] /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b5114076-2d30-417c-b0e6-98dc4caceb53.info is being set with open permissions: ugo+rw
Jul 30 20:30:26 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-083acb69-22f7-4a23-aed5-baae9f88f762 tempest-VolumesDeleteCascade-438274212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b5114076-2d30-417c-b0e6-98dc4caceb53.info {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:26 devstack sudo[98806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b5114076-2d30-417c-b0e6-98dc4caceb53.info
Jul 30 20:30:26 devstack sudo[98806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:26 devstack sudo[98806]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:27 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-083acb69-22f7-4a23-aed5-baae9f88f762 tempest-VolumesDeleteCascade-438274212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b5114076-2d30-417c-b0e6-98dc4caceb53.info" returned: 0 in 0.272s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:27 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-083acb69-22f7-4a23-aed5-baae9f88f762 tempest-VolumesDeleteCascade-438274212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.161s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:30:27 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-3156f944-7d81-4216-a0e2-904971dc190c tempest-VolumesActionsTest-1221656799 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.963s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:30:27 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-3156f944-7d81-4216-a0e2-904971dc190c tempest-VolumesActionsTest-1221656799 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:30:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1191431714',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2246a04e-ffb2-4da5-80e1-68fdc8d88bc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d549173757fb4ae6a997f839ba9a228f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:30:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:30:25Z,use_quota=True,user_id='8f0215a916da4440990d607d27e60bec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:30:27 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-3156f944-7d81-4216-a0e2-904971dc190c tempest-VolumesActionsTest-1221656799 None] Creating volume 2246a04e-ffb2-4da5-80e1-68fdc8d88bc4 {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:30:27 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-3156f944-7d81-4216-a0e2-904971dc190c tempest-VolumesActionsTest-1221656799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:30:27 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-3156f944-7d81-4216-a0e2-904971dc190c tempest-VolumesActionsTest-1221656799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:30:27 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-3156f944-7d81-4216-a0e2-904971dc190c tempest-VolumesActionsTest-1221656799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:30:27 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-3156f944-7d81-4216-a0e2-904971dc190c tempest-VolumesActionsTest-1221656799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:30:27 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-3156f944-7d81-4216-a0e2-904971dc190c tempest-VolumesActionsTest-1221656799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:30:27 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-3156f944-7d81-4216-a0e2-904971dc190c tempest-VolumesActionsTest-1221656799 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:30:27 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-3156f944-7d81-4216-a0e2-904971dc190c tempest-VolumesActionsTest-1221656799 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:30:27 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3156f944-7d81-4216-a0e2-904971dc190c tempest-VolumesActionsTest-1221656799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2246a04e-ffb2-4da5-80e1-68fdc8d88bc4 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:27 devstack sudo[98809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2246a04e-ffb2-4da5-80e1-68fdc8d88bc4 1073741824
Jul 30 20:30:27 devstack sudo[98809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:27 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-083acb69-22f7-4a23-aed5-baae9f88f762 tempest-VolumesDeleteCascade-438274212 None] Create snapshot completed successfully
Jul 30 20:30:27 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-4c43e7bc-da5f-452e-a3b0-7dfdfa3279e9 tempest-VolumesDeleteCascade-438274212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:30:27 devstack sudo[98809]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:27 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3156f944-7d81-4216-a0e2-904971dc190c tempest-VolumesActionsTest-1221656799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2246a04e-ffb2-4da5-80e1-68fdc8d88bc4 1073741824" returned: 0 in 0.546s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:27 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3156f944-7d81-4216-a0e2-904971dc190c tempest-VolumesActionsTest-1221656799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2246a04e-ffb2-4da5-80e1-68fdc8d88bc4 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:27 devstack sudo[98815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2246a04e-ffb2-4da5-80e1-68fdc8d88bc4
Jul 30 20:30:27 devstack sudo[98815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:27 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-d1b73da1-567f-415b-9f4a-a39f03a68de5 tempest-GroupSnapshotsTest-296266448 None] Update group completed successfully.
Jul 30 20:30:27 devstack sudo[98815]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:27 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3156f944-7d81-4216-a0e2-904971dc190c tempest-VolumesActionsTest-1221656799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2246a04e-ffb2-4da5-80e1-68fdc8d88bc4" returned: 0 in 0.311s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:27 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-3156f944-7d81-4216-a0e2-904971dc190c tempest-VolumesActionsTest-1221656799 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:30:27 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-3156f944-7d81-4216-a0e2-904971dc190c tempest-VolumesActionsTest-1221656799 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:30:27 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-4c43e7bc-da5f-452e-a3b0-7dfdfa3279e9 tempest-VolumesDeleteCascade-438274212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.501s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:30:27 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-3156f944-7d81-4216-a0e2-904971dc190c tempest-VolumesActionsTest-1221656799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e456df7-8e44-4aef-adee-eed3de948d66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2246a04e-ffb2-4da5-80e1-68fdc8d88bc4', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:30:27 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-3156f944-7d81-4216-a0e2-904971dc190c tempest-VolumesActionsTest-1221656799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40ac5523-e492-4375-a6ee-fb46e7911cea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:30:27 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-4c43e7bc-da5f-452e-a3b0-7dfdfa3279e9 tempest-VolumesDeleteCascade-438274212 None] Creating offline snapshot 8b96d5da-9dbb-459d-bfd8-af961da3b35e of volume b5114076-2d30-417c-b0e6-98dc4caceb53 {{(pid=88719) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 30 20:30:28 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-3156f944-7d81-4216-a0e2-904971dc190c tempest-VolumesActionsTest-1221656799 None] Volume volume-2246a04e-ffb2-4da5-80e1-68fdc8d88bc4 (2246a04e-ffb2-4da5-80e1-68fdc8d88bc4): created successfully
Jul 30 20:30:28 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-3156f944-7d81-4216-a0e2-904971dc190c tempest-VolumesActionsTest-1221656799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40ac5523-e492-4375-a6ee-fb46e7911cea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:30:28 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-3156f944-7d81-4216-a0e2-904971dc190c tempest-VolumesActionsTest-1221656799 None] Flow 'volume_create_manager' (ff427ee7-b13d-4494-b6d3-3bd907caab8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:30:28 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[96bb1a80-d853-431b-b4e6-cc4294178bed]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:30:28 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-4c43e7bc-da5f-452e-a3b0-7dfdfa3279e9 tempest-VolumesDeleteCascade-438274212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b5114076-2d30-417c-b0e6-98dc4caceb53.86cdaa74-7209-4b56-bc8d-5a9f97d978d1 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:28 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-3156f944-7d81-4216-a0e2-904971dc190c tempest-VolumesActionsTest-1221656799 None] Created volume successfully.
Jul 30 20:30:28 devstack sudo[98818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b5114076-2d30-417c-b0e6-98dc4caceb53.86cdaa74-7209-4b56-bc8d-5a9f97d978d1
Jul 30 20:30:28 devstack sudo[98818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:28 devstack sudo[98818]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:28 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-4c43e7bc-da5f-452e-a3b0-7dfdfa3279e9 tempest-VolumesDeleteCascade-438274212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b5114076-2d30-417c-b0e6-98dc4caceb53.86cdaa74-7209-4b56-bc8d-5a9f97d978d1" returned: 0 in 0.369s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:28 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-4c43e7bc-da5f-452e-a3b0-7dfdfa3279e9 tempest-VolumesDeleteCascade-438274212 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b5114076-2d30-417c-b0e6-98dc4caceb53(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88719) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 30 20:30:28 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-4c43e7bc-da5f-452e-a3b0-7dfdfa3279e9 tempest-VolumesDeleteCascade-438274212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b5114076-2d30-417c-b0e6-98dc4caceb53.86cdaa74-7209-4b56-bc8d-5a9f97d978d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b5114076-2d30-417c-b0e6-98dc4caceb53.8b96d5da-9dbb-459d-bfd8-af961da3b35e 1G {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:28 devstack sudo[98823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b5114076-2d30-417c-b0e6-98dc4caceb53.86cdaa74-7209-4b56-bc8d-5a9f97d978d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b5114076-2d30-417c-b0e6-98dc4caceb53.8b96d5da-9dbb-459d-bfd8-af961da3b35e 1G
Jul 30 20:30:28 devstack sudo[98823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:28 devstack sudo[98823]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:28 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-4c43e7bc-da5f-452e-a3b0-7dfdfa3279e9 tempest-VolumesDeleteCascade-438274212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b5114076-2d30-417c-b0e6-98dc4caceb53.86cdaa74-7209-4b56-bc8d-5a9f97d978d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b5114076-2d30-417c-b0e6-98dc4caceb53.8b96d5da-9dbb-459d-bfd8-af961da3b35e 1G" returned: 0 in 0.464s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:28 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-4c43e7bc-da5f-452e-a3b0-7dfdfa3279e9 tempest-VolumesDeleteCascade-438274212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5114076-2d30-417c-b0e6-98dc4caceb53.86cdaa74-7209-4b56-bc8d-5a9f97d978d1 -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b5114076-2d30-417c-b0e6-98dc4caceb53.8b96d5da-9dbb-459d-bfd8-af961da3b35e {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:28 devstack sudo[98829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5114076-2d30-417c-b0e6-98dc4caceb53.86cdaa74-7209-4b56-bc8d-5a9f97d978d1 -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b5114076-2d30-417c-b0e6-98dc4caceb53.8b96d5da-9dbb-459d-bfd8-af961da3b35e
Jul 30 20:30:28 devstack sudo[98829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:29 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-44a0fa22-758d-422e-81d1-805119e8d883 tempest-GroupSnapshotsTest-296266448 None] Update group completed successfully.
Jul 30 20:30:29 devstack sudo[98829]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:29 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-4c43e7bc-da5f-452e-a3b0-7dfdfa3279e9 tempest-VolumesDeleteCascade-438274212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5114076-2d30-417c-b0e6-98dc4caceb53.86cdaa74-7209-4b56-bc8d-5a9f97d978d1 -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b5114076-2d30-417c-b0e6-98dc4caceb53.8b96d5da-9dbb-459d-bfd8-af961da3b35e" returned: 0 in 0.360s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:29 devstack cinder-volume[88719]: WARNING cinder.volume.drivers.remotefs [None req-4c43e7bc-da5f-452e-a3b0-7dfdfa3279e9 tempest-VolumesDeleteCascade-438274212 None] /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b5114076-2d30-417c-b0e6-98dc4caceb53.8b96d5da-9dbb-459d-bfd8-af961da3b35e is being set with open permissions: ugo+rw
Jul 30 20:30:29 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-4c43e7bc-da5f-452e-a3b0-7dfdfa3279e9 tempest-VolumesDeleteCascade-438274212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b5114076-2d30-417c-b0e6-98dc4caceb53.8b96d5da-9dbb-459d-bfd8-af961da3b35e {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:29 devstack sudo[98835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b5114076-2d30-417c-b0e6-98dc4caceb53.8b96d5da-9dbb-459d-bfd8-af961da3b35e
Jul 30 20:30:29 devstack sudo[98835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:29 devstack sudo[98835]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:29 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-4c43e7bc-da5f-452e-a3b0-7dfdfa3279e9 tempest-VolumesDeleteCascade-438274212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b5114076-2d30-417c-b0e6-98dc4caceb53.8b96d5da-9dbb-459d-bfd8-af961da3b35e" returned: 0 in 0.275s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:29 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-4c43e7bc-da5f-452e-a3b0-7dfdfa3279e9 tempest-VolumesDeleteCascade-438274212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.611s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:30:29 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-4c43e7bc-da5f-452e-a3b0-7dfdfa3279e9 tempest-VolumesDeleteCascade-438274212 None] Create snapshot completed successfully
Jul 30 20:30:30 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b9d8dd9-8599-49db-8906-98b99b945786 tempest-VolumesGetTest-855358902 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:30:30 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-0b9d8dd9-8599-49db-8906-98b99b945786 tempest-VolumesGetTest-855358902 None] Flow 'volume_create_manager' (e46c4f19-679f-4bdf-923f-36d9b1572ba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:30:30 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-0b9d8dd9-8599-49db-8906-98b99b945786 tempest-VolumesGetTest-855358902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f1e08a6-f03f-4d6c-8d82-0c0368ca638d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:30:30 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-0b9d8dd9-8599-49db-8906-98b99b945786 tempest-VolumesGetTest-855358902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f1e08a6-f03f-4d6c-8d82-0c0368ca638d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:30:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1347796466',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa185ce8-d5b0-476a-9af5-9caedec918b5,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='95dc6a3a598a411dbd7b034cb48fcbb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:30:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:30:30Z,use_quota=True,user_id='e1274cdacdf54e3fbb200f3552412b74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:30:30 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-0b9d8dd9-8599-49db-8906-98b99b945786 tempest-VolumesGetTest-855358902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2aad4d30-c7f4-44da-855b-68b03981124c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:30:30 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-0b9d8dd9-8599-49db-8906-98b99b945786 tempest-VolumesGetTest-855358902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2aad4d30-c7f4-44da-855b-68b03981124c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:30:30 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-0b9d8dd9-8599-49db-8906-98b99b945786 tempest-VolumesGetTest-855358902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1143d135-8bd1-49f7-ad81-c6ce76b895b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:30:30 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-0b9d8dd9-8599-49db-8906-98b99b945786 tempest-VolumesGetTest-855358902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1143d135-8bd1-49f7-ad81-c6ce76b895b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa185ce8-d5b0-476a-9af5-9caedec918b5', 'volume_name': 'volume-aa185ce8-d5b0-476a-9af5-9caedec918b5', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:30:30 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-0b9d8dd9-8599-49db-8906-98b99b945786 tempest-VolumesGetTest-855358902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c41b3f73-bc4a-4367-97ad-9b657122a9c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:30:30 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-0b9d8dd9-8599-49db-8906-98b99b945786 tempest-VolumesGetTest-855358902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c41b3f73-bc4a-4367-97ad-9b657122a9c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:30:30 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-0b9d8dd9-8599-49db-8906-98b99b945786 tempest-VolumesGetTest-855358902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cad9545c-7da2-4ec5-ad5e-d25abe5e7b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:30:30 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-0b9d8dd9-8599-49db-8906-98b99b945786 tempest-VolumesGetTest-855358902 None] Volume aa185ce8-d5b0-476a-9af5-9caedec918b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa185ce8-d5b0-476a-9af5-9caedec918b5', 'volume_size': 1}
Jul 30 20:30:30 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-0b9d8dd9-8599-49db-8906-98b99b945786 tempest-VolumesGetTest-855358902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:30:30 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-0b9d8dd9-8599-49db-8906-98b99b945786 tempest-VolumesGetTest-855358902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:30:30 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-0b9d8dd9-8599-49db-8906-98b99b945786 tempest-VolumesGetTest-855358902 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:30:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1347796466',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa185ce8-d5b0-476a-9af5-9caedec918b5,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='95dc6a3a598a411dbd7b034cb48fcbb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:30:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:30:30Z,use_quota=True,user_id='e1274cdacdf54e3fbb200f3552412b74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:30:30 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-0b9d8dd9-8599-49db-8906-98b99b945786 tempest-VolumesGetTest-855358902 None] Creating volume aa185ce8-d5b0-476a-9af5-9caedec918b5 {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:30:30 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-0b9d8dd9-8599-49db-8906-98b99b945786 tempest-VolumesGetTest-855358902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:30:30 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-0b9d8dd9-8599-49db-8906-98b99b945786 tempest-VolumesGetTest-855358902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:30:30 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-0b9d8dd9-8599-49db-8906-98b99b945786 tempest-VolumesGetTest-855358902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:30:30 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-0b9d8dd9-8599-49db-8906-98b99b945786 tempest-VolumesGetTest-855358902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:30:30 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-0b9d8dd9-8599-49db-8906-98b99b945786 tempest-VolumesGetTest-855358902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:30:30 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-0b9d8dd9-8599-49db-8906-98b99b945786 tempest-VolumesGetTest-855358902 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:30:30 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-0b9d8dd9-8599-49db-8906-98b99b945786 tempest-VolumesGetTest-855358902 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:30:30 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-0b9d8dd9-8599-49db-8906-98b99b945786 tempest-VolumesGetTest-855358902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-aa185ce8-d5b0-476a-9af5-9caedec918b5 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:30 devstack sudo[98841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-aa185ce8-d5b0-476a-9af5-9caedec918b5 1073741824
Jul 30 20:30:30 devstack sudo[98841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:30 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-2eab130a-8d80-45d3-9388-8fbad91d8eb7 tempest-GroupSnapshotsTest-296266448 None] GroupSnapshot cc35fdae-9ae7-4c90-bb61-474d270fd94c: creating.
Jul 30 20:30:30 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-82b0a543-9b78-41df-8dd1-a1ad55bfd1dc tempest-VolumesDeleteCascade-438274212 None] Acquiring lock "cinder-b5114076-2d30-417c-b0e6-98dc4caceb53-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:30:30 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2eab130a-8d80-45d3-9388-8fbad91d8eb7 tempest-GroupSnapshotsTest-296266448 None] Group snapshot cc35fdae-9ae7-4c90-bb61-474d270fd94c: creating. {{(pid=88719) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jul 30 20:30:30 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-2eab130a-8d80-45d3-9388-8fbad91d8eb7 tempest-GroupSnapshotsTest-296266448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:30:30 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-82b0a543-9b78-41df-8dd1-a1ad55bfd1dc tempest-VolumesDeleteCascade-438274212 None] Lock "cinder-b5114076-2d30-417c-b0e6-98dc4caceb53-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:30:30 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-82b0a543-9b78-41df-8dd1-a1ad55bfd1dc tempest-VolumesDeleteCascade-438274212 None] Performing cascade delete. {{(pid=88719) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Jul 30 20:30:30 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-82b0a543-9b78-41df-8dd1-a1ad55bfd1dc tempest-VolumesDeleteCascade-438274212 None] Acquiring lock "cinder-86cdaa74-7209-4b56-bc8d-5a9f97d978d1-delete_snapshot" by "delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:30:30 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-82b0a543-9b78-41df-8dd1-a1ad55bfd1dc tempest-VolumesDeleteCascade-438274212 None] Lock "cinder-86cdaa74-7209-4b56-bc8d-5a9f97d978d1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:30:30 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-82b0a543-9b78-41df-8dd1-a1ad55bfd1dc tempest-VolumesDeleteCascade-438274212 None] Acquiring lock "cinder-quobyte-b5114076-2d30-417c-b0e6-98dc4caceb53" by "delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:30:30 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-82b0a543-9b78-41df-8dd1-a1ad55bfd1dc tempest-VolumesDeleteCascade-438274212 None] Lock "cinder-quobyte-b5114076-2d30-417c-b0e6-98dc4caceb53" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:30:30 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-82b0a543-9b78-41df-8dd1-a1ad55bfd1dc tempest-VolumesDeleteCascade-438274212 None] Acquiring lock "cinder-quobyte-86cdaa74-7209-4b56-bc8d-5a9f97d978d1" by "_delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:30:30 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-82b0a543-9b78-41df-8dd1-a1ad55bfd1dc tempest-VolumesDeleteCascade-438274212 None] Lock "cinder-quobyte-86cdaa74-7209-4b56-bc8d-5a9f97d978d1" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:30:30 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-82b0a543-9b78-41df-8dd1-a1ad55bfd1dc tempest-VolumesDeleteCascade-438274212 None] Deleting offline snapshot 86cdaa74-7209-4b56-bc8d-5a9f97d978d1 of volume b5114076-2d30-417c-b0e6-98dc4caceb53 {{(pid=88719) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 30 20:30:30 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-82b0a543-9b78-41df-8dd1-a1ad55bfd1dc tempest-VolumesDeleteCascade-438274212 None] snapshot_file for this snap is: volume-b5114076-2d30-417c-b0e6-98dc4caceb53.86cdaa74-7209-4b56-bc8d-5a9f97d978d1 {{(pid=88719) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 30 20:30:30 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b9be39-8f26-4cec-91e7-c630d496b04b]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:30:30 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-82b0a543-9b78-41df-8dd1-a1ad55bfd1dc tempest-VolumesDeleteCascade-438274212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b5114076-2d30-417c-b0e6-98dc4caceb53.86cdaa74-7209-4b56-bc8d-5a9f97d978d1 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:31 devstack sudo[98846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b5114076-2d30-417c-b0e6-98dc4caceb53.86cdaa74-7209-4b56-bc8d-5a9f97d978d1
Jul 30 20:30:31 devstack sudo[98846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:31 devstack sudo[98841]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:31 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-0b9d8dd9-8599-49db-8906-98b99b945786 tempest-VolumesGetTest-855358902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-aa185ce8-d5b0-476a-9af5-9caedec918b5 1073741824" returned: 0 in 0.603s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:31 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-0b9d8dd9-8599-49db-8906-98b99b945786 tempest-VolumesGetTest-855358902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-aa185ce8-d5b0-476a-9af5-9caedec918b5 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:31 devstack sudo[98849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-aa185ce8-d5b0-476a-9af5-9caedec918b5
Jul 30 20:30:31 devstack sudo[98849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:31 devstack sudo[98846]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:31 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-82b0a543-9b78-41df-8dd1-a1ad55bfd1dc tempest-VolumesDeleteCascade-438274212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b5114076-2d30-417c-b0e6-98dc4caceb53.86cdaa74-7209-4b56-bc8d-5a9f97d978d1" returned: 0 in 0.457s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:31 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-82b0a543-9b78-41df-8dd1-a1ad55bfd1dc tempest-VolumesDeleteCascade-438274212 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b5114076-2d30-417c-b0e6-98dc4caceb53(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88719) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 30 20:30:31 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[85c43df0-10a9-49bf-81cf-3321d52fab8d]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:30:31 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-82b0a543-9b78-41df-8dd1-a1ad55bfd1dc tempest-VolumesDeleteCascade-438274212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b5114076-2d30-417c-b0e6-98dc4caceb53 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:31 devstack sudo[98849]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:31 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-0b9d8dd9-8599-49db-8906-98b99b945786 tempest-VolumesGetTest-855358902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-aa185ce8-d5b0-476a-9af5-9caedec918b5" returned: 0 in 0.305s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:31 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-0b9d8dd9-8599-49db-8906-98b99b945786 tempest-VolumesGetTest-855358902 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:30:31 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-0b9d8dd9-8599-49db-8906-98b99b945786 tempest-VolumesGetTest-855358902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.956s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:30:31 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-2eab130a-8d80-45d3-9388-8fbad91d8eb7 tempest-GroupSnapshotsTest-296266448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.763s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:30:31 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-0b9d8dd9-8599-49db-8906-98b99b945786 tempest-VolumesGetTest-855358902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cad9545c-7da2-4ec5-ad5e-d25abe5e7b23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa185ce8-d5b0-476a-9af5-9caedec918b5', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:30:31 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-0b9d8dd9-8599-49db-8906-98b99b945786 tempest-VolumesGetTest-855358902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97e0a67b-2124-4725-bd8d-832701f6b9a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:30:31 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-2eab130a-8d80-45d3-9388-8fbad91d8eb7 tempest-GroupSnapshotsTest-296266448 None] Creating offline snapshot 37dba467-9e41-48bd-b419-5e41eaefec7d of volume 0b103f9e-78b8-40aa-adee-57742d868c4e {{(pid=88719) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 30 20:30:31 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-0b9d8dd9-8599-49db-8906-98b99b945786 tempest-VolumesGetTest-855358902 None] Volume volume-aa185ce8-d5b0-476a-9af5-9caedec918b5 (aa185ce8-d5b0-476a-9af5-9caedec918b5): created successfully
Jul 30 20:30:31 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-0b9d8dd9-8599-49db-8906-98b99b945786 tempest-VolumesGetTest-855358902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97e0a67b-2124-4725-bd8d-832701f6b9a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:30:31 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-0b9d8dd9-8599-49db-8906-98b99b945786 tempest-VolumesGetTest-855358902 None] Flow 'volume_create_manager' (e46c4f19-679f-4bdf-923f-36d9b1572ba4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:30:31 devstack sudo[98854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b5114076-2d30-417c-b0e6-98dc4caceb53
Jul 30 20:30:31 devstack sudo[98854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:31 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b77a54-fda3-4c5b-a6d5-ae9d269e70bf]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:30:31 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2eab130a-8d80-45d3-9388-8fbad91d8eb7 tempest-GroupSnapshotsTest-296266448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0b103f9e-78b8-40aa-adee-57742d868c4e {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:31 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-0b9d8dd9-8599-49db-8906-98b99b945786 tempest-VolumesGetTest-855358902 None] Created volume successfully.
Jul 30 20:30:31 devstack sudo[98857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0b103f9e-78b8-40aa-adee-57742d868c4e
Jul 30 20:30:31 devstack sudo[98857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:31 devstack sudo[98854]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:31 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-82b0a543-9b78-41df-8dd1-a1ad55bfd1dc tempest-VolumesDeleteCascade-438274212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b5114076-2d30-417c-b0e6-98dc4caceb53" returned: 0 in 0.494s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:31 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[19a6605f-1d90-4f62-8df1-b65746d9e7ca]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:30:31 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-82b0a543-9b78-41df-8dd1-a1ad55bfd1dc tempest-VolumesDeleteCascade-438274212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b5114076-2d30-417c-b0e6-98dc4caceb53.8b96d5da-9dbb-459d-bfd8-af961da3b35e {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:32 devstack sudo[98857]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:32 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2eab130a-8d80-45d3-9388-8fbad91d8eb7 tempest-GroupSnapshotsTest-296266448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0b103f9e-78b8-40aa-adee-57742d868c4e" returned: 0 in 0.556s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:32 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2eab130a-8d80-45d3-9388-8fbad91d8eb7 tempest-GroupSnapshotsTest-296266448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0b103f9e-78b8-40aa-adee-57742d868c4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0b103f9e-78b8-40aa-adee-57742d868c4e.37dba467-9e41-48bd-b419-5e41eaefec7d 1G {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:32 devstack sudo[98863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b5114076-2d30-417c-b0e6-98dc4caceb53.8b96d5da-9dbb-459d-bfd8-af961da3b35e
Jul 30 20:30:32 devstack sudo[98863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:32 devstack sudo[98871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0b103f9e-78b8-40aa-adee-57742d868c4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0b103f9e-78b8-40aa-adee-57742d868c4e.37dba467-9e41-48bd-b419-5e41eaefec7d 1G
Jul 30 20:30:32 devstack sudo[98871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:32 devstack sudo[98863]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:32 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-82b0a543-9b78-41df-8dd1-a1ad55bfd1dc tempest-VolumesDeleteCascade-438274212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b5114076-2d30-417c-b0e6-98dc4caceb53.8b96d5da-9dbb-459d-bfd8-af961da3b35e" returned: 0 in 0.488s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:32 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-82b0a543-9b78-41df-8dd1-a1ad55bfd1dc tempest-VolumesDeleteCascade-438274212 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b5114076-2d30-417c-b0e6-98dc4caceb53(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88719) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 30 20:30:32 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ef4bc4b-e3ed-4763-bdb4-21dbfc46b81a]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:30:32 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-82b0a543-9b78-41df-8dd1-a1ad55bfd1dc tempest-VolumesDeleteCascade-438274212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b5114076-2d30-417c-b0e6-98dc4caceb53.86cdaa74-7209-4b56-bc8d-5a9f97d978d1 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:32 devstack sudo[98889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b5114076-2d30-417c-b0e6-98dc4caceb53.86cdaa74-7209-4b56-bc8d-5a9f97d978d1
Jul 30 20:30:32 devstack sudo[98889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:32 devstack sudo[98871]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:32 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2eab130a-8d80-45d3-9388-8fbad91d8eb7 tempest-GroupSnapshotsTest-296266448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0b103f9e-78b8-40aa-adee-57742d868c4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0b103f9e-78b8-40aa-adee-57742d868c4e.37dba467-9e41-48bd-b419-5e41eaefec7d 1G" returned: 0 in 0.700s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:32 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2eab130a-8d80-45d3-9388-8fbad91d8eb7 tempest-GroupSnapshotsTest-296266448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b103f9e-78b8-40aa-adee-57742d868c4e -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0b103f9e-78b8-40aa-adee-57742d868c4e.37dba467-9e41-48bd-b419-5e41eaefec7d {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:32 devstack sudo[98895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b103f9e-78b8-40aa-adee-57742d868c4e -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0b103f9e-78b8-40aa-adee-57742d868c4e.37dba467-9e41-48bd-b419-5e41eaefec7d
Jul 30 20:30:32 devstack sudo[98895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:33 devstack sudo[98889]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:33 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-82b0a543-9b78-41df-8dd1-a1ad55bfd1dc tempest-VolumesDeleteCascade-438274212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b5114076-2d30-417c-b0e6-98dc4caceb53.86cdaa74-7209-4b56-bc8d-5a9f97d978d1" returned: 0 in 0.546s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:33 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-82b0a543-9b78-41df-8dd1-a1ad55bfd1dc tempest-VolumesDeleteCascade-438274212 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b5114076-2d30-417c-b0e6-98dc4caceb53(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88719) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 30 20:30:33 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[750b27fd-7ef8-4e34-856c-c696659a3d0c]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:30:33 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-82b0a543-9b78-41df-8dd1-a1ad55bfd1dc tempest-VolumesDeleteCascade-438274212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b5114076-2d30-417c-b0e6-98dc4caceb53 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:33 devstack sudo[98900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b5114076-2d30-417c-b0e6-98dc4caceb53
Jul 30 20:30:33 devstack sudo[98900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:33 devstack sudo[98895]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:33 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2eab130a-8d80-45d3-9388-8fbad91d8eb7 tempest-GroupSnapshotsTest-296266448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b103f9e-78b8-40aa-adee-57742d868c4e -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0b103f9e-78b8-40aa-adee-57742d868c4e.37dba467-9e41-48bd-b419-5e41eaefec7d" returned: 0 in 0.482s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:33 devstack cinder-volume[88719]: WARNING cinder.volume.drivers.remotefs [None req-2eab130a-8d80-45d3-9388-8fbad91d8eb7 tempest-GroupSnapshotsTest-296266448 None] /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0b103f9e-78b8-40aa-adee-57742d868c4e.37dba467-9e41-48bd-b419-5e41eaefec7d is being set with open permissions: ugo+rw: NotImplementedError
Jul 30 20:30:33 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2eab130a-8d80-45d3-9388-8fbad91d8eb7 tempest-GroupSnapshotsTest-296266448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0b103f9e-78b8-40aa-adee-57742d868c4e.37dba467-9e41-48bd-b419-5e41eaefec7d {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:33 devstack sudo[98905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0b103f9e-78b8-40aa-adee-57742d868c4e.37dba467-9e41-48bd-b419-5e41eaefec7d
Jul 30 20:30:33 devstack sudo[98905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:33 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3f75ab4-7a9f-4868-b4ba-4c4965bb3fdd tempest-VolumesGetTest-855358902 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:30:33 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-d3f75ab4-7a9f-4868-b4ba-4c4965bb3fdd tempest-VolumesGetTest-855358902 None] Flow 'volume_create_manager' (cdc65adf-39b4-4498-b4ab-6d056baaa7e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:30:33 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-d3f75ab4-7a9f-4868-b4ba-4c4965bb3fdd tempest-VolumesGetTest-855358902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba8ddb33-7c22-454a-91eb-02eb223d2a26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:30:33 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-d3f75ab4-7a9f-4868-b4ba-4c4965bb3fdd tempest-VolumesGetTest-855358902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba8ddb33-7c22-454a-91eb-02eb223d2a26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:30:33Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1261767465',display_name='tempest-VolumesGetTest-Volume-1518627199',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48d1828a-54f2-4b18-9a67-0551ed13228b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95dc6a3a598a411dbd7b034cb48fcbb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:30:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:30:33Z,use_quota=True,user_id='e1274cdacdf54e3fbb200f3552412b74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:30:33 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-d3f75ab4-7a9f-4868-b4ba-4c4965bb3fdd tempest-VolumesGetTest-855358902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bcb44e5-494b-47fc-8e3b-7e37488d3b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:30:33 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-d3f75ab4-7a9f-4868-b4ba-4c4965bb3fdd tempest-VolumesGetTest-855358902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bcb44e5-494b-47fc-8e3b-7e37488d3b76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:30:33 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-d3f75ab4-7a9f-4868-b4ba-4c4965bb3fdd tempest-VolumesGetTest-855358902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bf02ed9-47a9-467d-8104-d61ba49ab085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:30:33 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-d3f75ab4-7a9f-4868-b4ba-4c4965bb3fdd tempest-VolumesGetTest-855358902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bf02ed9-47a9-467d-8104-d61ba49ab085) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48d1828a-54f2-4b18-9a67-0551ed13228b', 'volume_name': 'volume-48d1828a-54f2-4b18-9a67-0551ed13228b', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:30:33 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-d3f75ab4-7a9f-4868-b4ba-4c4965bb3fdd tempest-VolumesGetTest-855358902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70593e63-41da-4cb6-9b38-46291ecff69a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:30:33 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-d3f75ab4-7a9f-4868-b4ba-4c4965bb3fdd tempest-VolumesGetTest-855358902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70593e63-41da-4cb6-9b38-46291ecff69a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:30:33 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-d3f75ab4-7a9f-4868-b4ba-4c4965bb3fdd tempest-VolumesGetTest-855358902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33a9a027-bf84-4b43-8026-be593ec97856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:30:33 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-d3f75ab4-7a9f-4868-b4ba-4c4965bb3fdd tempest-VolumesGetTest-855358902 None] Volume 48d1828a-54f2-4b18-9a67-0551ed13228b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48d1828a-54f2-4b18-9a67-0551ed13228b', 'volume_size': 1}
Jul 30 20:30:33 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-d3f75ab4-7a9f-4868-b4ba-4c4965bb3fdd tempest-VolumesGetTest-855358902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:30:33 devstack sudo[98900]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:33 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-82b0a543-9b78-41df-8dd1-a1ad55bfd1dc tempest-VolumesDeleteCascade-438274212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b5114076-2d30-417c-b0e6-98dc4caceb53" returned: 0 in 0.553s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:33 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-82b0a543-9b78-41df-8dd1-a1ad55bfd1dc tempest-VolumesDeleteCascade-438274212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b5114076-2d30-417c-b0e6-98dc4caceb53.86cdaa74-7209-4b56-bc8d-5a9f97d978d1 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:33 devstack sudo[98911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b5114076-2d30-417c-b0e6-98dc4caceb53.86cdaa74-7209-4b56-bc8d-5a9f97d978d1
Jul 30 20:30:33 devstack sudo[98911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:33 devstack sudo[98905]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:33 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2eab130a-8d80-45d3-9388-8fbad91d8eb7 tempest-GroupSnapshotsTest-296266448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0b103f9e-78b8-40aa-adee-57742d868c4e.37dba467-9e41-48bd-b419-5e41eaefec7d" returned: 0 in 0.381s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:33 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2eab130a-8d80-45d3-9388-8fbad91d8eb7 tempest-GroupSnapshotsTest-296266448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0b103f9e-78b8-40aa-adee-57742d868c4e.info {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:33 devstack sudo[98913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0b103f9e-78b8-40aa-adee-57742d868c4e.info
Jul 30 20:30:33 devstack sudo[98913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:34 devstack sudo[98913]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:34 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2eab130a-8d80-45d3-9388-8fbad91d8eb7 tempest-GroupSnapshotsTest-296266448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0b103f9e-78b8-40aa-adee-57742d868c4e.info" returned: 0 in 0.294s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:34 devstack cinder-volume[88719]: WARNING cinder.volume.drivers.remotefs [None req-2eab130a-8d80-45d3-9388-8fbad91d8eb7 tempest-GroupSnapshotsTest-296266448 None] /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0b103f9e-78b8-40aa-adee-57742d868c4e.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 30 20:30:34 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2eab130a-8d80-45d3-9388-8fbad91d8eb7 tempest-GroupSnapshotsTest-296266448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0b103f9e-78b8-40aa-adee-57742d868c4e.info {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:34 devstack sudo[98911]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:34 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-82b0a543-9b78-41df-8dd1-a1ad55bfd1dc tempest-VolumesDeleteCascade-438274212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b5114076-2d30-417c-b0e6-98dc4caceb53.86cdaa74-7209-4b56-bc8d-5a9f97d978d1" returned: 0 in 0.402s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:34 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-82b0a543-9b78-41df-8dd1-a1ad55bfd1dc tempest-VolumesDeleteCascade-438274212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b5114076-2d30-417c-b0e6-98dc4caceb53.86cdaa74-7209-4b56-bc8d-5a9f97d978d1 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:34 devstack sudo[98920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0b103f9e-78b8-40aa-adee-57742d868c4e.info
Jul 30 20:30:34 devstack sudo[98920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:34 devstack sudo[98921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b5114076-2d30-417c-b0e6-98dc4caceb53.86cdaa74-7209-4b56-bc8d-5a9f97d978d1
Jul 30 20:30:34 devstack sudo[98921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:34 devstack sudo[98920]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:34 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2eab130a-8d80-45d3-9388-8fbad91d8eb7 tempest-GroupSnapshotsTest-296266448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0b103f9e-78b8-40aa-adee-57742d868c4e.info" returned: 0 in 0.296s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:34 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-2eab130a-8d80-45d3-9388-8fbad91d8eb7 tempest-GroupSnapshotsTest-296266448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.856s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:30:34 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-2eab130a-8d80-45d3-9388-8fbad91d8eb7 tempest-GroupSnapshotsTest-296266448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:30:34 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-2eab130a-8d80-45d3-9388-8fbad91d8eb7 tempest-GroupSnapshotsTest-296266448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:30:34 devstack sudo[98921]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:34 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-82b0a543-9b78-41df-8dd1-a1ad55bfd1dc tempest-VolumesDeleteCascade-438274212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b5114076-2d30-417c-b0e6-98dc4caceb53.86cdaa74-7209-4b56-bc8d-5a9f97d978d1" returned: 0 in 0.312s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:34 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-82b0a543-9b78-41df-8dd1-a1ad55bfd1dc tempest-VolumesDeleteCascade-438274212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5114076-2d30-417c-b0e6-98dc4caceb53 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b5114076-2d30-417c-b0e6-98dc4caceb53.8b96d5da-9dbb-459d-bfd8-af961da3b35e -F qcow2 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:34 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-2eab130a-8d80-45d3-9388-8fbad91d8eb7 tempest-GroupSnapshotsTest-296266448 None] Creating offline snapshot b229a0f9-7a3b-4480-a737-ccb7c27a1e41 of volume 443ae94e-9a94-4ee8-883b-c4b0216646e5 {{(pid=88719) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 30 20:30:34 devstack sudo[98927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5114076-2d30-417c-b0e6-98dc4caceb53 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b5114076-2d30-417c-b0e6-98dc4caceb53.8b96d5da-9dbb-459d-bfd8-af961da3b35e -F qcow2
Jul 30 20:30:34 devstack sudo[98927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:34 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae663761-b7df-4426-a9bc-de9b27341ea3]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:30:34 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2eab130a-8d80-45d3-9388-8fbad91d8eb7 tempest-GroupSnapshotsTest-296266448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-443ae94e-9a94-4ee8-883b-c4b0216646e5 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:34 devstack sudo[98930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-443ae94e-9a94-4ee8-883b-c4b0216646e5
Jul 30 20:30:34 devstack sudo[98930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:34 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-82b0a543-9b78-41df-8dd1-a1ad55bfd1dc tempest-VolumesDeleteCascade-438274212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5114076-2d30-417c-b0e6-98dc4caceb53 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b5114076-2d30-417c-b0e6-98dc4caceb53.8b96d5da-9dbb-459d-bfd8-af961da3b35e -F qcow2" returned: 0 in 0.353s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:34 devstack sudo[98927]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:34 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-82b0a543-9b78-41df-8dd1-a1ad55bfd1dc tempest-VolumesDeleteCascade-438274212 None] Lock "cinder-quobyte-86cdaa74-7209-4b56-bc8d-5a9f97d978d1" released by "_delete_snapshot" :: held 3.885s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:30:34 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-82b0a543-9b78-41df-8dd1-a1ad55bfd1dc tempest-VolumesDeleteCascade-438274212 None] Lock "cinder-quobyte-b5114076-2d30-417c-b0e6-98dc4caceb53" released by "delete_snapshot" :: held 3.918s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:30:34 devstack sudo[98930]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:34 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2eab130a-8d80-45d3-9388-8fbad91d8eb7 tempest-GroupSnapshotsTest-296266448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-443ae94e-9a94-4ee8-883b-c4b0216646e5" returned: 0 in 0.552s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:34 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-82b0a543-9b78-41df-8dd1-a1ad55bfd1dc tempest-VolumesDeleteCascade-438274212 None] Created reservations ['ee01845b-a77a-45fe-9460-f5a2af223c42', '348c2c99-508e-476a-a217-655af836f3fa', '42d079f9-68d8-4a79-8cef-a524df4b5bbb', '8ebc6a02-45e6-408b-9ca5-e199ce943fe7'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:30:34 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2eab130a-8d80-45d3-9388-8fbad91d8eb7 tempest-GroupSnapshotsTest-296266448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-443ae94e-9a94-4ee8-883b-c4b0216646e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-443ae94e-9a94-4ee8-883b-c4b0216646e5.b229a0f9-7a3b-4480-a737-ccb7c27a1e41 1G {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:35 devstack sudo[98954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-443ae94e-9a94-4ee8-883b-c4b0216646e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-443ae94e-9a94-4ee8-883b-c4b0216646e5.b229a0f9-7a3b-4480-a737-ccb7c27a1e41 1G
Jul 30 20:30:35 devstack sudo[98954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:35 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-82b0a543-9b78-41df-8dd1-a1ad55bfd1dc tempest-VolumesDeleteCascade-438274212 None] Delete snapshot completed successfully.
Jul 30 20:30:35 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-82b0a543-9b78-41df-8dd1-a1ad55bfd1dc tempest-VolumesDeleteCascade-438274212 None] Lock "cinder-86cdaa74-7209-4b56-bc8d-5a9f97d978d1-delete_snapshot" released by "delete_snapshot" :: held 4.309s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:30:35 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-82b0a543-9b78-41df-8dd1-a1ad55bfd1dc tempest-VolumesDeleteCascade-438274212 None] Acquiring lock "cinder-8b96d5da-9dbb-459d-bfd8-af961da3b35e-delete_snapshot" by "delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:30:35 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-82b0a543-9b78-41df-8dd1-a1ad55bfd1dc tempest-VolumesDeleteCascade-438274212 None] Lock "cinder-8b96d5da-9dbb-459d-bfd8-af961da3b35e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:30:35 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-82b0a543-9b78-41df-8dd1-a1ad55bfd1dc tempest-VolumesDeleteCascade-438274212 None] Acquiring lock "cinder-quobyte-b5114076-2d30-417c-b0e6-98dc4caceb53" by "delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:30:35 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-82b0a543-9b78-41df-8dd1-a1ad55bfd1dc tempest-VolumesDeleteCascade-438274212 None] Lock "cinder-quobyte-b5114076-2d30-417c-b0e6-98dc4caceb53" acquired by "delete_snapshot" :: waited 0.032s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:30:35 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-82b0a543-9b78-41df-8dd1-a1ad55bfd1dc tempest-VolumesDeleteCascade-438274212 None] Acquiring lock "cinder-quobyte-8b96d5da-9dbb-459d-bfd8-af961da3b35e" by "_delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:30:35 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-82b0a543-9b78-41df-8dd1-a1ad55bfd1dc tempest-VolumesDeleteCascade-438274212 None] Lock "cinder-quobyte-8b96d5da-9dbb-459d-bfd8-af961da3b35e" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:30:35 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-82b0a543-9b78-41df-8dd1-a1ad55bfd1dc tempest-VolumesDeleteCascade-438274212 None] Deleting offline snapshot 8b96d5da-9dbb-459d-bfd8-af961da3b35e of volume b5114076-2d30-417c-b0e6-98dc4caceb53 {{(pid=88719) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 30 20:30:35 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-82b0a543-9b78-41df-8dd1-a1ad55bfd1dc tempest-VolumesDeleteCascade-438274212 None] snapshot_file for this snap is: volume-b5114076-2d30-417c-b0e6-98dc4caceb53.8b96d5da-9dbb-459d-bfd8-af961da3b35e {{(pid=88719) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 30 20:30:35 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[c605c38b-182a-4100-8a23-bf507869d4a5]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:30:35 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-82b0a543-9b78-41df-8dd1-a1ad55bfd1dc tempest-VolumesDeleteCascade-438274212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b5114076-2d30-417c-b0e6-98dc4caceb53.8b96d5da-9dbb-459d-bfd8-af961da3b35e {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:35 devstack sudo[98976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b5114076-2d30-417c-b0e6-98dc4caceb53.8b96d5da-9dbb-459d-bfd8-af961da3b35e
Jul 30 20:30:35 devstack sudo[98976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:35 devstack sudo[98954]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:35 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2eab130a-8d80-45d3-9388-8fbad91d8eb7 tempest-GroupSnapshotsTest-296266448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-443ae94e-9a94-4ee8-883b-c4b0216646e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-443ae94e-9a94-4ee8-883b-c4b0216646e5.b229a0f9-7a3b-4480-a737-ccb7c27a1e41 1G" returned: 0 in 0.911s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:35 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2eab130a-8d80-45d3-9388-8fbad91d8eb7 tempest-GroupSnapshotsTest-296266448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-443ae94e-9a94-4ee8-883b-c4b0216646e5 -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-443ae94e-9a94-4ee8-883b-c4b0216646e5.b229a0f9-7a3b-4480-a737-ccb7c27a1e41 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:35 devstack sudo[98976]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:35 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-82b0a543-9b78-41df-8dd1-a1ad55bfd1dc tempest-VolumesDeleteCascade-438274212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b5114076-2d30-417c-b0e6-98dc4caceb53.8b96d5da-9dbb-459d-bfd8-af961da3b35e" returned: 0 in 0.637s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:35 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-82b0a543-9b78-41df-8dd1-a1ad55bfd1dc tempest-VolumesDeleteCascade-438274212 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b5114076-2d30-417c-b0e6-98dc4caceb53(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88719) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 30 20:30:35 devstack sudo[99005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-443ae94e-9a94-4ee8-883b-c4b0216646e5 -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-443ae94e-9a94-4ee8-883b-c4b0216646e5.b229a0f9-7a3b-4480-a737-ccb7c27a1e41
Jul 30 20:30:35 devstack sudo[99005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:35 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a5b4ce7-bb4b-4ac8-adc6-3b86b9f12159]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:30:35 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-82b0a543-9b78-41df-8dd1-a1ad55bfd1dc tempest-VolumesDeleteCascade-438274212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b5114076-2d30-417c-b0e6-98dc4caceb53 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:36 devstack sudo[99010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b5114076-2d30-417c-b0e6-98dc4caceb53
Jul 30 20:30:36 devstack sudo[99010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:36 devstack sudo[99005]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:36 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2eab130a-8d80-45d3-9388-8fbad91d8eb7 tempest-GroupSnapshotsTest-296266448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-443ae94e-9a94-4ee8-883b-c4b0216646e5 -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-443ae94e-9a94-4ee8-883b-c4b0216646e5.b229a0f9-7a3b-4480-a737-ccb7c27a1e41" returned: 0 in 0.397s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:36 devstack cinder-volume[88719]: WARNING cinder.volume.drivers.remotefs [None req-2eab130a-8d80-45d3-9388-8fbad91d8eb7 tempest-GroupSnapshotsTest-296266448 None] /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-443ae94e-9a94-4ee8-883b-c4b0216646e5.b229a0f9-7a3b-4480-a737-ccb7c27a1e41 is being set with open permissions: ugo+rw: NotImplementedError
Jul 30 20:30:36 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2eab130a-8d80-45d3-9388-8fbad91d8eb7 tempest-GroupSnapshotsTest-296266448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-443ae94e-9a94-4ee8-883b-c4b0216646e5.b229a0f9-7a3b-4480-a737-ccb7c27a1e41 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:36 devstack sudo[99028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-443ae94e-9a94-4ee8-883b-c4b0216646e5.b229a0f9-7a3b-4480-a737-ccb7c27a1e41
Jul 30 20:30:36 devstack sudo[99028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:36 devstack sudo[99010]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:36 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-82b0a543-9b78-41df-8dd1-a1ad55bfd1dc tempest-VolumesDeleteCascade-438274212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b5114076-2d30-417c-b0e6-98dc4caceb53" returned: 0 in 0.489s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:36 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-82b0a543-9b78-41df-8dd1-a1ad55bfd1dc tempest-VolumesDeleteCascade-438274212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b5114076-2d30-417c-b0e6-98dc4caceb53.8b96d5da-9dbb-459d-bfd8-af961da3b35e {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:36 devstack sudo[99043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b5114076-2d30-417c-b0e6-98dc4caceb53.8b96d5da-9dbb-459d-bfd8-af961da3b35e
Jul 30 20:30:36 devstack sudo[99043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:36 devstack sudo[99028]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:36 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2eab130a-8d80-45d3-9388-8fbad91d8eb7 tempest-GroupSnapshotsTest-296266448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-443ae94e-9a94-4ee8-883b-c4b0216646e5.b229a0f9-7a3b-4480-a737-ccb7c27a1e41" returned: 0 in 0.278s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:36 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2eab130a-8d80-45d3-9388-8fbad91d8eb7 tempest-GroupSnapshotsTest-296266448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-443ae94e-9a94-4ee8-883b-c4b0216646e5.info {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:36 devstack sudo[99046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-443ae94e-9a94-4ee8-883b-c4b0216646e5.info
Jul 30 20:30:36 devstack sudo[99046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:36 devstack sudo[99043]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:36 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-82b0a543-9b78-41df-8dd1-a1ad55bfd1dc tempest-VolumesDeleteCascade-438274212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b5114076-2d30-417c-b0e6-98dc4caceb53.8b96d5da-9dbb-459d-bfd8-af961da3b35e" returned: 0 in 0.346s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:36 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-82b0a543-9b78-41df-8dd1-a1ad55bfd1dc tempest-VolumesDeleteCascade-438274212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b5114076-2d30-417c-b0e6-98dc4caceb53.8b96d5da-9dbb-459d-bfd8-af961da3b35e {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:36 devstack sudo[99053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b5114076-2d30-417c-b0e6-98dc4caceb53.8b96d5da-9dbb-459d-bfd8-af961da3b35e
Jul 30 20:30:36 devstack sudo[99053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:36 devstack sudo[99046]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:36 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2eab130a-8d80-45d3-9388-8fbad91d8eb7 tempest-GroupSnapshotsTest-296266448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-443ae94e-9a94-4ee8-883b-c4b0216646e5.info" returned: 0 in 0.278s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:36 devstack cinder-volume[88719]: WARNING cinder.volume.drivers.remotefs [None req-2eab130a-8d80-45d3-9388-8fbad91d8eb7 tempest-GroupSnapshotsTest-296266448 None] /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-443ae94e-9a94-4ee8-883b-c4b0216646e5.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 30 20:30:36 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2eab130a-8d80-45d3-9388-8fbad91d8eb7 tempest-GroupSnapshotsTest-296266448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-443ae94e-9a94-4ee8-883b-c4b0216646e5.info {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:36 devstack sudo[99055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-443ae94e-9a94-4ee8-883b-c4b0216646e5.info
Jul 30 20:30:36 devstack sudo[99055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:37 devstack sudo[99053]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:37 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-82b0a543-9b78-41df-8dd1-a1ad55bfd1dc tempest-VolumesDeleteCascade-438274212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b5114076-2d30-417c-b0e6-98dc4caceb53.8b96d5da-9dbb-459d-bfd8-af961da3b35e" returned: 0 in 0.282s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:37 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-82b0a543-9b78-41df-8dd1-a1ad55bfd1dc tempest-VolumesDeleteCascade-438274212 None] Lock "cinder-quobyte-8b96d5da-9dbb-459d-bfd8-af961da3b35e" released by "_delete_snapshot" :: held 1.911s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:30:37 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-82b0a543-9b78-41df-8dd1-a1ad55bfd1dc tempest-VolumesDeleteCascade-438274212 None] Lock "cinder-quobyte-b5114076-2d30-417c-b0e6-98dc4caceb53" released by "delete_snapshot" :: held 1.938s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:30:37 devstack sudo[99055]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:37 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2eab130a-8d80-45d3-9388-8fbad91d8eb7 tempest-GroupSnapshotsTest-296266448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-443ae94e-9a94-4ee8-883b-c4b0216646e5.info" returned: 0 in 0.282s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:37 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-2eab130a-8d80-45d3-9388-8fbad91d8eb7 tempest-GroupSnapshotsTest-296266448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.842s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:30:37 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-d3f75ab4-7a9f-4868-b4ba-4c4965bb3fdd tempest-VolumesGetTest-855358902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.565s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:30:37 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-d3f75ab4-7a9f-4868-b4ba-4c4965bb3fdd tempest-VolumesGetTest-855358902 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:30:33Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1261767465',display_name='tempest-VolumesGetTest-Volume-1518627199',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48d1828a-54f2-4b18-9a67-0551ed13228b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95dc6a3a598a411dbd7b034cb48fcbb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:30:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:30:33Z,use_quota=True,user_id='e1274cdacdf54e3fbb200f3552412b74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:30:37 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-d3f75ab4-7a9f-4868-b4ba-4c4965bb3fdd tempest-VolumesGetTest-855358902 None] Creating volume 48d1828a-54f2-4b18-9a67-0551ed13228b {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:30:37 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-d3f75ab4-7a9f-4868-b4ba-4c4965bb3fdd tempest-VolumesGetTest-855358902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:30:37 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-d3f75ab4-7a9f-4868-b4ba-4c4965bb3fdd tempest-VolumesGetTest-855358902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:30:37 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-d3f75ab4-7a9f-4868-b4ba-4c4965bb3fdd tempest-VolumesGetTest-855358902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:30:37 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-d3f75ab4-7a9f-4868-b4ba-4c4965bb3fdd tempest-VolumesGetTest-855358902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:30:37 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-d3f75ab4-7a9f-4868-b4ba-4c4965bb3fdd tempest-VolumesGetTest-855358902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:30:37 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-d3f75ab4-7a9f-4868-b4ba-4c4965bb3fdd tempest-VolumesGetTest-855358902 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:30:37 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-d3f75ab4-7a9f-4868-b4ba-4c4965bb3fdd tempest-VolumesGetTest-855358902 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:30:37 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-d3f75ab4-7a9f-4868-b4ba-4c4965bb3fdd tempest-VolumesGetTest-855358902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-48d1828a-54f2-4b18-9a67-0551ed13228b 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:37 devstack sudo[99059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-48d1828a-54f2-4b18-9a67-0551ed13228b 1073741824
Jul 30 20:30:37 devstack sudo[99059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:37 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-82b0a543-9b78-41df-8dd1-a1ad55bfd1dc tempest-VolumesDeleteCascade-438274212 None] Created reservations ['23462053-7ee6-4fe7-a9bc-93ff1b725287', '2c712430-7d90-43cc-b2e7-a0d5b5ff1a03', '11e5c984-b550-4e65-bb73-aa3dac98d267', '8283c36e-8f7e-44f5-ae52-133546cbee05'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:30:37 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-82b0a543-9b78-41df-8dd1-a1ad55bfd1dc tempest-VolumesDeleteCascade-438274212 None] Delete snapshot completed successfully.
Jul 30 20:30:37 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-2eab130a-8d80-45d3-9388-8fbad91d8eb7 tempest-GroupSnapshotsTest-296266448 None] group_snapshot cc35fdae-9ae7-4c90-bb61-474d270fd94c: created successfully
Jul 30 20:30:37 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-82b0a543-9b78-41df-8dd1-a1ad55bfd1dc tempest-VolumesDeleteCascade-438274212 None] Lock "cinder-8b96d5da-9dbb-459d-bfd8-af961da3b35e-delete_snapshot" released by "delete_snapshot" :: held 2.261s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:30:37 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-82b0a543-9b78-41df-8dd1-a1ad55bfd1dc tempest-VolumesDeleteCascade-438274212 None] Snapshots deleted, issuing volume delete {{(pid=88719) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Jul 30 20:30:37 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-82b0a543-9b78-41df-8dd1-a1ad55bfd1dc tempest-VolumesDeleteCascade-438274212 None] Acquiring lock "cinder-quobyte-b5114076-2d30-417c-b0e6-98dc4caceb53" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:30:37 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-82b0a543-9b78-41df-8dd1-a1ad55bfd1dc tempest-VolumesDeleteCascade-438274212 None] Lock "cinder-quobyte-b5114076-2d30-417c-b0e6-98dc4caceb53" acquired by "delete_volume" :: waited 0.023s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:30:37 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[22b35294-2862-4207-8763-ed10662e0c2c]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:30:37 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-82b0a543-9b78-41df-8dd1-a1ad55bfd1dc tempest-VolumesDeleteCascade-438274212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b5114076-2d30-417c-b0e6-98dc4caceb53 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:37 devstack sudo[99065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b5114076-2d30-417c-b0e6-98dc4caceb53
Jul 30 20:30:37 devstack sudo[99065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:37 devstack sudo[99059]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:37 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-d3f75ab4-7a9f-4868-b4ba-4c4965bb3fdd tempest-VolumesGetTest-855358902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-48d1828a-54f2-4b18-9a67-0551ed13228b 1073741824" returned: 0 in 0.711s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:37 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-d3f75ab4-7a9f-4868-b4ba-4c4965bb3fdd tempest-VolumesGetTest-855358902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-48d1828a-54f2-4b18-9a67-0551ed13228b {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:38 devstack sudo[99070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-48d1828a-54f2-4b18-9a67-0551ed13228b
Jul 30 20:30:38 devstack sudo[99070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:38 devstack sudo[99065]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:38 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-82b0a543-9b78-41df-8dd1-a1ad55bfd1dc tempest-VolumesDeleteCascade-438274212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b5114076-2d30-417c-b0e6-98dc4caceb53" returned: 0 in 0.521s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:38 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-82b0a543-9b78-41df-8dd1-a1ad55bfd1dc tempest-VolumesDeleteCascade-438274212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b5114076-2d30-417c-b0e6-98dc4caceb53 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:38 devstack sudo[99075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b5114076-2d30-417c-b0e6-98dc4caceb53
Jul 30 20:30:38 devstack sudo[99075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:38 devstack sudo[99070]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:38 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-d3f75ab4-7a9f-4868-b4ba-4c4965bb3fdd tempest-VolumesGetTest-855358902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-48d1828a-54f2-4b18-9a67-0551ed13228b" returned: 0 in 0.290s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:38 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-d3f75ab4-7a9f-4868-b4ba-4c4965bb3fdd tempest-VolumesGetTest-855358902 None] <== create_volume: return (1050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:30:38 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-d3f75ab4-7a9f-4868-b4ba-4c4965bb3fdd tempest-VolumesGetTest-855358902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.053s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:30:38 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-d3f75ab4-7a9f-4868-b4ba-4c4965bb3fdd tempest-VolumesGetTest-855358902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33a9a027-bf84-4b43-8026-be593ec97856) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48d1828a-54f2-4b18-9a67-0551ed13228b', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:30:38 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-d3f75ab4-7a9f-4868-b4ba-4c4965bb3fdd tempest-VolumesGetTest-855358902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cf11f5d-0ba6-4f18-99ee-02a293839c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:30:38 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-d3f75ab4-7a9f-4868-b4ba-4c4965bb3fdd tempest-VolumesGetTest-855358902 None] Volume volume-48d1828a-54f2-4b18-9a67-0551ed13228b (48d1828a-54f2-4b18-9a67-0551ed13228b): created successfully
Jul 30 20:30:38 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-d3f75ab4-7a9f-4868-b4ba-4c4965bb3fdd tempest-VolumesGetTest-855358902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cf11f5d-0ba6-4f18-99ee-02a293839c2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:30:38 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-d3f75ab4-7a9f-4868-b4ba-4c4965bb3fdd tempest-VolumesGetTest-855358902 None] Flow 'volume_create_manager' (cdc65adf-39b4-4498-b4ab-6d056baaa7e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:30:38 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-d3f75ab4-7a9f-4868-b4ba-4c4965bb3fdd tempest-VolumesGetTest-855358902 None] Created volume successfully.
Jul 30 20:30:38 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-10632e03-eb30-4250-9f88-f2895c07275b tempest-GroupSnapshotsTest-296266448 None] group_snapshot cc35fdae-9ae7-4c90-bb61-474d270fd94c: deleting
Jul 30 20:30:38 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-10632e03-eb30-4250-9f88-f2895c07275b tempest-GroupSnapshotsTest-296266448 None] group_snapshot cc35fdae-9ae7-4c90-bb61-474d270fd94c: deleting {{(pid=88719) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jul 30 20:30:38 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-10632e03-eb30-4250-9f88-f2895c07275b tempest-GroupSnapshotsTest-296266448 None] Acquiring lock "cinder-quobyte-0b103f9e-78b8-40aa-adee-57742d868c4e" by "delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:30:38 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-10632e03-eb30-4250-9f88-f2895c07275b tempest-GroupSnapshotsTest-296266448 None] Lock "cinder-quobyte-0b103f9e-78b8-40aa-adee-57742d868c4e" acquired by "delete_snapshot" :: waited 0.031s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:30:38 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-10632e03-eb30-4250-9f88-f2895c07275b tempest-GroupSnapshotsTest-296266448 None] Acquiring lock "cinder-quobyte-37dba467-9e41-48bd-b419-5e41eaefec7d" by "_delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:30:38 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-10632e03-eb30-4250-9f88-f2895c07275b tempest-GroupSnapshotsTest-296266448 None] Lock "cinder-quobyte-37dba467-9e41-48bd-b419-5e41eaefec7d" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:30:38 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-10632e03-eb30-4250-9f88-f2895c07275b tempest-GroupSnapshotsTest-296266448 None] Deleting offline snapshot 37dba467-9e41-48bd-b419-5e41eaefec7d of volume 0b103f9e-78b8-40aa-adee-57742d868c4e {{(pid=88719) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 30 20:30:38 devstack sudo[99075]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:38 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-10632e03-eb30-4250-9f88-f2895c07275b tempest-GroupSnapshotsTest-296266448 None] snapshot_file for this snap is: volume-0b103f9e-78b8-40aa-adee-57742d868c4e.37dba467-9e41-48bd-b419-5e41eaefec7d {{(pid=88719) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 30 20:30:38 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-82b0a543-9b78-41df-8dd1-a1ad55bfd1dc tempest-VolumesDeleteCascade-438274212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b5114076-2d30-417c-b0e6-98dc4caceb53" returned: 0 in 0.496s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:38 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d27d26a-e4dc-45bf-902d-00bd63c95068]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:30:38 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-10632e03-eb30-4250-9f88-f2895c07275b tempest-GroupSnapshotsTest-296266448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0b103f9e-78b8-40aa-adee-57742d868c4e.37dba467-9e41-48bd-b419-5e41eaefec7d {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:38 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-82b0a543-9b78-41df-8dd1-a1ad55bfd1dc tempest-VolumesDeleteCascade-438274212 None] Lock "cinder-quobyte-b5114076-2d30-417c-b0e6-98dc4caceb53" released by "delete_volume" :: held 1.167s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:30:38 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-82b0a543-9b78-41df-8dd1-a1ad55bfd1dc tempest-VolumesDeleteCascade-438274212 None] Created reservations ['ddb5a64b-b0c9-45ba-bfab-eb1e64b1c34b', 'c94905f8-6a14-4331-9071-a202cbef45b6', '9d966481-606f-448d-a7af-b60772763252', '779eaa15-d4d8-48fe-88f1-812ef9bd2095'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:30:38 devstack sudo[99079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0b103f9e-78b8-40aa-adee-57742d868c4e.37dba467-9e41-48bd-b419-5e41eaefec7d
Jul 30 20:30:38 devstack sudo[99079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:38 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-8eedfdd7-f6e1-4a0e-90c3-b46a50fb84b2 tempest-VolumesActionsTest-1221656799 None] Acquiring lock "cinder-2246a04e-ffb2-4da5-80e1-68fdc8d88bc4" by "attach_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:30:38 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-8eedfdd7-f6e1-4a0e-90c3-b46a50fb84b2 tempest-VolumesActionsTest-1221656799 None] Lock "cinder-2246a04e-ffb2-4da5-80e1-68fdc8d88bc4" acquired by "attach_volume" :: waited 0.072s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:30:38 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-82b0a543-9b78-41df-8dd1-a1ad55bfd1dc tempest-VolumesDeleteCascade-438274212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:30:38 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-82b0a543-9b78-41df-8dd1-a1ad55bfd1dc tempest-VolumesDeleteCascade-438274212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:30:38 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-82b0a543-9b78-41df-8dd1-a1ad55bfd1dc tempest-VolumesDeleteCascade-438274212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:30:38 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-82b0a543-9b78-41df-8dd1-a1ad55bfd1dc tempest-VolumesDeleteCascade-438274212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:30:38 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-82b0a543-9b78-41df-8dd1-a1ad55bfd1dc tempest-VolumesDeleteCascade-438274212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:30:38 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-82b0a543-9b78-41df-8dd1-a1ad55bfd1dc tempest-VolumesDeleteCascade-438274212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:39 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-8eedfdd7-f6e1-4a0e-90c3-b46a50fb84b2 tempest-VolumesActionsTest-1221656799 None] Attaching volume 2246a04e-ffb2-4da5-80e1-68fdc8d88bc4 to instance ed26818b-27f1-427c-b36f-72ccfdd6955c at mountpoint /dev/vdb on host None.
Jul 30 20:30:39 devstack sudo[99081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:30:39 devstack sudo[99081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:39 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-8eedfdd7-f6e1-4a0e-90c3-b46a50fb84b2 tempest-VolumesActionsTest-1221656799 None] Attach volume completed successfully.
Jul 30 20:30:39 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-8eedfdd7-f6e1-4a0e-90c3-b46a50fb84b2 tempest-VolumesActionsTest-1221656799 None] Lock "cinder-2246a04e-ffb2-4da5-80e1-68fdc8d88bc4" released by "attach_volume" :: held 0.248s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:30:39 devstack sudo[99079]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:39 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-10632e03-eb30-4250-9f88-f2895c07275b tempest-GroupSnapshotsTest-296266448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0b103f9e-78b8-40aa-adee-57742d868c4e.37dba467-9e41-48bd-b419-5e41eaefec7d" returned: 0 in 0.578s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:39 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-10632e03-eb30-4250-9f88-f2895c07275b tempest-GroupSnapshotsTest-296266448 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0b103f9e-78b8-40aa-adee-57742d868c4e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88719) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 30 20:30:39 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f17d677-a03b-446b-b0fe-e3164a9b770d]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:30:39 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-10632e03-eb30-4250-9f88-f2895c07275b tempest-GroupSnapshotsTest-296266448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0b103f9e-78b8-40aa-adee-57742d868c4e {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:39 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-49318c55-3a48-4b38-9d76-db20aa9ad5ce tempest-VolumesActionsTest-1221656799 None] Acquiring lock "cinder-2246a04e-ffb2-4da5-80e1-68fdc8d88bc4-detach_volume" by "detach_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:30:39 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-74361960-8636-48b0-a100-cc4224779e8d tempest-VolumesGetTest-855358902 None] Acquiring lock "cinder-48d1828a-54f2-4b18-9a67-0551ed13228b-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:30:39 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-74361960-8636-48b0-a100-cc4224779e8d tempest-VolumesGetTest-855358902 None] Lock "cinder-48d1828a-54f2-4b18-9a67-0551ed13228b-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:30:39 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-49318c55-3a48-4b38-9d76-db20aa9ad5ce tempest-VolumesActionsTest-1221656799 None] Lock "cinder-2246a04e-ffb2-4da5-80e1-68fdc8d88bc4-detach_volume" acquired by "detach_volume" :: waited 0.083s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:30:39 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-49318c55-3a48-4b38-9d76-db20aa9ad5ce tempest-VolumesActionsTest-1221656799 None] Detaching volume 2246a04e-ffb2-4da5-80e1-68fdc8d88bc4 from instance ed26818b-27f1-427c-b36f-72ccfdd6955c.
Jul 30 20:30:39 devstack sudo[99086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0b103f9e-78b8-40aa-adee-57742d868c4e
Jul 30 20:30:39 devstack sudo[99086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:39 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-74361960-8636-48b0-a100-cc4224779e8d tempest-VolumesGetTest-855358902 None] Acquiring lock "cinder-quobyte-48d1828a-54f2-4b18-9a67-0551ed13228b" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:30:39 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-74361960-8636-48b0-a100-cc4224779e8d tempest-VolumesGetTest-855358902 None] Lock "cinder-quobyte-48d1828a-54f2-4b18-9a67-0551ed13228b" acquired by "delete_volume" :: waited 0.041s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:30:39 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-49318c55-3a48-4b38-9d76-db20aa9ad5ce tempest-VolumesActionsTest-1221656799 None] Detach volume completed successfully.
Jul 30 20:30:39 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e465ef3-4af9-4c35-b5fd-1840aef06521]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:30:39 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-74361960-8636-48b0-a100-cc4224779e8d tempest-VolumesGetTest-855358902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-48d1828a-54f2-4b18-9a67-0551ed13228b {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:39 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-49318c55-3a48-4b38-9d76-db20aa9ad5ce tempest-VolumesActionsTest-1221656799 None] Lock "cinder-2246a04e-ffb2-4da5-80e1-68fdc8d88bc4-detach_volume" released by "detach_volume" :: held 0.218s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:30:39 devstack sudo[99081]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:39 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-82b0a543-9b78-41df-8dd1-a1ad55bfd1dc tempest-VolumesDeleteCascade-438274212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.666s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:39 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-82b0a543-9b78-41df-8dd1-a1ad55bfd1dc tempest-VolumesDeleteCascade-438274212 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:30:39 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-82b0a543-9b78-41df-8dd1-a1ad55bfd1dc tempest-VolumesDeleteCascade-438274212 None] Deleted volume successfully.
Jul 30 20:30:39 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-82b0a543-9b78-41df-8dd1-a1ad55bfd1dc tempest-VolumesDeleteCascade-438274212 None] Lock "cinder-b5114076-2d30-417c-b0e6-98dc4caceb53-delete_volume" released by "delete_volume" :: held 8.994s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:30:39 devstack sudo[99089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-48d1828a-54f2-4b18-9a67-0551ed13228b
Jul 30 20:30:39 devstack sudo[99089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:39 devstack sudo[99086]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:39 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-10632e03-eb30-4250-9f88-f2895c07275b tempest-GroupSnapshotsTest-296266448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0b103f9e-78b8-40aa-adee-57742d868c4e" returned: 0 in 0.656s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:39 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-10632e03-eb30-4250-9f88-f2895c07275b tempest-GroupSnapshotsTest-296266448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0b103f9e-78b8-40aa-adee-57742d868c4e.37dba467-9e41-48bd-b419-5e41eaefec7d {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:39 devstack sudo[99095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0b103f9e-78b8-40aa-adee-57742d868c4e.37dba467-9e41-48bd-b419-5e41eaefec7d
Jul 30 20:30:39 devstack sudo[99095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:40 devstack sudo[99089]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:40 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-74361960-8636-48b0-a100-cc4224779e8d tempest-VolumesGetTest-855358902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-48d1828a-54f2-4b18-9a67-0551ed13228b" returned: 0 in 0.610s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:40 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-74361960-8636-48b0-a100-cc4224779e8d tempest-VolumesGetTest-855358902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-48d1828a-54f2-4b18-9a67-0551ed13228b {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:40 devstack sudo[99102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-48d1828a-54f2-4b18-9a67-0551ed13228b
Jul 30 20:30:40 devstack sudo[99102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:40 devstack sudo[99102]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:40 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-74361960-8636-48b0-a100-cc4224779e8d tempest-VolumesGetTest-855358902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-48d1828a-54f2-4b18-9a67-0551ed13228b" returned: 0 in 0.350s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:40 devstack sudo[99095]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:40 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-10632e03-eb30-4250-9f88-f2895c07275b tempest-GroupSnapshotsTest-296266448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0b103f9e-78b8-40aa-adee-57742d868c4e.37dba467-9e41-48bd-b419-5e41eaefec7d" returned: 0 in 0.641s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:40 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-10632e03-eb30-4250-9f88-f2895c07275b tempest-GroupSnapshotsTest-296266448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0b103f9e-78b8-40aa-adee-57742d868c4e.37dba467-9e41-48bd-b419-5e41eaefec7d {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:40 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-74361960-8636-48b0-a100-cc4224779e8d tempest-VolumesGetTest-855358902 None] Lock "cinder-quobyte-48d1828a-54f2-4b18-9a67-0551ed13228b" released by "delete_volume" :: held 1.049s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:30:40 devstack cinder-volume[88719]: DEBUG dbcounter [-] [88719] Writing DB stats cinder:UPDATE=197,cinder:INSERT=53,cinder:DELETE=15,cinder:SELECT=176 {{(pid=88719) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 30 20:30:40 devstack sudo[99115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0b103f9e-78b8-40aa-adee-57742d868c4e.37dba467-9e41-48bd-b419-5e41eaefec7d
Jul 30 20:30:40 devstack sudo[99115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:40 devstack cinder-volume[88719]: DEBUG dbcounter [-] [88719] Writing DB stats cinder:SELECT=178,cinder:UPDATE=198,cinder:INSERT=51,cinder:DELETE=13 {{(pid=88719) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 30 20:30:40 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-51fb96a4-9a76-4852-b2ce-f3a2f88130ab tempest-VolumesDeleteCascade-438274212 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:30:40 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-51fb96a4-9a76-4852-b2ce-f3a2f88130ab tempest-VolumesDeleteCascade-438274212 None] Flow 'volume_create_manager' (619b59d9-75dc-492a-a206-928fdc1ef7ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:30:40 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-51fb96a4-9a76-4852-b2ce-f3a2f88130ab tempest-VolumesDeleteCascade-438274212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d5cc7c8-d8fd-4f20-93c9-042a940b4c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:30:40 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-51fb96a4-9a76-4852-b2ce-f3a2f88130ab tempest-VolumesDeleteCascade-438274212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d5cc7c8-d8fd-4f20-93c9-042a940b4c9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:30:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1981468070',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0c1768a-1a8c-47f4-8a26-fe0e4fc69519,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec939d2f3e854a7d8479d12e4c5984ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:30:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:30:41Z,use_quota=True,user_id='6336fb776b644caeac64c0cf9b4da35a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:30:40 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-51fb96a4-9a76-4852-b2ce-f3a2f88130ab tempest-VolumesDeleteCascade-438274212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (011c181a-7c7f-41f3-afe9-1a8f24789cca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:30:40 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-51fb96a4-9a76-4852-b2ce-f3a2f88130ab tempest-VolumesDeleteCascade-438274212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (011c181a-7c7f-41f3-afe9-1a8f24789cca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:30:40 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-51fb96a4-9a76-4852-b2ce-f3a2f88130ab tempest-VolumesDeleteCascade-438274212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a6c094d-b349-46ee-9549-df8313b202c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:30:40 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-51fb96a4-9a76-4852-b2ce-f3a2f88130ab tempest-VolumesDeleteCascade-438274212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a6c094d-b349-46ee-9549-df8313b202c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0c1768a-1a8c-47f4-8a26-fe0e4fc69519', 'volume_name': 'volume-d0c1768a-1a8c-47f4-8a26-fe0e4fc69519', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:30:40 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-51fb96a4-9a76-4852-b2ce-f3a2f88130ab tempest-VolumesDeleteCascade-438274212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3757ae8d-0217-4170-8225-edd2eda38065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:30:40 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-51fb96a4-9a76-4852-b2ce-f3a2f88130ab tempest-VolumesDeleteCascade-438274212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3757ae8d-0217-4170-8225-edd2eda38065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:30:40 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-51fb96a4-9a76-4852-b2ce-f3a2f88130ab tempest-VolumesDeleteCascade-438274212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c26671a-b7f1-4d19-aadf-90b4051f9005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:30:40 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-51fb96a4-9a76-4852-b2ce-f3a2f88130ab tempest-VolumesDeleteCascade-438274212 None] Volume d0c1768a-1a8c-47f4-8a26-fe0e4fc69519: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0c1768a-1a8c-47f4-8a26-fe0e4fc69519', 'volume_size': 1}
Jul 30 20:30:40 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-51fb96a4-9a76-4852-b2ce-f3a2f88130ab tempest-VolumesDeleteCascade-438274212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:30:40 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-51fb96a4-9a76-4852-b2ce-f3a2f88130ab tempest-VolumesDeleteCascade-438274212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:30:40 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-51fb96a4-9a76-4852-b2ce-f3a2f88130ab tempest-VolumesDeleteCascade-438274212 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:30:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1981468070',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0c1768a-1a8c-47f4-8a26-fe0e4fc69519,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec939d2f3e854a7d8479d12e4c5984ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:30:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:30:41Z,use_quota=True,user_id='6336fb776b644caeac64c0cf9b4da35a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:30:40 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-51fb96a4-9a76-4852-b2ce-f3a2f88130ab tempest-VolumesDeleteCascade-438274212 None] Creating volume d0c1768a-1a8c-47f4-8a26-fe0e4fc69519 {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:30:40 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-51fb96a4-9a76-4852-b2ce-f3a2f88130ab tempest-VolumesDeleteCascade-438274212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:30:40 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-51fb96a4-9a76-4852-b2ce-f3a2f88130ab tempest-VolumesDeleteCascade-438274212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:30:40 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-51fb96a4-9a76-4852-b2ce-f3a2f88130ab tempest-VolumesDeleteCascade-438274212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:30:40 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-51fb96a4-9a76-4852-b2ce-f3a2f88130ab tempest-VolumesDeleteCascade-438274212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:30:40 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-51fb96a4-9a76-4852-b2ce-f3a2f88130ab tempest-VolumesDeleteCascade-438274212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:30:40 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-51fb96a4-9a76-4852-b2ce-f3a2f88130ab tempest-VolumesDeleteCascade-438274212 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:30:40 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-51fb96a4-9a76-4852-b2ce-f3a2f88130ab tempest-VolumesDeleteCascade-438274212 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:30:40 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-51fb96a4-9a76-4852-b2ce-f3a2f88130ab tempest-VolumesDeleteCascade-438274212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d0c1768a-1a8c-47f4-8a26-fe0e4fc69519 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:40 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-74361960-8636-48b0-a100-cc4224779e8d tempest-VolumesGetTest-855358902 None] Created reservations ['57db398e-ab98-41da-af89-2e69bf0bbe23', 'b760e410-7c7b-42b7-8442-3414996f0125', 'ab1d6078-0696-490e-9282-4a39505dfc02', 'aa6a0516-55e8-4090-a5e6-70199dfe3789'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:30:40 devstack sudo[99129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d0c1768a-1a8c-47f4-8a26-fe0e4fc69519 1073741824
Jul 30 20:30:40 devstack sudo[99129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:40 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-74361960-8636-48b0-a100-cc4224779e8d tempest-VolumesGetTest-855358902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:30:40 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-74361960-8636-48b0-a100-cc4224779e8d tempest-VolumesGetTest-855358902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:30:40 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-74361960-8636-48b0-a100-cc4224779e8d tempest-VolumesGetTest-855358902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:30:41 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-74361960-8636-48b0-a100-cc4224779e8d tempest-VolumesGetTest-855358902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:30:41 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-74361960-8636-48b0-a100-cc4224779e8d tempest-VolumesGetTest-855358902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:30:41 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-74361960-8636-48b0-a100-cc4224779e8d tempest-VolumesGetTest-855358902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:41 devstack sudo[99115]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:41 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-10632e03-eb30-4250-9f88-f2895c07275b tempest-GroupSnapshotsTest-296266448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0b103f9e-78b8-40aa-adee-57742d868c4e.37dba467-9e41-48bd-b419-5e41eaefec7d" returned: 0 in 0.461s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:41 devstack sudo[99137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:30:41 devstack sudo[99137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:41 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-10632e03-eb30-4250-9f88-f2895c07275b tempest-GroupSnapshotsTest-296266448 None] Lock "cinder-quobyte-37dba467-9e41-48bd-b419-5e41eaefec7d" released by "_delete_snapshot" :: held 2.536s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:30:41 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-10632e03-eb30-4250-9f88-f2895c07275b tempest-GroupSnapshotsTest-296266448 None] Lock "cinder-quobyte-0b103f9e-78b8-40aa-adee-57742d868c4e" released by "delete_snapshot" :: held 2.583s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:30:41 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-10632e03-eb30-4250-9f88-f2895c07275b tempest-GroupSnapshotsTest-296266448 None] Acquiring lock "cinder-quobyte-443ae94e-9a94-4ee8-883b-c4b0216646e5" by "delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:30:41 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-10632e03-eb30-4250-9f88-f2895c07275b tempest-GroupSnapshotsTest-296266448 None] Lock "cinder-quobyte-443ae94e-9a94-4ee8-883b-c4b0216646e5" acquired by "delete_snapshot" :: waited 0.032s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:30:41 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-10632e03-eb30-4250-9f88-f2895c07275b tempest-GroupSnapshotsTest-296266448 None] Acquiring lock "cinder-quobyte-b229a0f9-7a3b-4480-a737-ccb7c27a1e41" by "_delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:30:41 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-10632e03-eb30-4250-9f88-f2895c07275b tempest-GroupSnapshotsTest-296266448 None] Lock "cinder-quobyte-b229a0f9-7a3b-4480-a737-ccb7c27a1e41" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:30:41 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-10632e03-eb30-4250-9f88-f2895c07275b tempest-GroupSnapshotsTest-296266448 None] Deleting offline snapshot b229a0f9-7a3b-4480-a737-ccb7c27a1e41 of volume 443ae94e-9a94-4ee8-883b-c4b0216646e5 {{(pid=88719) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 30 20:30:41 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-10632e03-eb30-4250-9f88-f2895c07275b tempest-GroupSnapshotsTest-296266448 None] snapshot_file for this snap is: volume-443ae94e-9a94-4ee8-883b-c4b0216646e5.b229a0f9-7a3b-4480-a737-ccb7c27a1e41 {{(pid=88719) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 30 20:30:41 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[3844f30d-2a25-439b-bd9a-da53ce673d69]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:30:41 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-10632e03-eb30-4250-9f88-f2895c07275b tempest-GroupSnapshotsTest-296266448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-443ae94e-9a94-4ee8-883b-c4b0216646e5.b229a0f9-7a3b-4480-a737-ccb7c27a1e41 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:41 devstack sudo[99137]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:41 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-74361960-8636-48b0-a100-cc4224779e8d tempest-VolumesGetTest-855358902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.369s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:41 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-74361960-8636-48b0-a100-cc4224779e8d tempest-VolumesGetTest-855358902 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:30:41 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-74361960-8636-48b0-a100-cc4224779e8d tempest-VolumesGetTest-855358902 None] Deleted volume successfully.
Jul 30 20:30:41 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-74361960-8636-48b0-a100-cc4224779e8d tempest-VolumesGetTest-855358902 None] Lock "cinder-48d1828a-54f2-4b18-9a67-0551ed13228b-delete_volume" released by "delete_volume" :: held 2.063s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:30:41 devstack sudo[99142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-443ae94e-9a94-4ee8-883b-c4b0216646e5.b229a0f9-7a3b-4480-a737-ccb7c27a1e41
Jul 30 20:30:41 devstack sudo[99142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:41 devstack sudo[99129]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:41 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-51fb96a4-9a76-4852-b2ce-f3a2f88130ab tempest-VolumesDeleteCascade-438274212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d0c1768a-1a8c-47f4-8a26-fe0e4fc69519 1073741824" returned: 0 in 0.655s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:41 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-51fb96a4-9a76-4852-b2ce-f3a2f88130ab tempest-VolumesDeleteCascade-438274212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d0c1768a-1a8c-47f4-8a26-fe0e4fc69519 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:41 devstack sudo[99146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d0c1768a-1a8c-47f4-8a26-fe0e4fc69519
Jul 30 20:30:41 devstack sudo[99146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:41 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-1c298381-093c-490f-a409-fc6b28ead26f tempest-VolumesGetTest-855358902 None] Acquiring lock "cinder-aa185ce8-d5b0-476a-9af5-9caedec918b5-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:30:41 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-1c298381-093c-490f-a409-fc6b28ead26f tempest-VolumesGetTest-855358902 None] Lock "cinder-aa185ce8-d5b0-476a-9af5-9caedec918b5-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:30:41 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-1c298381-093c-490f-a409-fc6b28ead26f tempest-VolumesGetTest-855358902 None] Acquiring lock "cinder-quobyte-aa185ce8-d5b0-476a-9af5-9caedec918b5" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:30:41 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-1c298381-093c-490f-a409-fc6b28ead26f tempest-VolumesGetTest-855358902 None] Lock "cinder-quobyte-aa185ce8-d5b0-476a-9af5-9caedec918b5" acquired by "delete_volume" :: waited 0.020s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:30:41 devstack sudo[99142]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:41 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-10632e03-eb30-4250-9f88-f2895c07275b tempest-GroupSnapshotsTest-296266448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-443ae94e-9a94-4ee8-883b-c4b0216646e5.b229a0f9-7a3b-4480-a737-ccb7c27a1e41" returned: 0 in 0.747s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:41 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-10632e03-eb30-4250-9f88-f2895c07275b tempest-GroupSnapshotsTest-296266448 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-443ae94e-9a94-4ee8-883b-c4b0216646e5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88719) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 30 20:30:42 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[864acb46-d099-4085-9211-2486960abef4]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:30:42 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-1c298381-093c-490f-a409-fc6b28ead26f tempest-VolumesGetTest-855358902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-aa185ce8-d5b0-476a-9af5-9caedec918b5 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:42 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[993b562f-878e-4e79-88c2-e8a8d392e7ab]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:30:42 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-10632e03-eb30-4250-9f88-f2895c07275b tempest-GroupSnapshotsTest-296266448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-443ae94e-9a94-4ee8-883b-c4b0216646e5 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:42 devstack sudo[99146]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:42 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-51fb96a4-9a76-4852-b2ce-f3a2f88130ab tempest-VolumesDeleteCascade-438274212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d0c1768a-1a8c-47f4-8a26-fe0e4fc69519" returned: 0 in 0.433s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:42 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-51fb96a4-9a76-4852-b2ce-f3a2f88130ab tempest-VolumesDeleteCascade-438274212 None] <== create_volume: return (1185ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:30:42 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-51fb96a4-9a76-4852-b2ce-f3a2f88130ab tempest-VolumesDeleteCascade-438274212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.188s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:30:42 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-51fb96a4-9a76-4852-b2ce-f3a2f88130ab tempest-VolumesDeleteCascade-438274212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c26671a-b7f1-4d19-aadf-90b4051f9005) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0c1768a-1a8c-47f4-8a26-fe0e4fc69519', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:30:42 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-51fb96a4-9a76-4852-b2ce-f3a2f88130ab tempest-VolumesDeleteCascade-438274212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1279e1ba-12e9-4cd0-ba0a-9a277c858d5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:30:42 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-51fb96a4-9a76-4852-b2ce-f3a2f88130ab tempest-VolumesDeleteCascade-438274212 None] Volume volume-d0c1768a-1a8c-47f4-8a26-fe0e4fc69519 (d0c1768a-1a8c-47f4-8a26-fe0e4fc69519): created successfully
Jul 30 20:30:42 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-51fb96a4-9a76-4852-b2ce-f3a2f88130ab tempest-VolumesDeleteCascade-438274212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1279e1ba-12e9-4cd0-ba0a-9a277c858d5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:30:42 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-51fb96a4-9a76-4852-b2ce-f3a2f88130ab tempest-VolumesDeleteCascade-438274212 None] Flow 'volume_create_manager' (619b59d9-75dc-492a-a206-928fdc1ef7ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:30:42 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-51fb96a4-9a76-4852-b2ce-f3a2f88130ab tempest-VolumesDeleteCascade-438274212 None] Created volume successfully.
Jul 30 20:30:42 devstack sudo[99154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-aa185ce8-d5b0-476a-9af5-9caedec918b5
Jul 30 20:30:42 devstack sudo[99154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:42 devstack sudo[99155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-443ae94e-9a94-4ee8-883b-c4b0216646e5
Jul 30 20:30:42 devstack sudo[99155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:42 devstack sudo[99154]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:42 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-1c298381-093c-490f-a409-fc6b28ead26f tempest-VolumesGetTest-855358902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-aa185ce8-d5b0-476a-9af5-9caedec918b5" returned: 0 in 0.412s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:42 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-1c298381-093c-490f-a409-fc6b28ead26f tempest-VolumesGetTest-855358902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-aa185ce8-d5b0-476a-9af5-9caedec918b5 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:42 devstack sudo[99164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-aa185ce8-d5b0-476a-9af5-9caedec918b5
Jul 30 20:30:42 devstack sudo[99164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:42 devstack sudo[99155]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:42 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-10632e03-eb30-4250-9f88-f2895c07275b tempest-GroupSnapshotsTest-296266448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-443ae94e-9a94-4ee8-883b-c4b0216646e5" returned: 0 in 0.443s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:42 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-10632e03-eb30-4250-9f88-f2895c07275b tempest-GroupSnapshotsTest-296266448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-443ae94e-9a94-4ee8-883b-c4b0216646e5.b229a0f9-7a3b-4480-a737-ccb7c27a1e41 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:42 devstack sudo[99166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-443ae94e-9a94-4ee8-883b-c4b0216646e5.b229a0f9-7a3b-4480-a737-ccb7c27a1e41
Jul 30 20:30:42 devstack sudo[99166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:42 devstack sudo[99164]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:42 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-1c298381-093c-490f-a409-fc6b28ead26f tempest-VolumesGetTest-855358902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-aa185ce8-d5b0-476a-9af5-9caedec918b5" returned: 0 in 0.255s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:42 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-1c298381-093c-490f-a409-fc6b28ead26f tempest-VolumesGetTest-855358902 None] Lock "cinder-quobyte-aa185ce8-d5b0-476a-9af5-9caedec918b5" released by "delete_volume" :: held 0.723s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:30:42 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-1c298381-093c-490f-a409-fc6b28ead26f tempest-VolumesGetTest-855358902 None] Created reservations ['d13c40c8-94a3-485b-a1b1-ff7d6030f57d', '82ad9e10-3a7f-4ff2-88f4-6956ba9afe63', '554a8154-ad90-48b3-873e-f0cf7d13502b', '62d9644b-112e-4061-b631-ec7df2bf9a5f'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:30:42 devstack sudo[99166]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:42 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-10632e03-eb30-4250-9f88-f2895c07275b tempest-GroupSnapshotsTest-296266448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-443ae94e-9a94-4ee8-883b-c4b0216646e5.b229a0f9-7a3b-4480-a737-ccb7c27a1e41" returned: 0 in 0.378s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:42 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-10632e03-eb30-4250-9f88-f2895c07275b tempest-GroupSnapshotsTest-296266448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-443ae94e-9a94-4ee8-883b-c4b0216646e5.b229a0f9-7a3b-4480-a737-ccb7c27a1e41 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:42 devstack sudo[99173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-443ae94e-9a94-4ee8-883b-c4b0216646e5.b229a0f9-7a3b-4480-a737-ccb7c27a1e41
Jul 30 20:30:42 devstack sudo[99173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:42 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-1c298381-093c-490f-a409-fc6b28ead26f tempest-VolumesGetTest-855358902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:30:42 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-1c298381-093c-490f-a409-fc6b28ead26f tempest-VolumesGetTest-855358902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:30:42 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-1c298381-093c-490f-a409-fc6b28ead26f tempest-VolumesGetTest-855358902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:30:42 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-1c298381-093c-490f-a409-fc6b28ead26f tempest-VolumesGetTest-855358902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:30:42 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-1c298381-093c-490f-a409-fc6b28ead26f tempest-VolumesGetTest-855358902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:30:42 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-1c298381-093c-490f-a409-fc6b28ead26f tempest-VolumesGetTest-855358902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:42 devstack sudo[99175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:30:42 devstack sudo[99175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:43 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-65d63425-0e3b-4bbe-9fe0-c26e0bb2297a tempest-VolumesDeleteCascade-438274212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:30:43 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-65d63425-0e3b-4bbe-9fe0-c26e0bb2297a tempest-VolumesDeleteCascade-438274212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:30:43 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-65d63425-0e3b-4bbe-9fe0-c26e0bb2297a tempest-VolumesDeleteCascade-438274212 None] Creating offline snapshot f71de75d-f21c-4acf-8d98-da3e9af97334 of volume d0c1768a-1a8c-47f4-8a26-fe0e4fc69519 {{(pid=88719) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 30 20:30:43 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[478ed316-72fa-4ea9-a904-f0ba761c91c7]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:30:43 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-65d63425-0e3b-4bbe-9fe0-c26e0bb2297a tempest-VolumesDeleteCascade-438274212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d0c1768a-1a8c-47f4-8a26-fe0e4fc69519 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:43 devstack sudo[99173]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:43 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-10632e03-eb30-4250-9f88-f2895c07275b tempest-GroupSnapshotsTest-296266448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-443ae94e-9a94-4ee8-883b-c4b0216646e5.b229a0f9-7a3b-4480-a737-ccb7c27a1e41" returned: 0 in 0.365s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:43 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-10632e03-eb30-4250-9f88-f2895c07275b tempest-GroupSnapshotsTest-296266448 None] Lock "cinder-quobyte-b229a0f9-7a3b-4480-a737-ccb7c27a1e41" released by "_delete_snapshot" :: held 2.077s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:30:43 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-10632e03-eb30-4250-9f88-f2895c07275b tempest-GroupSnapshotsTest-296266448 None] Lock "cinder-quobyte-443ae94e-9a94-4ee8-883b-c4b0216646e5" released by "delete_snapshot" :: held 2.122s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:30:43 devstack sudo[99175]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:43 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-1c298381-093c-490f-a409-fc6b28ead26f tempest-VolumesGetTest-855358902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.373s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:43 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-1c298381-093c-490f-a409-fc6b28ead26f tempest-VolumesGetTest-855358902 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:30:43 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-1c298381-093c-490f-a409-fc6b28ead26f tempest-VolumesGetTest-855358902 None] Deleted volume successfully.
Jul 30 20:30:43 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-1c298381-093c-490f-a409-fc6b28ead26f tempest-VolumesGetTest-855358902 None] Lock "cinder-aa185ce8-d5b0-476a-9af5-9caedec918b5-delete_volume" released by "delete_volume" :: held 1.458s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:30:43 devstack sudo[99178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d0c1768a-1a8c-47f4-8a26-fe0e4fc69519
Jul 30 20:30:43 devstack sudo[99178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:43 devstack cinder-volume[88719]: WARNING cinder.quota [None req-10632e03-eb30-4250-9f88-f2895c07275b tempest-GroupSnapshotsTest-296266448 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1504696967 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1504696967, it is now deprecated. Please use the default quota class for default quota.
Jul 30 20:30:43 devstack cinder-volume[88719]: WARNING cinder.quota [None req-10632e03-eb30-4250-9f88-f2895c07275b tempest-GroupSnapshotsTest-296266448 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1504696967 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1504696967, it is now deprecated. Please use the default quota class for default quota.
Jul 30 20:30:43 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-10632e03-eb30-4250-9f88-f2895c07275b tempest-GroupSnapshotsTest-296266448 None] Created reservations ['938a9b63-17e6-4027-aa2b-947097d47243', '94b7269e-f02a-4aa2-9c3a-95b774569b51', '7deffea0-43f5-4999-921f-146e8f124fca', '6395c4a6-325b-4d6e-9268-8cdc0e1340a6'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:30:43 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-10632e03-eb30-4250-9f88-f2895c07275b tempest-GroupSnapshotsTest-296266448 None] Created reservations ['bb18e42e-61e7-4916-8595-8dffd459a061', '0fe1a394-995c-40ac-84f6-a48c571f5af6', 'bf0b9c14-c555-4904-b26e-5c3b394662ad', '3ba2f152-276f-4b26-8d49-fb8f9fb2f2f7'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:30:43 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-10632e03-eb30-4250-9f88-f2895c07275b tempest-GroupSnapshotsTest-296266448 None] group_snapshot cc35fdae-9ae7-4c90-bb61-474d270fd94c: deleted successfully
Jul 30 20:30:43 devstack sudo[99178]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:43 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-65d63425-0e3b-4bbe-9fe0-c26e0bb2297a tempest-VolumesDeleteCascade-438274212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d0c1768a-1a8c-47f4-8a26-fe0e4fc69519" returned: 0 in 0.562s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:43 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-65d63425-0e3b-4bbe-9fe0-c26e0bb2297a tempest-VolumesDeleteCascade-438274212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d0c1768a-1a8c-47f4-8a26-fe0e4fc69519,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d0c1768a-1a8c-47f4-8a26-fe0e4fc69519.f71de75d-f21c-4acf-8d98-da3e9af97334 1G {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:43 devstack sudo[99185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d0c1768a-1a8c-47f4-8a26-fe0e4fc69519,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d0c1768a-1a8c-47f4-8a26-fe0e4fc69519.f71de75d-f21c-4acf-8d98-da3e9af97334 1G
Jul 30 20:30:43 devstack sudo[99185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:43 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-1176dbb0-d1d5-430b-94b6-2e2340dfc5e7 tempest-VolumesGetTest-855358902 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:30:43 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-1176dbb0-d1d5-430b-94b6-2e2340dfc5e7 tempest-VolumesGetTest-855358902 None] Flow 'volume_create_manager' (f5b66be1-d538-446a-906c-c7d4ad94b640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:30:43 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-1176dbb0-d1d5-430b-94b6-2e2340dfc5e7 tempest-VolumesGetTest-855358902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67780919-73c0-4e21-a439-70db327b5c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:30:43 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-1176dbb0-d1d5-430b-94b6-2e2340dfc5e7 tempest-VolumesGetTest-855358902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67780919-73c0-4e21-a439-70db327b5c74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:30:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1398690424',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=929878c3-5ccc-4334-926f-2fa20a0c305d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95dc6a3a598a411dbd7b034cb48fcbb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:30:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:30:44Z,use_quota=True,user_id='e1274cdacdf54e3fbb200f3552412b74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:30:43 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-1176dbb0-d1d5-430b-94b6-2e2340dfc5e7 tempest-VolumesGetTest-855358902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e59585a-11ed-4821-8c03-94e627a4c66b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:30:43 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-1176dbb0-d1d5-430b-94b6-2e2340dfc5e7 tempest-VolumesGetTest-855358902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e59585a-11ed-4821-8c03-94e627a4c66b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:30:43 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-1176dbb0-d1d5-430b-94b6-2e2340dfc5e7 tempest-VolumesGetTest-855358902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92810496-5ae1-4bf7-b961-b1358dc77040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:30:43 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-1176dbb0-d1d5-430b-94b6-2e2340dfc5e7 tempest-VolumesGetTest-855358902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92810496-5ae1-4bf7-b961-b1358dc77040) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '929878c3-5ccc-4334-926f-2fa20a0c305d', 'volume_name': 'volume-929878c3-5ccc-4334-926f-2fa20a0c305d', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:30:43 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-1176dbb0-d1d5-430b-94b6-2e2340dfc5e7 tempest-VolumesGetTest-855358902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e799f97c-b92f-4bc1-b8b1-9c83c05acb08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:30:43 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-1176dbb0-d1d5-430b-94b6-2e2340dfc5e7 tempest-VolumesGetTest-855358902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e799f97c-b92f-4bc1-b8b1-9c83c05acb08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:30:43 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-1176dbb0-d1d5-430b-94b6-2e2340dfc5e7 tempest-VolumesGetTest-855358902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ecf2cb0-2841-4f17-828c-483d9ccf58fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:30:43 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-1176dbb0-d1d5-430b-94b6-2e2340dfc5e7 tempest-VolumesGetTest-855358902 None] Volume 929878c3-5ccc-4334-926f-2fa20a0c305d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-929878c3-5ccc-4334-926f-2fa20a0c305d', 'volume_size': 1}
Jul 30 20:30:43 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-1176dbb0-d1d5-430b-94b6-2e2340dfc5e7 tempest-VolumesGetTest-855358902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:30:44 devstack sudo[99185]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:44 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-65d63425-0e3b-4bbe-9fe0-c26e0bb2297a tempest-VolumesDeleteCascade-438274212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d0c1768a-1a8c-47f4-8a26-fe0e4fc69519,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d0c1768a-1a8c-47f4-8a26-fe0e4fc69519.f71de75d-f21c-4acf-8d98-da3e9af97334 1G" returned: 0 in 0.489s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:44 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-65d63425-0e3b-4bbe-9fe0-c26e0bb2297a tempest-VolumesDeleteCascade-438274212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0c1768a-1a8c-47f4-8a26-fe0e4fc69519 -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d0c1768a-1a8c-47f4-8a26-fe0e4fc69519.f71de75d-f21c-4acf-8d98-da3e9af97334 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:44 devstack sudo[99194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0c1768a-1a8c-47f4-8a26-fe0e4fc69519 -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d0c1768a-1a8c-47f4-8a26-fe0e4fc69519.f71de75d-f21c-4acf-8d98-da3e9af97334
Jul 30 20:30:44 devstack sudo[99194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:44 devstack sudo[99194]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:44 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-65d63425-0e3b-4bbe-9fe0-c26e0bb2297a tempest-VolumesDeleteCascade-438274212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0c1768a-1a8c-47f4-8a26-fe0e4fc69519 -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d0c1768a-1a8c-47f4-8a26-fe0e4fc69519.f71de75d-f21c-4acf-8d98-da3e9af97334" returned: 0 in 0.345s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:44 devstack cinder-volume[88719]: WARNING cinder.volume.drivers.remotefs [None req-65d63425-0e3b-4bbe-9fe0-c26e0bb2297a tempest-VolumesDeleteCascade-438274212 None] /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d0c1768a-1a8c-47f4-8a26-fe0e4fc69519.f71de75d-f21c-4acf-8d98-da3e9af97334 is being set with open permissions: ugo+rw
Jul 30 20:30:44 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-65d63425-0e3b-4bbe-9fe0-c26e0bb2297a tempest-VolumesDeleteCascade-438274212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d0c1768a-1a8c-47f4-8a26-fe0e4fc69519.f71de75d-f21c-4acf-8d98-da3e9af97334 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:44 devstack sudo[99204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d0c1768a-1a8c-47f4-8a26-fe0e4fc69519.f71de75d-f21c-4acf-8d98-da3e9af97334
Jul 30 20:30:44 devstack sudo[99204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:44 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-41820daa-ea45-4447-8f29-f611625d01d4 tempest-GroupSnapshotsTest-296266448 None] Acquiring lock "cinder-quobyte-0b103f9e-78b8-40aa-adee-57742d868c4e" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:30:44 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-41820daa-ea45-4447-8f29-f611625d01d4 tempest-GroupSnapshotsTest-296266448 None] Lock "cinder-quobyte-0b103f9e-78b8-40aa-adee-57742d868c4e" acquired by "delete_volume" :: waited 0.022s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:30:44 devstack sudo[99204]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:44 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-65d63425-0e3b-4bbe-9fe0-c26e0bb2297a tempest-VolumesDeleteCascade-438274212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d0c1768a-1a8c-47f4-8a26-fe0e4fc69519.f71de75d-f21c-4acf-8d98-da3e9af97334" returned: 0 in 0.348s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:44 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[f161ddef-7eeb-43cf-9c33-5fef5cfd68a2]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:30:44 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-41820daa-ea45-4447-8f29-f611625d01d4 tempest-GroupSnapshotsTest-296266448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0b103f9e-78b8-40aa-adee-57742d868c4e {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:44 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-65d63425-0e3b-4bbe-9fe0-c26e0bb2297a tempest-VolumesDeleteCascade-438274212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d0c1768a-1a8c-47f4-8a26-fe0e4fc69519.info {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:44 devstack sudo[99208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d0c1768a-1a8c-47f4-8a26-fe0e4fc69519.info
Jul 30 20:30:44 devstack sudo[99208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:45 devstack sudo[99207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0b103f9e-78b8-40aa-adee-57742d868c4e
Jul 30 20:30:45 devstack sudo[99207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:45 devstack sudo[99208]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:45 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-65d63425-0e3b-4bbe-9fe0-c26e0bb2297a tempest-VolumesDeleteCascade-438274212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d0c1768a-1a8c-47f4-8a26-fe0e4fc69519.info" returned: 0 in 0.327s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:45 devstack cinder-volume[88719]: WARNING cinder.volume.drivers.remotefs [None req-65d63425-0e3b-4bbe-9fe0-c26e0bb2297a tempest-VolumesDeleteCascade-438274212 None] /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d0c1768a-1a8c-47f4-8a26-fe0e4fc69519.info is being set with open permissions: ugo+rw
Jul 30 20:30:45 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-65d63425-0e3b-4bbe-9fe0-c26e0bb2297a tempest-VolumesDeleteCascade-438274212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d0c1768a-1a8c-47f4-8a26-fe0e4fc69519.info {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:45 devstack sudo[99214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d0c1768a-1a8c-47f4-8a26-fe0e4fc69519.info
Jul 30 20:30:45 devstack sudo[99214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:45 devstack sudo[99207]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:45 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-41820daa-ea45-4447-8f29-f611625d01d4 tempest-GroupSnapshotsTest-296266448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0b103f9e-78b8-40aa-adee-57742d868c4e" returned: 0 in 0.485s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:45 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-41820daa-ea45-4447-8f29-f611625d01d4 tempest-GroupSnapshotsTest-296266448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0b103f9e-78b8-40aa-adee-57742d868c4e {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:45 devstack sudo[99217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0b103f9e-78b8-40aa-adee-57742d868c4e
Jul 30 20:30:45 devstack sudo[99217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:45 devstack sudo[99214]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:45 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-65d63425-0e3b-4bbe-9fe0-c26e0bb2297a tempest-VolumesDeleteCascade-438274212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d0c1768a-1a8c-47f4-8a26-fe0e4fc69519.info" returned: 0 in 0.286s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:45 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-65d63425-0e3b-4bbe-9fe0-c26e0bb2297a tempest-VolumesDeleteCascade-438274212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.522s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:30:45 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-1176dbb0-d1d5-430b-94b6-2e2340dfc5e7 tempest-VolumesGetTest-855358902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.753s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:30:45 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-1176dbb0-d1d5-430b-94b6-2e2340dfc5e7 tempest-VolumesGetTest-855358902 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:30:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1398690424',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=929878c3-5ccc-4334-926f-2fa20a0c305d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95dc6a3a598a411dbd7b034cb48fcbb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:30:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:30:44Z,use_quota=True,user_id='e1274cdacdf54e3fbb200f3552412b74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:30:45 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-1176dbb0-d1d5-430b-94b6-2e2340dfc5e7 tempest-VolumesGetTest-855358902 None] Creating volume 929878c3-5ccc-4334-926f-2fa20a0c305d {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:30:45 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-1176dbb0-d1d5-430b-94b6-2e2340dfc5e7 tempest-VolumesGetTest-855358902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:30:45 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-1176dbb0-d1d5-430b-94b6-2e2340dfc5e7 tempest-VolumesGetTest-855358902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:30:45 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-1176dbb0-d1d5-430b-94b6-2e2340dfc5e7 tempest-VolumesGetTest-855358902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:30:45 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-1176dbb0-d1d5-430b-94b6-2e2340dfc5e7 tempest-VolumesGetTest-855358902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:30:45 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-1176dbb0-d1d5-430b-94b6-2e2340dfc5e7 tempest-VolumesGetTest-855358902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:30:45 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-1176dbb0-d1d5-430b-94b6-2e2340dfc5e7 tempest-VolumesGetTest-855358902 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:30:45 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-1176dbb0-d1d5-430b-94b6-2e2340dfc5e7 tempest-VolumesGetTest-855358902 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:30:45 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-1176dbb0-d1d5-430b-94b6-2e2340dfc5e7 tempest-VolumesGetTest-855358902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-929878c3-5ccc-4334-926f-2fa20a0c305d 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:45 devstack sudo[99223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-929878c3-5ccc-4334-926f-2fa20a0c305d 1073741824
Jul 30 20:30:45 devstack sudo[99223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:45 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-65d63425-0e3b-4bbe-9fe0-c26e0bb2297a tempest-VolumesDeleteCascade-438274212 None] Create snapshot completed successfully
Jul 30 20:30:45 devstack sudo[99217]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:45 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-41820daa-ea45-4447-8f29-f611625d01d4 tempest-GroupSnapshotsTest-296266448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0b103f9e-78b8-40aa-adee-57742d868c4e" returned: 0 in 0.339s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:45 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-41820daa-ea45-4447-8f29-f611625d01d4 tempest-GroupSnapshotsTest-296266448 None] Lock "cinder-quobyte-0b103f9e-78b8-40aa-adee-57742d868c4e" released by "delete_volume" :: held 0.929s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:30:45 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-41820daa-ea45-4447-8f29-f611625d01d4 tempest-GroupSnapshotsTest-296266448 None] Acquiring lock "cinder-quobyte-443ae94e-9a94-4ee8-883b-c4b0216646e5" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:30:45 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-41820daa-ea45-4447-8f29-f611625d01d4 tempest-GroupSnapshotsTest-296266448 None] Lock "cinder-quobyte-443ae94e-9a94-4ee8-883b-c4b0216646e5" acquired by "delete_volume" :: waited 0.019s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:30:45 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[94f5d642-cefa-4d0f-a8d7-cf23714a571b]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:30:45 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-41820daa-ea45-4447-8f29-f611625d01d4 tempest-GroupSnapshotsTest-296266448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-443ae94e-9a94-4ee8-883b-c4b0216646e5 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:45 devstack sudo[99229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-443ae94e-9a94-4ee8-883b-c4b0216646e5
Jul 30 20:30:45 devstack sudo[99229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:46 devstack sudo[99223]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:46 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-1176dbb0-d1d5-430b-94b6-2e2340dfc5e7 tempest-VolumesGetTest-855358902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-929878c3-5ccc-4334-926f-2fa20a0c305d 1073741824" returned: 0 in 0.681s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:46 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-1176dbb0-d1d5-430b-94b6-2e2340dfc5e7 tempest-VolumesGetTest-855358902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-929878c3-5ccc-4334-926f-2fa20a0c305d {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:46 devstack sudo[99245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-929878c3-5ccc-4334-926f-2fa20a0c305d
Jul 30 20:30:46 devstack sudo[99245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:46 devstack sudo[99229]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:46 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-41820daa-ea45-4447-8f29-f611625d01d4 tempest-GroupSnapshotsTest-296266448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-443ae94e-9a94-4ee8-883b-c4b0216646e5" returned: 0 in 0.609s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:46 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-41820daa-ea45-4447-8f29-f611625d01d4 tempest-GroupSnapshotsTest-296266448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-443ae94e-9a94-4ee8-883b-c4b0216646e5 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:46 devstack sudo[99247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-443ae94e-9a94-4ee8-883b-c4b0216646e5
Jul 30 20:30:46 devstack sudo[99247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:46 devstack sudo[99245]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:46 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-1176dbb0-d1d5-430b-94b6-2e2340dfc5e7 tempest-VolumesGetTest-855358902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-929878c3-5ccc-4334-926f-2fa20a0c305d" returned: 0 in 0.386s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:46 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-1176dbb0-d1d5-430b-94b6-2e2340dfc5e7 tempest-VolumesGetTest-855358902 None] <== create_volume: return (1131ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:30:46 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-1176dbb0-d1d5-430b-94b6-2e2340dfc5e7 tempest-VolumesGetTest-855358902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.142s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:30:46 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-1176dbb0-d1d5-430b-94b6-2e2340dfc5e7 tempest-VolumesGetTest-855358902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ecf2cb0-2841-4f17-828c-483d9ccf58fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-929878c3-5ccc-4334-926f-2fa20a0c305d', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:30:46 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-1176dbb0-d1d5-430b-94b6-2e2340dfc5e7 tempest-VolumesGetTest-855358902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a4f4d50-82af-4ea9-9625-c5dcba2f33ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:30:46 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-1176dbb0-d1d5-430b-94b6-2e2340dfc5e7 tempest-VolumesGetTest-855358902 None] Volume volume-929878c3-5ccc-4334-926f-2fa20a0c305d (929878c3-5ccc-4334-926f-2fa20a0c305d): created successfully
Jul 30 20:30:46 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-1176dbb0-d1d5-430b-94b6-2e2340dfc5e7 tempest-VolumesGetTest-855358902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a4f4d50-82af-4ea9-9625-c5dcba2f33ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:30:46 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-1176dbb0-d1d5-430b-94b6-2e2340dfc5e7 tempest-VolumesGetTest-855358902 None] Flow 'volume_create_manager' (f5b66be1-d538-446a-906c-c7d4ad94b640) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:30:46 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-1176dbb0-d1d5-430b-94b6-2e2340dfc5e7 tempest-VolumesGetTest-855358902 None] Created volume successfully.
Jul 30 20:30:46 devstack sudo[99247]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:46 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-41820daa-ea45-4447-8f29-f611625d01d4 tempest-GroupSnapshotsTest-296266448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-443ae94e-9a94-4ee8-883b-c4b0216646e5" returned: 0 in 0.472s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:46 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-41820daa-ea45-4447-8f29-f611625d01d4 tempest-GroupSnapshotsTest-296266448 None] Lock "cinder-quobyte-443ae94e-9a94-4ee8-883b-c4b0216646e5" released by "delete_volume" :: held 1.156s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:30:47 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4f329de-e0aa-4f7d-b4a0-7eacb43f790d tempest-VolumesDeleteCascade-438274212 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:30:47 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-41820daa-ea45-4447-8f29-f611625d01d4 tempest-GroupSnapshotsTest-296266448 None] Created reservations ['529e5314-40a8-4229-a83d-6b14e584481a'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:30:47 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-a4f329de-e0aa-4f7d-b4a0-7eacb43f790d tempest-VolumesDeleteCascade-438274212 None] Flow 'volume_create_manager' (aeadca75-5b24-480b-b4c5-c54f41a45ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:30:47 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-a4f329de-e0aa-4f7d-b4a0-7eacb43f790d tempest-VolumesDeleteCascade-438274212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ddec37b-e2fb-4610-bf57-7cdbc9557fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:30:47 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-a4f329de-e0aa-4f7d-b4a0-7eacb43f790d tempest-VolumesDeleteCascade-438274212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ddec37b-e2fb-4610-bf57-7cdbc9557fb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:30:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-3491809',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cd261e6-5a4f-49b3-bbc1-e35d2d206a77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec939d2f3e854a7d8479d12e4c5984ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:30:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f71de75d-f21c-4acf-8d98-da3e9af97334,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:30:47Z,use_quota=True,user_id='6336fb776b644caeac64c0cf9b4da35a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:30:47 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-a4f329de-e0aa-4f7d-b4a0-7eacb43f790d tempest-VolumesDeleteCascade-438274212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f3818a4-7d8b-47d5-944d-feb47adbd0bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:30:47 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-a4f329de-e0aa-4f7d-b4a0-7eacb43f790d tempest-VolumesDeleteCascade-438274212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f3818a4-7d8b-47d5-944d-feb47adbd0bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:30:47 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-a4f329de-e0aa-4f7d-b4a0-7eacb43f790d tempest-VolumesDeleteCascade-438274212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29a59fbc-8628-4f9f-a861-22d89471b06a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:30:47 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-a4f329de-e0aa-4f7d-b4a0-7eacb43f790d tempest-VolumesDeleteCascade-438274212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29a59fbc-8628-4f9f-a861-22d89471b06a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0cd261e6-5a4f-49b3-bbc1-e35d2d206a77', 'volume_name': 'volume-0cd261e6-5a4f-49b3-bbc1-e35d2d206a77', 'volume_size': 1, 'snapshot_id': 'f71de75d-f21c-4acf-8d98-da3e9af97334'}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:30:47 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-a4f329de-e0aa-4f7d-b4a0-7eacb43f790d tempest-VolumesDeleteCascade-438274212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62168204-7e54-4bb9-b6b0-f3dc5fe5ea55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:30:47 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-a4f329de-e0aa-4f7d-b4a0-7eacb43f790d tempest-VolumesDeleteCascade-438274212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62168204-7e54-4bb9-b6b0-f3dc5fe5ea55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:30:47 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-a4f329de-e0aa-4f7d-b4a0-7eacb43f790d tempest-VolumesDeleteCascade-438274212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa33e1d5-24ee-4260-b0e3-83ccf85a8c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:30:47 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-a4f329de-e0aa-4f7d-b4a0-7eacb43f790d tempest-VolumesDeleteCascade-438274212 None] Volume 0cd261e6-5a4f-49b3-bbc1-e35d2d206a77: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0cd261e6-5a4f-49b3-bbc1-e35d2d206a77', 'volume_size': 1, 'snapshot_id': 'f71de75d-f21c-4acf-8d98-da3e9af97334'}
Jul 30 20:30:47 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-a4f329de-e0aa-4f7d-b4a0-7eacb43f790d tempest-VolumesDeleteCascade-438274212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:30:47 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-a4f329de-e0aa-4f7d-b4a0-7eacb43f790d tempest-VolumesDeleteCascade-438274212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:30:47 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-a4f329de-e0aa-4f7d-b4a0-7eacb43f790d tempest-VolumesDeleteCascade-438274212 None] Acquiring lock "cinder-quobyte-f71de75d-f21c-4acf-8d98-da3e9af97334-0cd261e6-5a4f-49b3-bbc1-e35d2d206a77" by "_create_volume_from_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:30:47 devstack cinder-volume[88719]: WARNING cinder.quota [None req-41820daa-ea45-4447-8f29-f611625d01d4 tempest-GroupSnapshotsTest-296266448 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1504696967 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1504696967, it is now deprecated. Please use the default quota class for default quota.
Jul 30 20:30:47 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-a4f329de-e0aa-4f7d-b4a0-7eacb43f790d tempest-VolumesDeleteCascade-438274212 None] Lock "cinder-quobyte-f71de75d-f21c-4acf-8d98-da3e9af97334-0cd261e6-5a4f-49b3-bbc1-e35d2d206a77" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:30:47 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-a4f329de-e0aa-4f7d-b4a0-7eacb43f790d tempest-VolumesDeleteCascade-438274212 None] Creating volume 0cd261e6-5a4f-49b3-bbc1-e35d2d206a77 from snapshot f71de75d-f21c-4acf-8d98-da3e9af97334 {{(pid=88719) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Jul 30 20:30:47 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-a4f329de-e0aa-4f7d-b4a0-7eacb43f790d tempest-VolumesDeleteCascade-438274212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:30:47 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-a4f329de-e0aa-4f7d-b4a0-7eacb43f790d tempest-VolumesDeleteCascade-438274212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:30:47 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-a4f329de-e0aa-4f7d-b4a0-7eacb43f790d tempest-VolumesDeleteCascade-438274212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:30:47 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-a4f329de-e0aa-4f7d-b4a0-7eacb43f790d tempest-VolumesDeleteCascade-438274212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:30:47 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-a4f329de-e0aa-4f7d-b4a0-7eacb43f790d tempest-VolumesDeleteCascade-438274212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:30:47 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-a4f329de-e0aa-4f7d-b4a0-7eacb43f790d tempest-VolumesDeleteCascade-438274212 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:30:47 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-a4f329de-e0aa-4f7d-b4a0-7eacb43f790d tempest-VolumesDeleteCascade-438274212 None] Acquiring lock "cinder-quobyte-0cd261e6-5a4f-49b3-bbc1-e35d2d206a77" by "_copy_volume_from_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:30:47 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-a4f329de-e0aa-4f7d-b4a0-7eacb43f790d tempest-VolumesDeleteCascade-438274212 None] Lock "cinder-quobyte-0cd261e6-5a4f-49b3-bbc1-e35d2d206a77" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:30:47 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-a4f329de-e0aa-4f7d-b4a0-7eacb43f790d tempest-VolumesDeleteCascade-438274212 None] snapshot: f71de75d-f21c-4acf-8d98-da3e9af97334, volume: 0cd261e6-5a4f-49b3-bbc1-e35d2d206a77,  {{(pid=88719) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}}
Jul 30 20:30:47 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-41820daa-ea45-4447-8f29-f611625d01d4 tempest-GroupSnapshotsTest-296266448 None] Created reservations ['ae012d33-1573-4ec1-ab74-2b8e47eb500f', '71f8c37c-82d5-412a-b9ff-a313a79c4e2d', 'bd882d16-ca7c-4077-9c5b-6d9a000be79c', 'd6a0d11c-8a58-4668-adf0-c1dfebc1668f'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:30:47 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-a4f329de-e0aa-4f7d-b4a0-7eacb43f790d tempest-VolumesDeleteCascade-438274212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:30:47 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-a4f329de-e0aa-4f7d-b4a0-7eacb43f790d tempest-VolumesDeleteCascade-438274212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:30:47 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-a4f329de-e0aa-4f7d-b4a0-7eacb43f790d tempest-VolumesDeleteCascade-438274212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:30:47 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-a4f329de-e0aa-4f7d-b4a0-7eacb43f790d tempest-VolumesDeleteCascade-438274212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:30:47 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-a4f329de-e0aa-4f7d-b4a0-7eacb43f790d tempest-VolumesDeleteCascade-438274212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:30:47 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[19f46c9e-d935-4286-bc82-c9a3b4376364]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:30:47 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-a4f329de-e0aa-4f7d-b4a0-7eacb43f790d tempest-VolumesDeleteCascade-438274212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d0c1768a-1a8c-47f4-8a26-fe0e4fc69519.f71de75d-f21c-4acf-8d98-da3e9af97334 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:47 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-41820daa-ea45-4447-8f29-f611625d01d4 tempest-GroupSnapshotsTest-296266448 None] Created reservations ['93257cb5-6e7f-4c84-88ae-0363affbb071', '75a881f6-410d-496b-800a-c27d4b6eb93f', '7a0d1e97-6dc3-452c-8c56-0bac4dc615f2', '2e50d0c6-1780-4a9e-806a-459f269fe32b'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:30:47 devstack sudo[99253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d0c1768a-1a8c-47f4-8a26-fe0e4fc69519.f71de75d-f21c-4acf-8d98-da3e9af97334
Jul 30 20:30:47 devstack sudo[99253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:47 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-41820daa-ea45-4447-8f29-f611625d01d4 tempest-GroupSnapshotsTest-296266448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:30:47 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-41820daa-ea45-4447-8f29-f611625d01d4 tempest-GroupSnapshotsTest-296266448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:30:47 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-41820daa-ea45-4447-8f29-f611625d01d4 tempest-GroupSnapshotsTest-296266448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:30:47 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-41820daa-ea45-4447-8f29-f611625d01d4 tempest-GroupSnapshotsTest-296266448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:30:47 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-41820daa-ea45-4447-8f29-f611625d01d4 tempest-GroupSnapshotsTest-296266448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:30:47 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-41820daa-ea45-4447-8f29-f611625d01d4 tempest-GroupSnapshotsTest-296266448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:47 devstack sudo[99255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:30:47 devstack sudo[99255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:47 devstack sudo[99253]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:47 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-a4f329de-e0aa-4f7d-b4a0-7eacb43f790d tempest-VolumesDeleteCascade-438274212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d0c1768a-1a8c-47f4-8a26-fe0e4fc69519.f71de75d-f21c-4acf-8d98-da3e9af97334" returned: 0 in 0.466s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:47 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-a4f329de-e0aa-4f7d-b4a0-7eacb43f790d tempest-VolumesDeleteCascade-438274212 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d0c1768a-1a8c-47f4-8a26-fe0e4fc69519(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88719) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 30 20:30:47 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[2614223c-5ff2-4107-b14b-17311eade82c]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:30:47 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-a4f329de-e0aa-4f7d-b4a0-7eacb43f790d tempest-VolumesDeleteCascade-438274212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d0c1768a-1a8c-47f4-8a26-fe0e4fc69519 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:47 devstack sudo[99255]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:47 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-41820daa-ea45-4447-8f29-f611625d01d4 tempest-GroupSnapshotsTest-296266448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.338s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:47 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-41820daa-ea45-4447-8f29-f611625d01d4 tempest-GroupSnapshotsTest-296266448 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:30:47 devstack sudo[99262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d0c1768a-1a8c-47f4-8a26-fe0e4fc69519
Jul 30 20:30:47 devstack sudo[99262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:47 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-41820daa-ea45-4447-8f29-f611625d01d4 tempest-GroupSnapshotsTest-296266448 None] Delete group completed successfully.
Jul 30 20:30:48 devstack sudo[99262]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:48 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-a4f329de-e0aa-4f7d-b4a0-7eacb43f790d tempest-VolumesDeleteCascade-438274212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d0c1768a-1a8c-47f4-8a26-fe0e4fc69519" returned: 0 in 0.437s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:48 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-a4f329de-e0aa-4f7d-b4a0-7eacb43f790d tempest-VolumesDeleteCascade-438274212 None] will copy from snapshot at /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d0c1768a-1a8c-47f4-8a26-fe0e4fc69519 {{(pid=88719) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}}
Jul 30 20:30:48 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-a4f329de-e0aa-4f7d-b4a0-7eacb43f790d tempest-VolumesDeleteCascade-438274212 None] Creating direct copy from snapshot {{(pid=88719) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}}
Jul 30 20:30:48 devstack cinder-volume[88719]: DEBUG cinder.utils [None req-a4f329de-e0aa-4f7d-b4a0-7eacb43f790d tempest-VolumesDeleteCascade-438274212 None] Path /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0cd261e6-5a4f-49b3-bbc1-e35d2d206a77 not found in is_blk_device check {{(pid=88719) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 30 20:30:48 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-a4f329de-e0aa-4f7d-b4a0-7eacb43f790d tempest-VolumesDeleteCascade-438274212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d0c1768a-1a8c-47f4-8a26-fe0e4fc69519 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0cd261e6-5a4f-49b3-bbc1-e35d2d206a77 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:48 devstack sudo[99268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d0c1768a-1a8c-47f4-8a26-fe0e4fc69519 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0cd261e6-5a4f-49b3-bbc1-e35d2d206a77
Jul 30 20:30:48 devstack sudo[99268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:48 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-43e1c980-26ba-4370-b606-ed602ce73df7 tempest-VolumesGetTest-855358902 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:30:49 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-43e1c980-26ba-4370-b606-ed602ce73df7 tempest-VolumesGetTest-855358902 None] Flow 'volume_create_manager' (4bf77677-9aaa-4118-8f14-f727a28adbc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:30:49 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-43e1c980-26ba-4370-b606-ed602ce73df7 tempest-VolumesGetTest-855358902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fe10669-480c-4f3c-9209-9ebe7bec74ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:30:49 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-43e1c980-26ba-4370-b606-ed602ce73df7 tempest-VolumesGetTest-855358902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fe10669-480c-4f3c-9209-9ebe7bec74ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:30:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-132341187',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a596314-76da-48bf-be90-05c95a94a2a0,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='95dc6a3a598a411dbd7b034cb48fcbb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:30:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=929878c3-5ccc-4334-926f-2fa20a0c305d,status='creating',terminated_at=None,updated_at=2026-07-30T18:30:49Z,use_quota=True,user_id='e1274cdacdf54e3fbb200f3552412b74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:30:49 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-43e1c980-26ba-4370-b606-ed602ce73df7 tempest-VolumesGetTest-855358902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3c5ac02-4ef8-4d75-a0c5-b0a732d8ef30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:30:49 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-43e1c980-26ba-4370-b606-ed602ce73df7 tempest-VolumesGetTest-855358902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3c5ac02-4ef8-4d75-a0c5-b0a732d8ef30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:30:49 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-43e1c980-26ba-4370-b606-ed602ce73df7 tempest-VolumesGetTest-855358902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e308aea0-1040-4888-8c61-d1c4ae1e7466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:30:49 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-43e1c980-26ba-4370-b606-ed602ce73df7 tempest-VolumesGetTest-855358902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e308aea0-1040-4888-8c61-d1c4ae1e7466) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '2a596314-76da-48bf-be90-05c95a94a2a0', 'volume_name': 'volume-2a596314-76da-48bf-be90-05c95a94a2a0', 'volume_size': 1, 'source_volid': '929878c3-5ccc-4334-926f-2fa20a0c305d', 'source_volstatus': 'available'}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:30:49 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-43e1c980-26ba-4370-b606-ed602ce73df7 tempest-VolumesGetTest-855358902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84477128-1377-4130-9627-41a03d4db6a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:30:49 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-43e1c980-26ba-4370-b606-ed602ce73df7 tempest-VolumesGetTest-855358902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84477128-1377-4130-9627-41a03d4db6a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:30:49 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-43e1c980-26ba-4370-b606-ed602ce73df7 tempest-VolumesGetTest-855358902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c4ca1ea-af6f-4078-800f-101ad982edea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:30:49 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-43e1c980-26ba-4370-b606-ed602ce73df7 tempest-VolumesGetTest-855358902 None] Volume 2a596314-76da-48bf-be90-05c95a94a2a0: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-2a596314-76da-48bf-be90-05c95a94a2a0', 'volume_size': 1, 'source_volid': '929878c3-5ccc-4334-926f-2fa20a0c305d', 'source_volstatus': 'available'}
Jul 30 20:30:49 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-43e1c980-26ba-4370-b606-ed602ce73df7 tempest-VolumesGetTest-855358902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:30:50 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-c916487a-166f-40b0-a8b2-ec777c05e1bb tempest-GroupSnapshotsTest-296266448 None] Group tempest-GroupSnapshotsTest-Group-1313734549: creating
Jul 30 20:30:50 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-c916487a-166f-40b0-a8b2-ec777c05e1bb tempest-GroupSnapshotsTest-296266448 None] Group tempest-GroupSnapshotsTest-Group-1313734549: created successfully
Jul 30 20:30:50 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-c916487a-166f-40b0-a8b2-ec777c05e1bb tempest-GroupSnapshotsTest-296266448 None] Create group completed successfully.
Jul 30 20:30:52 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb9cbd5f-94f1-4f18-9b6f-bfb7d72b296a tempest-GroupSnapshotsTest-296266448 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:30:52 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-fb9cbd5f-94f1-4f18-9b6f-bfb7d72b296a tempest-GroupSnapshotsTest-296266448 None] Flow 'volume_create_manager' (0b984c3f-ef82-4eba-8009-e4baae38c88a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:30:52 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-fb9cbd5f-94f1-4f18-9b6f-bfb7d72b296a tempest-GroupSnapshotsTest-296266448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55ff927a-2660-457d-99ad-5623217420cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:30:52 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-fb9cbd5f-94f1-4f18-9b6f-bfb7d72b296a tempest-GroupSnapshotsTest-296266448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55ff927a-2660-457d-99ad-5623217420cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:30:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-851617419',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=afb4548d-9a1d-408d-bd36-098bb7341c65,host='devstack@QuobyteHD#QuobyteHD',id=6aec8396-c8b8-4d57-b369-cead782edcc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9a30efeb6fe428bbf6b21c25f0e9ae2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:30:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:30:52Z,use_quota=True,user_id='b7501c2b5cc547a8b7d91d86c5d9f3ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fb6c0ca-7808-4fe9-aeef-dbcdf2a60bcd),volume_type_id=6fb6c0ca-7808-4fe9-aeef-dbcdf2a60bcd)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:30:52 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-fb9cbd5f-94f1-4f18-9b6f-bfb7d72b296a tempest-GroupSnapshotsTest-296266448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (535dff25-4144-44eb-b45f-61708ad23ad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:30:52 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-fb9cbd5f-94f1-4f18-9b6f-bfb7d72b296a tempest-GroupSnapshotsTest-296266448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (535dff25-4144-44eb-b45f-61708ad23ad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:30:52 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-fb9cbd5f-94f1-4f18-9b6f-bfb7d72b296a tempest-GroupSnapshotsTest-296266448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d961f1ce-be9e-41df-a1ae-6c7860e009b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:30:52 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-fb9cbd5f-94f1-4f18-9b6f-bfb7d72b296a tempest-GroupSnapshotsTest-296266448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d961f1ce-be9e-41df-a1ae-6c7860e009b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6aec8396-c8b8-4d57-b369-cead782edcc3', 'volume_name': 'volume-6aec8396-c8b8-4d57-b369-cead782edcc3', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:30:52 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-fb9cbd5f-94f1-4f18-9b6f-bfb7d72b296a tempest-GroupSnapshotsTest-296266448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75a54514-7585-43e9-b1c9-cc3d26817c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:30:52 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-fb9cbd5f-94f1-4f18-9b6f-bfb7d72b296a tempest-GroupSnapshotsTest-296266448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75a54514-7585-43e9-b1c9-cc3d26817c92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:30:52 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-fb9cbd5f-94f1-4f18-9b6f-bfb7d72b296a tempest-GroupSnapshotsTest-296266448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bca5cfe3-a66f-4c75-8e55-6193cba8af52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:30:52 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-fb9cbd5f-94f1-4f18-9b6f-bfb7d72b296a tempest-GroupSnapshotsTest-296266448 None] Volume 6aec8396-c8b8-4d57-b369-cead782edcc3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6aec8396-c8b8-4d57-b369-cead782edcc3', 'volume_size': 1}
Jul 30 20:30:52 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-fb9cbd5f-94f1-4f18-9b6f-bfb7d72b296a tempest-GroupSnapshotsTest-296266448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:30:55 devstack sudo[99268]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:55 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-a4f329de-e0aa-4f7d-b4a0-7eacb43f790d tempest-VolumesDeleteCascade-438274212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d0c1768a-1a8c-47f4-8a26-fe0e4fc69519 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0cd261e6-5a4f-49b3-bbc1-e35d2d206a77" returned: 0 in 7.299s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:55 devstack cinder-volume[88719]: DEBUG cinder.image.image_utils [None req-a4f329de-e0aa-4f7d-b4a0-7eacb43f790d tempest-VolumesDeleteCascade-438274212 None] Image conversion details: src /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d0c1768a-1a8c-47f4-8a26-fe0e4fc69519, size 1024.00 MB, duration 7.30 sec, destination /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0cd261e6-5a4f-49b3-bbc1-e35d2d206a77 {{(pid=88719) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 30 20:30:55 devstack cinder-volume[88719]: INFO cinder.image.image_utils [None req-a4f329de-e0aa-4f7d-b4a0-7eacb43f790d tempest-VolumesDeleteCascade-438274212 None] Converted 1024.00 MB image at 140.27 MB/s
Jul 30 20:30:55 devstack cinder-volume[88719]: WARNING cinder.volume.drivers.remotefs [None req-a4f329de-e0aa-4f7d-b4a0-7eacb43f790d tempest-VolumesDeleteCascade-438274212 None] /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0cd261e6-5a4f-49b3-bbc1-e35d2d206a77 is being set with open permissions: ugo+rw
Jul 30 20:30:55 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-a4f329de-e0aa-4f7d-b4a0-7eacb43f790d tempest-VolumesDeleteCascade-438274212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0cd261e6-5a4f-49b3-bbc1-e35d2d206a77 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:55 devstack sudo[99366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0cd261e6-5a4f-49b3-bbc1-e35d2d206a77
Jul 30 20:30:55 devstack sudo[99366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:55 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-ce480eed-0511-4a9e-97ee-cff4db825feb tempest-VolumesActionsTest-1221656799 None] Acquiring lock "cinder-2246a04e-ffb2-4da5-80e1-68fdc8d88bc4" by "attach_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:30:55 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-ce480eed-0511-4a9e-97ee-cff4db825feb tempest-VolumesActionsTest-1221656799 None] Lock "cinder-2246a04e-ffb2-4da5-80e1-68fdc8d88bc4" acquired by "attach_volume" :: waited 0.021s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:30:55 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-ce480eed-0511-4a9e-97ee-cff4db825feb tempest-VolumesActionsTest-1221656799 None] Attaching volume 2246a04e-ffb2-4da5-80e1-68fdc8d88bc4 to instance 6f04ca32-f38f-4900-b73e-bcd6d4969fc1 at mountpoint /dev/vdb on host None.
Jul 30 20:30:55 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-ce480eed-0511-4a9e-97ee-cff4db825feb tempest-VolumesActionsTest-1221656799 None] Attach volume completed successfully.
Jul 30 20:30:55 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-ce480eed-0511-4a9e-97ee-cff4db825feb tempest-VolumesActionsTest-1221656799 None] Lock "cinder-2246a04e-ffb2-4da5-80e1-68fdc8d88bc4" released by "attach_volume" :: held 0.108s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:30:55 devstack sudo[99366]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:55 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-a4f329de-e0aa-4f7d-b4a0-7eacb43f790d tempest-VolumesDeleteCascade-438274212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0cd261e6-5a4f-49b3-bbc1-e35d2d206a77" returned: 0 in 0.307s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:55 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-a4f329de-e0aa-4f7d-b4a0-7eacb43f790d tempest-VolumesDeleteCascade-438274212 None] Lock "cinder-quobyte-0cd261e6-5a4f-49b3-bbc1-e35d2d206a77" released by "_copy_volume_from_snapshot" :: held 8.605s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:30:55 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-a4f329de-e0aa-4f7d-b4a0-7eacb43f790d tempest-VolumesDeleteCascade-438274212 None] Lock "cinder-quobyte-f71de75d-f21c-4acf-8d98-da3e9af97334-0cd261e6-5a4f-49b3-bbc1-e35d2d206a77" released by "_create_volume_from_snapshot" :: held 8.684s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:30:55 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-a4f329de-e0aa-4f7d-b4a0-7eacb43f790d tempest-VolumesDeleteCascade-438274212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.704s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:30:55 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-43e1c980-26ba-4370-b606-ed602ce73df7 tempest-VolumesGetTest-855358902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 6.268s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:30:55 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-43e1c980-26ba-4370-b606-ed602ce73df7 tempest-VolumesGetTest-855358902 None] Cloning volume 929878c3-5ccc-4334-926f-2fa20a0c305d to volume 2a596314-76da-48bf-be90-05c95a94a2a0
Jul 30 20:30:55 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-a4f329de-e0aa-4f7d-b4a0-7eacb43f790d tempest-VolumesDeleteCascade-438274212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa33e1d5-24ee-4260-b0e3-83ccf85a8c37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0cd261e6-5a4f-49b3-bbc1-e35d2d206a77', 'volume_size': 1, 'snapshot_id': 'f71de75d-f21c-4acf-8d98-da3e9af97334'}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:30:55 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-a4f329de-e0aa-4f7d-b4a0-7eacb43f790d tempest-VolumesDeleteCascade-438274212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f244fac-8883-4585-8adf-ea0c989c6051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:30:55 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-d0a48d40-a193-478f-87e8-b87ccbf702b1 tempest-VolumesActionsTest-1221656799 None] Acquiring lock "cinder-2246a04e-ffb2-4da5-80e1-68fdc8d88bc4-detach_volume" by "detach_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:30:55 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-43e1c980-26ba-4370-b606-ed602ce73df7 tempest-VolumesGetTest-855358902 None] Creating offline snapshot 0a968bbd-232b-4b87-b212-e68d09cc2c1c of volume 929878c3-5ccc-4334-926f-2fa20a0c305d {{(pid=88719) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 30 20:30:55 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-a4f329de-e0aa-4f7d-b4a0-7eacb43f790d tempest-VolumesDeleteCascade-438274212 None] Volume volume-0cd261e6-5a4f-49b3-bbc1-e35d2d206a77 (0cd261e6-5a4f-49b3-bbc1-e35d2d206a77): created successfully
Jul 30 20:30:55 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-a4f329de-e0aa-4f7d-b4a0-7eacb43f790d tempest-VolumesDeleteCascade-438274212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f244fac-8883-4585-8adf-ea0c989c6051) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:30:55 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-a4f329de-e0aa-4f7d-b4a0-7eacb43f790d tempest-VolumesDeleteCascade-438274212 None] Flow 'volume_create_manager' (aeadca75-5b24-480b-b4c5-c54f41a45ce6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:30:55 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-d0a48d40-a193-478f-87e8-b87ccbf702b1 tempest-VolumesActionsTest-1221656799 None] Lock "cinder-2246a04e-ffb2-4da5-80e1-68fdc8d88bc4-detach_volume" acquired by "detach_volume" :: waited 0.043s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:30:55 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-d0a48d40-a193-478f-87e8-b87ccbf702b1 tempest-VolumesActionsTest-1221656799 None] Detaching volume 2246a04e-ffb2-4da5-80e1-68fdc8d88bc4 from instance 6f04ca32-f38f-4900-b73e-bcd6d4969fc1.
Jul 30 20:30:55 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[689d927c-ff88-4607-9207-928bd46f465b]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:30:55 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-43e1c980-26ba-4370-b606-ed602ce73df7 tempest-VolumesGetTest-855358902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-929878c3-5ccc-4334-926f-2fa20a0c305d {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:56 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-a4f329de-e0aa-4f7d-b4a0-7eacb43f790d tempest-VolumesDeleteCascade-438274212 None] Created volume successfully.
Jul 30 20:30:56 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-d0a48d40-a193-478f-87e8-b87ccbf702b1 tempest-VolumesActionsTest-1221656799 None] Detach volume completed successfully.
Jul 30 20:30:56 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-d0a48d40-a193-478f-87e8-b87ccbf702b1 tempest-VolumesActionsTest-1221656799 None] Lock "cinder-2246a04e-ffb2-4da5-80e1-68fdc8d88bc4-detach_volume" released by "detach_volume" :: held 0.089s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:30:56 devstack sudo[99369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-929878c3-5ccc-4334-926f-2fa20a0c305d
Jul 30 20:30:56 devstack sudo[99369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:56 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-1c997d11-1fe7-4c7e-9b8c-9c05191d4b6d tempest-VolumesDeleteCascade-438274212 None] Acquiring lock "cinder-d0c1768a-1a8c-47f4-8a26-fe0e4fc69519-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:30:56 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-1c997d11-1fe7-4c7e-9b8c-9c05191d4b6d tempest-VolumesDeleteCascade-438274212 None] Lock "cinder-d0c1768a-1a8c-47f4-8a26-fe0e4fc69519-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:30:56 devstack sudo[99369]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:56 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-43e1c980-26ba-4370-b606-ed602ce73df7 tempest-VolumesGetTest-855358902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-929878c3-5ccc-4334-926f-2fa20a0c305d" returned: 0 in 0.492s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:56 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-43e1c980-26ba-4370-b606-ed602ce73df7 tempest-VolumesGetTest-855358902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-929878c3-5ccc-4334-926f-2fa20a0c305d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-929878c3-5ccc-4334-926f-2fa20a0c305d.0a968bbd-232b-4b87-b212-e68d09cc2c1c 1G {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:56 devstack sudo[99375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-929878c3-5ccc-4334-926f-2fa20a0c305d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-929878c3-5ccc-4334-926f-2fa20a0c305d.0a968bbd-232b-4b87-b212-e68d09cc2c1c 1G
Jul 30 20:30:56 devstack sudo[99375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:56 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-1c997d11-1fe7-4c7e-9b8c-9c05191d4b6d tempest-VolumesDeleteCascade-438274212 None] Performing cascade delete. {{(pid=88719) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Jul 30 20:30:56 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-1c997d11-1fe7-4c7e-9b8c-9c05191d4b6d tempest-VolumesDeleteCascade-438274212 None] Acquiring lock "cinder-f71de75d-f21c-4acf-8d98-da3e9af97334-delete_snapshot" by "delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:30:56 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-1c997d11-1fe7-4c7e-9b8c-9c05191d4b6d tempest-VolumesDeleteCascade-438274212 None] Lock "cinder-f71de75d-f21c-4acf-8d98-da3e9af97334-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:30:56 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-1c997d11-1fe7-4c7e-9b8c-9c05191d4b6d tempest-VolumesDeleteCascade-438274212 None] Acquiring lock "cinder-quobyte-d0c1768a-1a8c-47f4-8a26-fe0e4fc69519" by "delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:30:56 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-1c997d11-1fe7-4c7e-9b8c-9c05191d4b6d tempest-VolumesDeleteCascade-438274212 None] Lock "cinder-quobyte-d0c1768a-1a8c-47f4-8a26-fe0e4fc69519" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:30:56 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-1c997d11-1fe7-4c7e-9b8c-9c05191d4b6d tempest-VolumesDeleteCascade-438274212 None] Acquiring lock "cinder-quobyte-f71de75d-f21c-4acf-8d98-da3e9af97334" by "_delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:30:56 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-1c997d11-1fe7-4c7e-9b8c-9c05191d4b6d tempest-VolumesDeleteCascade-438274212 None] Lock "cinder-quobyte-f71de75d-f21c-4acf-8d98-da3e9af97334" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:30:56 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-1c997d11-1fe7-4c7e-9b8c-9c05191d4b6d tempest-VolumesDeleteCascade-438274212 None] Deleting offline snapshot f71de75d-f21c-4acf-8d98-da3e9af97334 of volume d0c1768a-1a8c-47f4-8a26-fe0e4fc69519 {{(pid=88719) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 30 20:30:56 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-1c997d11-1fe7-4c7e-9b8c-9c05191d4b6d tempest-VolumesDeleteCascade-438274212 None] snapshot_file for this snap is: volume-d0c1768a-1a8c-47f4-8a26-fe0e4fc69519.f71de75d-f21c-4acf-8d98-da3e9af97334 {{(pid=88719) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 30 20:30:56 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2e3f12a-b519-4589-85d8-e8f4dd6df986]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:30:56 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-1c997d11-1fe7-4c7e-9b8c-9c05191d4b6d tempest-VolumesDeleteCascade-438274212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d0c1768a-1a8c-47f4-8a26-fe0e4fc69519.f71de75d-f21c-4acf-8d98-da3e9af97334 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:56 devstack sudo[99378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d0c1768a-1a8c-47f4-8a26-fe0e4fc69519.f71de75d-f21c-4acf-8d98-da3e9af97334
Jul 30 20:30:56 devstack sudo[99378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:57 devstack sudo[99375]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:57 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-43e1c980-26ba-4370-b606-ed602ce73df7 tempest-VolumesGetTest-855358902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-929878c3-5ccc-4334-926f-2fa20a0c305d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-929878c3-5ccc-4334-926f-2fa20a0c305d.0a968bbd-232b-4b87-b212-e68d09cc2c1c 1G" returned: 0 in 0.691s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:57 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-43e1c980-26ba-4370-b606-ed602ce73df7 tempest-VolumesGetTest-855358902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-929878c3-5ccc-4334-926f-2fa20a0c305d -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-929878c3-5ccc-4334-926f-2fa20a0c305d.0a968bbd-232b-4b87-b212-e68d09cc2c1c {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:57 devstack sudo[99405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-929878c3-5ccc-4334-926f-2fa20a0c305d -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-929878c3-5ccc-4334-926f-2fa20a0c305d.0a968bbd-232b-4b87-b212-e68d09cc2c1c
Jul 30 20:30:57 devstack sudo[99405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:57 devstack sudo[99378]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:57 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-1c997d11-1fe7-4c7e-9b8c-9c05191d4b6d tempest-VolumesDeleteCascade-438274212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d0c1768a-1a8c-47f4-8a26-fe0e4fc69519.f71de75d-f21c-4acf-8d98-da3e9af97334" returned: 0 in 0.588s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:57 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-1c997d11-1fe7-4c7e-9b8c-9c05191d4b6d tempest-VolumesDeleteCascade-438274212 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d0c1768a-1a8c-47f4-8a26-fe0e4fc69519(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88719) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 30 20:30:57 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[08aaacc8-d412-4224-afce-1a4ab4406b5a]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:30:57 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-1c997d11-1fe7-4c7e-9b8c-9c05191d4b6d tempest-VolumesDeleteCascade-438274212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d0c1768a-1a8c-47f4-8a26-fe0e4fc69519 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:57 devstack sudo[99411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d0c1768a-1a8c-47f4-8a26-fe0e4fc69519
Jul 30 20:30:57 devstack sudo[99411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:57 devstack sudo[99405]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:57 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-43e1c980-26ba-4370-b606-ed602ce73df7 tempest-VolumesGetTest-855358902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-929878c3-5ccc-4334-926f-2fa20a0c305d -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-929878c3-5ccc-4334-926f-2fa20a0c305d.0a968bbd-232b-4b87-b212-e68d09cc2c1c" returned: 0 in 0.364s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:57 devstack cinder-volume[88719]: WARNING cinder.volume.drivers.remotefs [None req-43e1c980-26ba-4370-b606-ed602ce73df7 tempest-VolumesGetTest-855358902 None] /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-929878c3-5ccc-4334-926f-2fa20a0c305d.0a968bbd-232b-4b87-b212-e68d09cc2c1c is being set with open permissions: ugo+rw
Jul 30 20:30:57 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-43e1c980-26ba-4370-b606-ed602ce73df7 tempest-VolumesGetTest-855358902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-929878c3-5ccc-4334-926f-2fa20a0c305d.0a968bbd-232b-4b87-b212-e68d09cc2c1c {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:57 devstack sudo[99417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-929878c3-5ccc-4334-926f-2fa20a0c305d.0a968bbd-232b-4b87-b212-e68d09cc2c1c
Jul 30 20:30:57 devstack sudo[99417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:57 devstack sudo[99417]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:57 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-43e1c980-26ba-4370-b606-ed602ce73df7 tempest-VolumesGetTest-855358902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-929878c3-5ccc-4334-926f-2fa20a0c305d.0a968bbd-232b-4b87-b212-e68d09cc2c1c" returned: 0 in 0.311s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:57 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-43e1c980-26ba-4370-b606-ed602ce73df7 tempest-VolumesGetTest-855358902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-929878c3-5ccc-4334-926f-2fa20a0c305d.info {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:57 devstack sudo[99439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-929878c3-5ccc-4334-926f-2fa20a0c305d.info
Jul 30 20:30:57 devstack sudo[99439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:58 devstack sudo[99411]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-1c997d11-1fe7-4c7e-9b8c-9c05191d4b6d tempest-VolumesDeleteCascade-438274212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d0c1768a-1a8c-47f4-8a26-fe0e4fc69519" returned: 0 in 0.767s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-1c997d11-1fe7-4c7e-9b8c-9c05191d4b6d tempest-VolumesDeleteCascade-438274212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d0c1768a-1a8c-47f4-8a26-fe0e4fc69519.f71de75d-f21c-4acf-8d98-da3e9af97334 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:58 devstack sudo[99463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d0c1768a-1a8c-47f4-8a26-fe0e4fc69519.f71de75d-f21c-4acf-8d98-da3e9af97334
Jul 30 20:30:58 devstack sudo[99463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:58 devstack sudo[99439]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-43e1c980-26ba-4370-b606-ed602ce73df7 tempest-VolumesGetTest-855358902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-929878c3-5ccc-4334-926f-2fa20a0c305d.info" returned: 0 in 0.511s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:58 devstack cinder-volume[88719]: WARNING cinder.volume.drivers.remotefs [None req-43e1c980-26ba-4370-b606-ed602ce73df7 tempest-VolumesGetTest-855358902 None] /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-929878c3-5ccc-4334-926f-2fa20a0c305d.info is being set with open permissions: ugo+rw
Jul 30 20:30:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-43e1c980-26ba-4370-b606-ed602ce73df7 tempest-VolumesGetTest-855358902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-929878c3-5ccc-4334-926f-2fa20a0c305d.info {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:58 devstack sudo[99468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-929878c3-5ccc-4334-926f-2fa20a0c305d.info
Jul 30 20:30:58 devstack sudo[99468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:58 devstack sudo[99463]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-1c997d11-1fe7-4c7e-9b8c-9c05191d4b6d tempest-VolumesDeleteCascade-438274212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d0c1768a-1a8c-47f4-8a26-fe0e4fc69519.f71de75d-f21c-4acf-8d98-da3e9af97334" returned: 0 in 0.561s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-1c997d11-1fe7-4c7e-9b8c-9c05191d4b6d tempest-VolumesDeleteCascade-438274212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d0c1768a-1a8c-47f4-8a26-fe0e4fc69519.f71de75d-f21c-4acf-8d98-da3e9af97334 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:58 devstack sudo[99473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d0c1768a-1a8c-47f4-8a26-fe0e4fc69519.f71de75d-f21c-4acf-8d98-da3e9af97334
Jul 30 20:30:58 devstack sudo[99473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:58 devstack sudo[99468]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-43e1c980-26ba-4370-b606-ed602ce73df7 tempest-VolumesGetTest-855358902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-929878c3-5ccc-4334-926f-2fa20a0c305d.info" returned: 0 in 0.311s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:58 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-43e1c980-26ba-4370-b606-ed602ce73df7 tempest-VolumesGetTest-855358902 None] Acquiring lock "cinder-quobyte-2a596314-76da-48bf-be90-05c95a94a2a0" by "_copy_volume_from_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:30:58 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-43e1c980-26ba-4370-b606-ed602ce73df7 tempest-VolumesGetTest-855358902 None] Lock "cinder-quobyte-2a596314-76da-48bf-be90-05c95a94a2a0" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:30:58 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-43e1c980-26ba-4370-b606-ed602ce73df7 tempest-VolumesGetTest-855358902 None] snapshot: 0a968bbd-232b-4b87-b212-e68d09cc2c1c, volume: 2a596314-76da-48bf-be90-05c95a94a2a0,  {{(pid=88719) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}}
Jul 30 20:30:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-43e1c980-26ba-4370-b606-ed602ce73df7 tempest-VolumesGetTest-855358902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:30:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-43e1c980-26ba-4370-b606-ed602ce73df7 tempest-VolumesGetTest-855358902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:30:58 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-43e1c980-26ba-4370-b606-ed602ce73df7 tempest-VolumesGetTest-855358902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:30:58 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-43e1c980-26ba-4370-b606-ed602ce73df7 tempest-VolumesGetTest-855358902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:30:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-43e1c980-26ba-4370-b606-ed602ce73df7 tempest-VolumesGetTest-855358902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:30:58 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3e030c2-8dd0-472a-a094-f8c9e2a1a7d9]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:30:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-43e1c980-26ba-4370-b606-ed602ce73df7 tempest-VolumesGetTest-855358902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-929878c3-5ccc-4334-926f-2fa20a0c305d.0a968bbd-232b-4b87-b212-e68d09cc2c1c {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:58 devstack sudo[99473]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-1c997d11-1fe7-4c7e-9b8c-9c05191d4b6d tempest-VolumesDeleteCascade-438274212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d0c1768a-1a8c-47f4-8a26-fe0e4fc69519.f71de75d-f21c-4acf-8d98-da3e9af97334" returned: 0 in 0.289s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:58 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-1c997d11-1fe7-4c7e-9b8c-9c05191d4b6d tempest-VolumesDeleteCascade-438274212 None] Lock "cinder-quobyte-f71de75d-f21c-4acf-8d98-da3e9af97334" released by "_delete_snapshot" :: held 2.319s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:30:58 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-1c997d11-1fe7-4c7e-9b8c-9c05191d4b6d tempest-VolumesDeleteCascade-438274212 None] Lock "cinder-quobyte-d0c1768a-1a8c-47f4-8a26-fe0e4fc69519" released by "delete_snapshot" :: held 2.342s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:30:58 devstack sudo[99477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-929878c3-5ccc-4334-926f-2fa20a0c305d.0a968bbd-232b-4b87-b212-e68d09cc2c1c
Jul 30 20:30:58 devstack sudo[99477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:58 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-1c997d11-1fe7-4c7e-9b8c-9c05191d4b6d tempest-VolumesDeleteCascade-438274212 None] Created reservations ['a796c0c0-5c17-4a87-b1b2-36a64dd010c9', '6764f1e8-c5ea-4872-85cc-77822ac6a233', '8e214f03-bfb6-40f6-b3d8-e352280c3c98', '83214e63-d305-4da4-8d6d-2b373c47346f'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:30:59 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-1c997d11-1fe7-4c7e-9b8c-9c05191d4b6d tempest-VolumesDeleteCascade-438274212 None] Delete snapshot completed successfully.
Jul 30 20:30:59 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-1c997d11-1fe7-4c7e-9b8c-9c05191d4b6d tempest-VolumesDeleteCascade-438274212 None] Lock "cinder-f71de75d-f21c-4acf-8d98-da3e9af97334-delete_snapshot" released by "delete_snapshot" :: held 2.492s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:30:59 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-1c997d11-1fe7-4c7e-9b8c-9c05191d4b6d tempest-VolumesDeleteCascade-438274212 None] Snapshots deleted, issuing volume delete {{(pid=88719) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Jul 30 20:30:59 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-1c997d11-1fe7-4c7e-9b8c-9c05191d4b6d tempest-VolumesDeleteCascade-438274212 None] Acquiring lock "cinder-quobyte-d0c1768a-1a8c-47f4-8a26-fe0e4fc69519" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:30:59 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-1c997d11-1fe7-4c7e-9b8c-9c05191d4b6d tempest-VolumesDeleteCascade-438274212 None] Lock "cinder-quobyte-d0c1768a-1a8c-47f4-8a26-fe0e4fc69519" acquired by "delete_volume" :: waited 0.014s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:30:59 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[9065cc17-b6a8-40ba-8fb4-62afba2b9265]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:30:59 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-1c997d11-1fe7-4c7e-9b8c-9c05191d4b6d tempest-VolumesDeleteCascade-438274212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d0c1768a-1a8c-47f4-8a26-fe0e4fc69519 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:59 devstack sudo[99479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d0c1768a-1a8c-47f4-8a26-fe0e4fc69519
Jul 30 20:30:59 devstack sudo[99479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:59 devstack sudo[99477]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:59 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-43e1c980-26ba-4370-b606-ed602ce73df7 tempest-VolumesGetTest-855358902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-929878c3-5ccc-4334-926f-2fa20a0c305d.0a968bbd-232b-4b87-b212-e68d09cc2c1c" returned: 0 in 0.398s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:59 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-43e1c980-26ba-4370-b606-ed602ce73df7 tempest-VolumesGetTest-855358902 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-929878c3-5ccc-4334-926f-2fa20a0c305d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88719) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 30 20:30:59 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ef1830e-5e76-4f41-b4fa-5e3781353c14]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:30:59 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-43e1c980-26ba-4370-b606-ed602ce73df7 tempest-VolumesGetTest-855358902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-929878c3-5ccc-4334-926f-2fa20a0c305d {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:59 devstack sudo[99484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-929878c3-5ccc-4334-926f-2fa20a0c305d
Jul 30 20:30:59 devstack sudo[99484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:59 devstack sudo[99479]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:59 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-1c997d11-1fe7-4c7e-9b8c-9c05191d4b6d tempest-VolumesDeleteCascade-438274212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d0c1768a-1a8c-47f4-8a26-fe0e4fc69519" returned: 0 in 0.412s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:59 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-1c997d11-1fe7-4c7e-9b8c-9c05191d4b6d tempest-VolumesDeleteCascade-438274212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d0c1768a-1a8c-47f4-8a26-fe0e4fc69519 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:59 devstack sudo[99490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d0c1768a-1a8c-47f4-8a26-fe0e4fc69519
Jul 30 20:30:59 devstack sudo[99490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:59 devstack sudo[99484]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:59 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-43e1c980-26ba-4370-b606-ed602ce73df7 tempest-VolumesGetTest-855358902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-929878c3-5ccc-4334-926f-2fa20a0c305d" returned: 0 in 0.436s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:59 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-43e1c980-26ba-4370-b606-ed602ce73df7 tempest-VolumesGetTest-855358902 None] will copy from snapshot at /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-929878c3-5ccc-4334-926f-2fa20a0c305d {{(pid=88719) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}}
Jul 30 20:30:59 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-43e1c980-26ba-4370-b606-ed602ce73df7 tempest-VolumesGetTest-855358902 None] Creating direct copy from snapshot {{(pid=88719) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}}
Jul 30 20:30:59 devstack cinder-volume[88719]: DEBUG cinder.utils [None req-43e1c980-26ba-4370-b606-ed602ce73df7 tempest-VolumesGetTest-855358902 None] Path /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2a596314-76da-48bf-be90-05c95a94a2a0 not found in is_blk_device check {{(pid=88719) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 30 20:30:59 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-43e1c980-26ba-4370-b606-ed602ce73df7 tempest-VolumesGetTest-855358902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-929878c3-5ccc-4334-926f-2fa20a0c305d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2a596314-76da-48bf-be90-05c95a94a2a0 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:59 devstack sudo[99495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-929878c3-5ccc-4334-926f-2fa20a0c305d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2a596314-76da-48bf-be90-05c95a94a2a0
Jul 30 20:30:59 devstack sudo[99495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:30:59 devstack sudo[99490]: pam_unix(sudo:session): session closed for user root
Jul 30 20:30:59 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-1c997d11-1fe7-4c7e-9b8c-9c05191d4b6d tempest-VolumesDeleteCascade-438274212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d0c1768a-1a8c-47f4-8a26-fe0e4fc69519" returned: 0 in 0.281s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:30:59 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-1c997d11-1fe7-4c7e-9b8c-9c05191d4b6d tempest-VolumesDeleteCascade-438274212 None] Lock "cinder-quobyte-d0c1768a-1a8c-47f4-8a26-fe0e4fc69519" released by "delete_volume" :: held 0.761s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:30:59 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-1c997d11-1fe7-4c7e-9b8c-9c05191d4b6d tempest-VolumesDeleteCascade-438274212 None] Created reservations ['8b630154-76d6-478e-b9eb-aada7720aa1d', '8717ae78-dda9-4270-85c5-c103bbbcbf85', 'a3a3c997-7a15-4664-b9e6-81e11099cdd7', 'da2ed1a0-2a22-4105-a7b2-103b692f7935'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:30:59 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-1c997d11-1fe7-4c7e-9b8c-9c05191d4b6d tempest-VolumesDeleteCascade-438274212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:30:59 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-1c997d11-1fe7-4c7e-9b8c-9c05191d4b6d tempest-VolumesDeleteCascade-438274212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:30:59 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-1c997d11-1fe7-4c7e-9b8c-9c05191d4b6d tempest-VolumesDeleteCascade-438274212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:30:59 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-1c997d11-1fe7-4c7e-9b8c-9c05191d4b6d tempest-VolumesDeleteCascade-438274212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:30:59 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-1c997d11-1fe7-4c7e-9b8c-9c05191d4b6d tempest-VolumesDeleteCascade-438274212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:30:59 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-1c997d11-1fe7-4c7e-9b8c-9c05191d4b6d tempest-VolumesDeleteCascade-438274212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:30:59 devstack sudo[99500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:30:59 devstack sudo[99500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:31:00 devstack sudo[99500]: pam_unix(sudo:session): session closed for user root
Jul 30 20:31:00 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-1c997d11-1fe7-4c7e-9b8c-9c05191d4b6d tempest-VolumesDeleteCascade-438274212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.345s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:31:00 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-1c997d11-1fe7-4c7e-9b8c-9c05191d4b6d tempest-VolumesDeleteCascade-438274212 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:31:00 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-1c997d11-1fe7-4c7e-9b8c-9c05191d4b6d tempest-VolumesDeleteCascade-438274212 None] Deleted volume successfully.
Jul 30 20:31:00 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-1c997d11-1fe7-4c7e-9b8c-9c05191d4b6d tempest-VolumesDeleteCascade-438274212 None] Lock "cinder-d0c1768a-1a8c-47f4-8a26-fe0e4fc69519-delete_volume" released by "delete_volume" :: held 3.953s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:31:01 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-12b2963d-76bc-476c-a8dd-b030abd31864 tempest-VolumesDeleteCascade-438274212 None] Acquiring lock "cinder-0cd261e6-5a4f-49b3-bbc1-e35d2d206a77-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:31:01 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-12b2963d-76bc-476c-a8dd-b030abd31864 tempest-VolumesDeleteCascade-438274212 None] Lock "cinder-0cd261e6-5a4f-49b3-bbc1-e35d2d206a77-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:31:01 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-12b2963d-76bc-476c-a8dd-b030abd31864 tempest-VolumesDeleteCascade-438274212 None] Acquiring lock "cinder-quobyte-0cd261e6-5a4f-49b3-bbc1-e35d2d206a77" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:31:01 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-12b2963d-76bc-476c-a8dd-b030abd31864 tempest-VolumesDeleteCascade-438274212 None] Lock "cinder-quobyte-0cd261e6-5a4f-49b3-bbc1-e35d2d206a77" acquired by "delete_volume" :: waited 0.034s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:31:01 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b7a832c-3616-42a5-b511-dbe03af1706b]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:31:01 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-12b2963d-76bc-476c-a8dd-b030abd31864 tempest-VolumesDeleteCascade-438274212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0cd261e6-5a4f-49b3-bbc1-e35d2d206a77 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:31:01 devstack sudo[99511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0cd261e6-5a4f-49b3-bbc1-e35d2d206a77
Jul 30 20:31:01 devstack sudo[99511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:31:02 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-40a6a922-5776-4ff4-a53a-0e2ff0ed2ff2 tempest-VolumesActionsTest-1221656799 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:31:02 devstack sudo[99511]: pam_unix(sudo:session): session closed for user root
Jul 30 20:31:02 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-12b2963d-76bc-476c-a8dd-b030abd31864 tempest-VolumesDeleteCascade-438274212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0cd261e6-5a4f-49b3-bbc1-e35d2d206a77" returned: 0 in 1.386s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:31:02 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-12b2963d-76bc-476c-a8dd-b030abd31864 tempest-VolumesDeleteCascade-438274212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0cd261e6-5a4f-49b3-bbc1-e35d2d206a77 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:31:02 devstack sudo[99517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0cd261e6-5a4f-49b3-bbc1-e35d2d206a77
Jul 30 20:31:02 devstack sudo[99517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:31:03 devstack sudo[99517]: pam_unix(sudo:session): session closed for user root
Jul 30 20:31:03 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-12b2963d-76bc-476c-a8dd-b030abd31864 tempest-VolumesDeleteCascade-438274212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0cd261e6-5a4f-49b3-bbc1-e35d2d206a77" returned: 0 in 0.686s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:31:03 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-12b2963d-76bc-476c-a8dd-b030abd31864 tempest-VolumesDeleteCascade-438274212 None] Lock "cinder-quobyte-0cd261e6-5a4f-49b3-bbc1-e35d2d206a77" released by "delete_volume" :: held 2.179s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:31:03 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-12b2963d-76bc-476c-a8dd-b030abd31864 tempest-VolumesDeleteCascade-438274212 None] Created reservations ['9b9b1ae4-9bfc-4f48-80af-69096df30914', 'e2d881ae-d427-4e93-a027-89073bc4fa9d', '4212d7d6-7f82-4b5a-b18c-b6af7fb663de', 'e69011ff-ce3d-4e1a-84ae-7a24bf63b785'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:31:03 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-12b2963d-76bc-476c-a8dd-b030abd31864 tempest-VolumesDeleteCascade-438274212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:31:03 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-12b2963d-76bc-476c-a8dd-b030abd31864 tempest-VolumesDeleteCascade-438274212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:31:03 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-12b2963d-76bc-476c-a8dd-b030abd31864 tempest-VolumesDeleteCascade-438274212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:31:03 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-12b2963d-76bc-476c-a8dd-b030abd31864 tempest-VolumesDeleteCascade-438274212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:31:03 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-12b2963d-76bc-476c-a8dd-b030abd31864 tempest-VolumesDeleteCascade-438274212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:31:03 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-12b2963d-76bc-476c-a8dd-b030abd31864 tempest-VolumesDeleteCascade-438274212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:31:03 devstack sudo[99524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:31:03 devstack sudo[99524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:31:04 devstack sudo[99524]: pam_unix(sudo:session): session closed for user root
Jul 30 20:31:04 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-12b2963d-76bc-476c-a8dd-b030abd31864 tempest-VolumesDeleteCascade-438274212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.431s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:31:04 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-12b2963d-76bc-476c-a8dd-b030abd31864 tempest-VolumesDeleteCascade-438274212 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:31:04 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-12b2963d-76bc-476c-a8dd-b030abd31864 tempest-VolumesDeleteCascade-438274212 None] Deleted volume successfully.
Jul 30 20:31:04 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-12b2963d-76bc-476c-a8dd-b030abd31864 tempest-VolumesDeleteCascade-438274212 None] Lock "cinder-0cd261e6-5a4f-49b3-bbc1-e35d2d206a77-delete_volume" released by "delete_volume" :: held 3.126s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:31:04 devstack sudo[99495]: pam_unix(sudo:session): session closed for user root
Jul 30 20:31:04 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-43e1c980-26ba-4370-b606-ed602ce73df7 tempest-VolumesGetTest-855358902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-929878c3-5ccc-4334-926f-2fa20a0c305d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2a596314-76da-48bf-be90-05c95a94a2a0" returned: 0 in 5.100s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:31:04 devstack cinder-volume[88719]: DEBUG cinder.image.image_utils [None req-43e1c980-26ba-4370-b606-ed602ce73df7 tempest-VolumesGetTest-855358902 None] Image conversion details: src /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-929878c3-5ccc-4334-926f-2fa20a0c305d, size 1024.00 MB, duration 5.10 sec, destination /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2a596314-76da-48bf-be90-05c95a94a2a0 {{(pid=88719) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 30 20:31:04 devstack cinder-volume[88719]: INFO cinder.image.image_utils [None req-43e1c980-26ba-4370-b606-ed602ce73df7 tempest-VolumesGetTest-855358902 None] Converted 1024.00 MB image at 200.74 MB/s
Jul 30 20:31:04 devstack cinder-volume[88719]: WARNING cinder.volume.drivers.remotefs [None req-43e1c980-26ba-4370-b606-ed602ce73df7 tempest-VolumesGetTest-855358902 None] /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2a596314-76da-48bf-be90-05c95a94a2a0 is being set with open permissions: ugo+rw
Jul 30 20:31:04 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-43e1c980-26ba-4370-b606-ed602ce73df7 tempest-VolumesGetTest-855358902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2a596314-76da-48bf-be90-05c95a94a2a0 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:31:04 devstack sudo[99528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2a596314-76da-48bf-be90-05c95a94a2a0
Jul 30 20:31:04 devstack sudo[99528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:31:05 devstack sudo[99528]: pam_unix(sudo:session): session closed for user root
Jul 30 20:31:05 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-43e1c980-26ba-4370-b606-ed602ce73df7 tempest-VolumesGetTest-855358902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2a596314-76da-48bf-be90-05c95a94a2a0" returned: 0 in 0.243s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:31:05 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-43e1c980-26ba-4370-b606-ed602ce73df7 tempest-VolumesGetTest-855358902 None] Lock "cinder-quobyte-2a596314-76da-48bf-be90-05c95a94a2a0" released by "_copy_volume_from_snapshot" :: held 6.278s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:31:05 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-43e1c980-26ba-4370-b606-ed602ce73df7 tempest-VolumesGetTest-855358902 None] Acquiring lock "cinder-quobyte-0a968bbd-232b-4b87-b212-e68d09cc2c1c" by "_delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:31:05 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-43e1c980-26ba-4370-b606-ed602ce73df7 tempest-VolumesGetTest-855358902 None] Lock "cinder-quobyte-0a968bbd-232b-4b87-b212-e68d09cc2c1c" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:31:05 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-43e1c980-26ba-4370-b606-ed602ce73df7 tempest-VolumesGetTest-855358902 None] Deleting offline snapshot 0a968bbd-232b-4b87-b212-e68d09cc2c1c of volume 929878c3-5ccc-4334-926f-2fa20a0c305d {{(pid=88719) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 30 20:31:05 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-43e1c980-26ba-4370-b606-ed602ce73df7 tempest-VolumesGetTest-855358902 None] snapshot_file for this snap is: volume-929878c3-5ccc-4334-926f-2fa20a0c305d.0a968bbd-232b-4b87-b212-e68d09cc2c1c {{(pid=88719) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 30 20:31:05 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[87e8b94e-5d77-4bc8-8568-57278ea6b378]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:31:05 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-43e1c980-26ba-4370-b606-ed602ce73df7 tempest-VolumesGetTest-855358902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-929878c3-5ccc-4334-926f-2fa20a0c305d.0a968bbd-232b-4b87-b212-e68d09cc2c1c {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:31:05 devstack sudo[99531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-929878c3-5ccc-4334-926f-2fa20a0c305d.0a968bbd-232b-4b87-b212-e68d09cc2c1c
Jul 30 20:31:05 devstack sudo[99531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:31:05 devstack sudo[99531]: pam_unix(sudo:session): session closed for user root
Jul 30 20:31:05 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-43e1c980-26ba-4370-b606-ed602ce73df7 tempest-VolumesGetTest-855358902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-929878c3-5ccc-4334-926f-2fa20a0c305d.0a968bbd-232b-4b87-b212-e68d09cc2c1c" returned: 0 in 0.376s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:31:05 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-43e1c980-26ba-4370-b606-ed602ce73df7 tempest-VolumesGetTest-855358902 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-929878c3-5ccc-4334-926f-2fa20a0c305d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88719) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 30 20:31:05 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b136881-0951-47e5-a8c1-f629f98480fc]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:31:05 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-43e1c980-26ba-4370-b606-ed602ce73df7 tempest-VolumesGetTest-855358902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-929878c3-5ccc-4334-926f-2fa20a0c305d {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:31:05 devstack sudo[99537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-929878c3-5ccc-4334-926f-2fa20a0c305d
Jul 30 20:31:05 devstack sudo[99537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:31:06 devstack sudo[99537]: pam_unix(sudo:session): session closed for user root
Jul 30 20:31:06 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-43e1c980-26ba-4370-b606-ed602ce73df7 tempest-VolumesGetTest-855358902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-929878c3-5ccc-4334-926f-2fa20a0c305d" returned: 0 in 0.583s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:31:06 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-43e1c980-26ba-4370-b606-ed602ce73df7 tempest-VolumesGetTest-855358902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-929878c3-5ccc-4334-926f-2fa20a0c305d.0a968bbd-232b-4b87-b212-e68d09cc2c1c {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:31:06 devstack sudo[99548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-929878c3-5ccc-4334-926f-2fa20a0c305d.0a968bbd-232b-4b87-b212-e68d09cc2c1c
Jul 30 20:31:06 devstack sudo[99548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:31:06 devstack sudo[99548]: pam_unix(sudo:session): session closed for user root
Jul 30 20:31:06 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-43e1c980-26ba-4370-b606-ed602ce73df7 tempest-VolumesGetTest-855358902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-929878c3-5ccc-4334-926f-2fa20a0c305d.0a968bbd-232b-4b87-b212-e68d09cc2c1c" returned: 0 in 0.334s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:31:06 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-43e1c980-26ba-4370-b606-ed602ce73df7 tempest-VolumesGetTest-855358902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-929878c3-5ccc-4334-926f-2fa20a0c305d.0a968bbd-232b-4b87-b212-e68d09cc2c1c {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:31:06 devstack sudo[99554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-929878c3-5ccc-4334-926f-2fa20a0c305d.0a968bbd-232b-4b87-b212-e68d09cc2c1c
Jul 30 20:31:06 devstack sudo[99554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:31:06 devstack sudo[99554]: pam_unix(sudo:session): session closed for user root
Jul 30 20:31:06 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-43e1c980-26ba-4370-b606-ed602ce73df7 tempest-VolumesGetTest-855358902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-929878c3-5ccc-4334-926f-2fa20a0c305d.0a968bbd-232b-4b87-b212-e68d09cc2c1c" returned: 0 in 0.246s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:31:06 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-43e1c980-26ba-4370-b606-ed602ce73df7 tempest-VolumesGetTest-855358902 None] Lock "cinder-quobyte-0a968bbd-232b-4b87-b212-e68d09cc2c1c" released by "_delete_snapshot" :: held 1.637s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:31:06 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-43e1c980-26ba-4370-b606-ed602ce73df7 tempest-VolumesGetTest-855358902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.884s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:31:06 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-fb9cbd5f-94f1-4f18-9b6f-bfb7d72b296a tempest-GroupSnapshotsTest-296266448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.004s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:31:06 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-fb9cbd5f-94f1-4f18-9b6f-bfb7d72b296a tempest-GroupSnapshotsTest-296266448 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=afb4548d-9a1d-408d-bd36-098bb7341c65,created_at=2026-07-30T18:30:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-851617419',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=afb4548d-9a1d-408d-bd36-098bb7341c65,host='devstack@QuobyteHD#QuobyteHD',id=6aec8396-c8b8-4d57-b369-cead782edcc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9a30efeb6fe428bbf6b21c25f0e9ae2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:30:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:30:52Z,use_quota=True,user_id='b7501c2b5cc547a8b7d91d86c5d9f3ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fb6c0ca-7808-4fe9-aeef-dbcdf2a60bcd),volume_type_id=6fb6c0ca-7808-4fe9-aeef-dbcdf2a60bcd)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:31:06 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-fb9cbd5f-94f1-4f18-9b6f-bfb7d72b296a tempest-GroupSnapshotsTest-296266448 None] Creating volume 6aec8396-c8b8-4d57-b369-cead782edcc3 {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:31:06 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-fb9cbd5f-94f1-4f18-9b6f-bfb7d72b296a tempest-GroupSnapshotsTest-296266448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:31:06 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-fb9cbd5f-94f1-4f18-9b6f-bfb7d72b296a tempest-GroupSnapshotsTest-296266448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:31:06 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-fb9cbd5f-94f1-4f18-9b6f-bfb7d72b296a tempest-GroupSnapshotsTest-296266448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:31:06 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-fb9cbd5f-94f1-4f18-9b6f-bfb7d72b296a tempest-GroupSnapshotsTest-296266448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:31:06 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-fb9cbd5f-94f1-4f18-9b6f-bfb7d72b296a tempest-GroupSnapshotsTest-296266448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:31:06 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-fb9cbd5f-94f1-4f18-9b6f-bfb7d72b296a tempest-GroupSnapshotsTest-296266448 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:31:06 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-fb9cbd5f-94f1-4f18-9b6f-bfb7d72b296a tempest-GroupSnapshotsTest-296266448 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:31:06 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-fb9cbd5f-94f1-4f18-9b6f-bfb7d72b296a tempest-GroupSnapshotsTest-296266448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6aec8396-c8b8-4d57-b369-cead782edcc3 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:31:06 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-43e1c980-26ba-4370-b606-ed602ce73df7 tempest-VolumesGetTest-855358902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c4ca1ea-af6f-4078-800f-101ad982edea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a596314-76da-48bf-be90-05c95a94a2a0', 'volume_size': 1, 'source_volid': '929878c3-5ccc-4334-926f-2fa20a0c305d', 'source_volstatus': 'available'}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:31:06 devstack sudo[99557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6aec8396-c8b8-4d57-b369-cead782edcc3 1073741824
Jul 30 20:31:06 devstack sudo[99557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:31:06 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-43e1c980-26ba-4370-b606-ed602ce73df7 tempest-VolumesGetTest-855358902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed786fc5-0f1f-4bb9-8590-cdc03113926b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:31:06 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-43e1c980-26ba-4370-b606-ed602ce73df7 tempest-VolumesGetTest-855358902 None] Volume volume-2a596314-76da-48bf-be90-05c95a94a2a0 (2a596314-76da-48bf-be90-05c95a94a2a0): created successfully
Jul 30 20:31:06 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-43e1c980-26ba-4370-b606-ed602ce73df7 tempest-VolumesGetTest-855358902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed786fc5-0f1f-4bb9-8590-cdc03113926b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:31:06 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-43e1c980-26ba-4370-b606-ed602ce73df7 tempest-VolumesGetTest-855358902 None] Flow 'volume_create_manager' (4bf77677-9aaa-4118-8f14-f727a28adbc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:31:06 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-43e1c980-26ba-4370-b606-ed602ce73df7 tempest-VolumesGetTest-855358902 None] Created volume successfully.
Jul 30 20:31:07 devstack sudo[99557]: pam_unix(sudo:session): session closed for user root
Jul 30 20:31:07 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-fb9cbd5f-94f1-4f18-9b6f-bfb7d72b296a tempest-GroupSnapshotsTest-296266448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6aec8396-c8b8-4d57-b369-cead782edcc3 1073741824" returned: 0 in 0.508s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:31:07 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-fb9cbd5f-94f1-4f18-9b6f-bfb7d72b296a tempest-GroupSnapshotsTest-296266448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6aec8396-c8b8-4d57-b369-cead782edcc3 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:31:07 devstack sudo[99563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6aec8396-c8b8-4d57-b369-cead782edcc3
Jul 30 20:31:07 devstack sudo[99563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:31:07 devstack sudo[99563]: pam_unix(sudo:session): session closed for user root
Jul 30 20:31:07 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-fb9cbd5f-94f1-4f18-9b6f-bfb7d72b296a tempest-GroupSnapshotsTest-296266448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6aec8396-c8b8-4d57-b369-cead782edcc3" returned: 0 in 0.254s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:31:07 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-fb9cbd5f-94f1-4f18-9b6f-bfb7d72b296a tempest-GroupSnapshotsTest-296266448 None] <== create_volume: return (798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:31:07 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-fb9cbd5f-94f1-4f18-9b6f-bfb7d72b296a tempest-GroupSnapshotsTest-296266448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.801s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:31:07 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-40a6a922-5776-4ff4-a53a-0e2ff0ed2ff2 tempest-VolumesActionsTest-1221656799 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 5.128s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:31:07 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[de3e884b-b9d3-46dc-a045-9ca0b2c4a830]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:31:07 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-fb9cbd5f-94f1-4f18-9b6f-bfb7d72b296a tempest-GroupSnapshotsTest-296266448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bca5cfe3-a66f-4c75-8e55-6193cba8af52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6aec8396-c8b8-4d57-b369-cead782edcc3', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:31:07 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-fb9cbd5f-94f1-4f18-9b6f-bfb7d72b296a tempest-GroupSnapshotsTest-296266448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a896027-792c-4438-9366-c014d87eb37a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:31:07 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-40a6a922-5776-4ff4-a53a-0e2ff0ed2ff2 tempest-VolumesActionsTest-1221656799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2246a04e-ffb2-4da5-80e1-68fdc8d88bc4 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:31:07 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-fb9cbd5f-94f1-4f18-9b6f-bfb7d72b296a tempest-GroupSnapshotsTest-296266448 None] Volume volume-6aec8396-c8b8-4d57-b369-cead782edcc3 (6aec8396-c8b8-4d57-b369-cead782edcc3): created successfully
Jul 30 20:31:07 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-fb9cbd5f-94f1-4f18-9b6f-bfb7d72b296a tempest-GroupSnapshotsTest-296266448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a896027-792c-4438-9366-c014d87eb37a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:31:07 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-fb9cbd5f-94f1-4f18-9b6f-bfb7d72b296a tempest-GroupSnapshotsTest-296266448 None] Flow 'volume_create_manager' (0b984c3f-ef82-4eba-8009-e4baae38c88a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:31:07 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-fb9cbd5f-94f1-4f18-9b6f-bfb7d72b296a tempest-GroupSnapshotsTest-296266448 None] Created volume successfully.
Jul 30 20:31:07 devstack sudo[99566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2246a04e-ffb2-4da5-80e1-68fdc8d88bc4
Jul 30 20:31:07 devstack sudo[99566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:31:08 devstack sudo[99566]: pam_unix(sudo:session): session closed for user root
Jul 30 20:31:08 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-40a6a922-5776-4ff4-a53a-0e2ff0ed2ff2 tempest-VolumesActionsTest-1221656799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2246a04e-ffb2-4da5-80e1-68fdc8d88bc4" returned: 0 in 0.410s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:31:08 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0b1899a-03d1-4072-b1b3-41f7fa7330f0]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:31:08 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-40a6a922-5776-4ff4-a53a-0e2ff0ed2ff2 tempest-VolumesActionsTest-1221656799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2246a04e-ffb2-4da5-80e1-68fdc8d88bc4 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:31:08 devstack sudo[99571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2246a04e-ffb2-4da5-80e1-68fdc8d88bc4
Jul 30 20:31:08 devstack sudo[99571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:31:08 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-ce077495-ed75-4f0a-b116-355c9b202001 tempest-GroupSnapshotsTest-296266448 None] GroupSnapshot 2171251d-bcf2-4c93-a23d-9c9aaaabd599: creating.
Jul 30 20:31:08 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-ce077495-ed75-4f0a-b116-355c9b202001 tempest-GroupSnapshotsTest-296266448 None] Group snapshot 2171251d-bcf2-4c93-a23d-9c9aaaabd599: creating. {{(pid=88719) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jul 30 20:31:08 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-ce077495-ed75-4f0a-b116-355c9b202001 tempest-GroupSnapshotsTest-296266448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:31:08 devstack sudo[99571]: pam_unix(sudo:session): session closed for user root
Jul 30 20:31:08 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-40a6a922-5776-4ff4-a53a-0e2ff0ed2ff2 tempest-VolumesActionsTest-1221656799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2246a04e-ffb2-4da5-80e1-68fdc8d88bc4" returned: 0 in 0.466s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:31:08 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-40a6a922-5776-4ff4-a53a-0e2ff0ed2ff2 tempest-VolumesActionsTest-1221656799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2246a04e-ffb2-4da5-80e1-68fdc8d88bc4 /opt/stack/data/cinder/conversion/2246a04e-ffb2-4da5-80e1-68fdc8d88bc4.temp_image.e12dceb9-de9d-438e-a033-d4500edddf5cyvslvehc.img {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:31:08 devstack sudo[99576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2246a04e-ffb2-4da5-80e1-68fdc8d88bc4 /opt/stack/data/cinder/conversion/2246a04e-ffb2-4da5-80e1-68fdc8d88bc4.temp_image.e12dceb9-de9d-438e-a033-d4500edddf5cyvslvehc.img
Jul 30 20:31:08 devstack sudo[99576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:31:08 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3f3d3e1-c368-4158-931d-08cbc564cd47 tempest-VolumesGetTest-855358902 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:31:08 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-d3f3d3e1-c368-4158-931d-08cbc564cd47 tempest-VolumesGetTest-855358902 None] Flow 'volume_create_manager' (df8d9b61-b046-4767-8273-70fdab95acdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:31:08 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-d3f3d3e1-c368-4158-931d-08cbc564cd47 tempest-VolumesGetTest-855358902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fab3dd71-53d9-4b31-a2d4-b2e1cdb54b41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:31:08 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-d3f3d3e1-c368-4158-931d-08cbc564cd47 tempest-VolumesGetTest-855358902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fab3dd71-53d9-4b31-a2d4-b2e1cdb54b41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:31:08Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2082515844',display_name='tempest-VolumesGetTest-Volume-247837833',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=684b7354-83c9-44cb-bd86-2000cc60d6e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95dc6a3a598a411dbd7b034cb48fcbb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:31:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:31:08Z,use_quota=True,user_id='e1274cdacdf54e3fbb200f3552412b74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:31:08 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-d3f3d3e1-c368-4158-931d-08cbc564cd47 tempest-VolumesGetTest-855358902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5ae6922-cff4-4911-9e29-67f5c1950880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:31:08 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-d3f3d3e1-c368-4158-931d-08cbc564cd47 tempest-VolumesGetTest-855358902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5ae6922-cff4-4911-9e29-67f5c1950880) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:31:08 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-d3f3d3e1-c368-4158-931d-08cbc564cd47 tempest-VolumesGetTest-855358902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10a4ed60-0b20-4eb9-9e56-2f631b442846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:31:08 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-d3f3d3e1-c368-4158-931d-08cbc564cd47 tempest-VolumesGetTest-855358902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10a4ed60-0b20-4eb9-9e56-2f631b442846) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '684b7354-83c9-44cb-bd86-2000cc60d6e0', 'volume_name': 'volume-684b7354-83c9-44cb-bd86-2000cc60d6e0', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:31:08 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-d3f3d3e1-c368-4158-931d-08cbc564cd47 tempest-VolumesGetTest-855358902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b8061e9-bceb-4aad-9329-674433e66f54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:31:08 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-d3f3d3e1-c368-4158-931d-08cbc564cd47 tempest-VolumesGetTest-855358902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b8061e9-bceb-4aad-9329-674433e66f54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:31:08 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-d3f3d3e1-c368-4158-931d-08cbc564cd47 tempest-VolumesGetTest-855358902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (119cd773-fff0-4b29-ada3-e36515558418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:31:08 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-d3f3d3e1-c368-4158-931d-08cbc564cd47 tempest-VolumesGetTest-855358902 None] Volume 684b7354-83c9-44cb-bd86-2000cc60d6e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-684b7354-83c9-44cb-bd86-2000cc60d6e0', 'volume_size': 1}
Jul 30 20:31:08 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-d3f3d3e1-c368-4158-931d-08cbc564cd47 tempest-VolumesGetTest-855358902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:31:10 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1d60229-3652-418c-9811-68853c5f6074 tempest-VolumesTransfersTest-1267868163 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:31:10 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-b1d60229-3652-418c-9811-68853c5f6074 tempest-VolumesTransfersTest-1267868163 None] Flow 'volume_create_manager' (c6ef6927-bcdf-4e31-ab3f-50aba0af01f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:31:10 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-b1d60229-3652-418c-9811-68853c5f6074 tempest-VolumesTransfersTest-1267868163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60bd56b9-bca9-42b1-92f1-4a89f6b0adb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:31:10 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-b1d60229-3652-418c-9811-68853c5f6074 tempest-VolumesTransfersTest-1267868163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60bd56b9-bca9-42b1-92f1-4a89f6b0adb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:31:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1342812276',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f36f9c0-ce60-4d8a-adeb-87aa5956a2e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33397095abac4d36a20c95100d5f4114',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:31:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:31:10Z,use_quota=True,user_id='9f4266c66e7446d4b3cfb830db2d17e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:31:10 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-b1d60229-3652-418c-9811-68853c5f6074 tempest-VolumesTransfersTest-1267868163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (659d0425-5cee-4713-96da-678cdb699258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:31:10 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-b1d60229-3652-418c-9811-68853c5f6074 tempest-VolumesTransfersTest-1267868163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (659d0425-5cee-4713-96da-678cdb699258) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:31:10 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-b1d60229-3652-418c-9811-68853c5f6074 tempest-VolumesTransfersTest-1267868163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffecb83c-cb2e-4759-a07b-34939e0589bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:31:10 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-b1d60229-3652-418c-9811-68853c5f6074 tempest-VolumesTransfersTest-1267868163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffecb83c-cb2e-4759-a07b-34939e0589bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f36f9c0-ce60-4d8a-adeb-87aa5956a2e2', 'volume_name': 'volume-6f36f9c0-ce60-4d8a-adeb-87aa5956a2e2', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:31:10 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-b1d60229-3652-418c-9811-68853c5f6074 tempest-VolumesTransfersTest-1267868163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f42a1d1d-ce48-469f-a0f9-70c448b7cb6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:31:10 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-b1d60229-3652-418c-9811-68853c5f6074 tempest-VolumesTransfersTest-1267868163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f42a1d1d-ce48-469f-a0f9-70c448b7cb6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:31:10 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-b1d60229-3652-418c-9811-68853c5f6074 tempest-VolumesTransfersTest-1267868163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f4ea25b-1f7e-40d3-90dc-6699296956e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:31:10 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-b1d60229-3652-418c-9811-68853c5f6074 tempest-VolumesTransfersTest-1267868163 None] Volume 6f36f9c0-ce60-4d8a-adeb-87aa5956a2e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f36f9c0-ce60-4d8a-adeb-87aa5956a2e2', 'volume_size': 1}
Jul 30 20:31:10 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-b1d60229-3652-418c-9811-68853c5f6074 tempest-VolumesTransfersTest-1267868163 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:31:12 devstack sudo[99576]: pam_unix(sudo:session): session closed for user root
Jul 30 20:31:12 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-40a6a922-5776-4ff4-a53a-0e2ff0ed2ff2 tempest-VolumesActionsTest-1221656799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2246a04e-ffb2-4da5-80e1-68fdc8d88bc4 /opt/stack/data/cinder/conversion/2246a04e-ffb2-4da5-80e1-68fdc8d88bc4.temp_image.e12dceb9-de9d-438e-a033-d4500edddf5cyvslvehc.img" returned: 0 in 4.393s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:31:12 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad2290ab-b1f1-46bd-b0dc-84bfcd45455e]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:31:12 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-40a6a922-5776-4ff4-a53a-0e2ff0ed2ff2 tempest-VolumesActionsTest-1221656799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2246a04e-ffb2-4da5-80e1-68fdc8d88bc4 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:31:13 devstack sudo[99590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2246a04e-ffb2-4da5-80e1-68fdc8d88bc4
Jul 30 20:31:13 devstack sudo[99590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:31:13 devstack sudo[99590]: pam_unix(sudo:session): session closed for user root
Jul 30 20:31:13 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-40a6a922-5776-4ff4-a53a-0e2ff0ed2ff2 tempest-VolumesActionsTest-1221656799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2246a04e-ffb2-4da5-80e1-68fdc8d88bc4" returned: 0 in 0.508s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:31:13 devstack cinder-volume[88719]: DEBUG cinder.image.image_utils [None req-40a6a922-5776-4ff4-a53a-0e2ff0ed2ff2 tempest-VolumesActionsTest-1221656799 None] Image conversion details: src /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2246a04e-ffb2-4da5-80e1-68fdc8d88bc4, size 1024.00 MB, duration 4.39 sec, destination /opt/stack/data/cinder/conversion/2246a04e-ffb2-4da5-80e1-68fdc8d88bc4.temp_image.e12dceb9-de9d-438e-a033-d4500edddf5cyvslvehc.img {{(pid=88719) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 30 20:31:13 devstack cinder-volume[88719]: INFO cinder.image.image_utils [None req-40a6a922-5776-4ff4-a53a-0e2ff0ed2ff2 tempest-VolumesActionsTest-1221656799 None] Converted 1024.00 MB image at 233.02 MB/s
Jul 30 20:31:13 devstack cinder-volume[88719]: DEBUG cinder.image.image_utils [None req-40a6a922-5776-4ff4-a53a-0e2ff0ed2ff2 tempest-VolumesActionsTest-1221656799 None] e12dceb9-de9d-438e-a033-d4500edddf5c was raw, no need to convert to raw {{(pid=88719) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}}
Jul 30 20:31:16 devstack cinder-volume[88719]: DEBUG oslo_service.periodic_task [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88719) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 30 20:31:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:31:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:31:16 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:31:16 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:31:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:31:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:31:16 devstack sudo[99597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:31:16 devstack sudo[99597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:31:16 devstack sudo[99597]: pam_unix(sudo:session): session closed for user root
Jul 30 20:31:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.261s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:31:16 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:31:16 devstack cinder-volume[88719]: DEBUG oslo_service.periodic_task [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Running periodic task VolumeManager._thread_info {{(pid=88719) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 30 20:31:16 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] thread count: 28 {{(pid=88719) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 30 20:31:16 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] thread info: [<_MainThread(MainThread, started 132390416908416)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132390306497536)>, <Thread(Thread-3 (stat_writer), started daemon 132390304471680)>, <Thread(Rabbit-heartbeat, started daemon 132390303393408)>, <Thread(Thread-5 (_runner), started daemon 132390303543168)>, <Thread(Thread-7 (_runner), started daemon 132390303563392)>, <Thread(fd_logger, started daemon 132390301344640)>, <Thread(privsep_reader, started daemon 132390301560640)>, <Thread(tpool_thread_0, started daemon 132390291470016)>, <Thread(tpool_thread_1, started daemon 132390283077312)>, <Thread(tpool_thread_2, started daemon 132390274684608)>, <Thread(tpool_thread_3, started daemon 132390266291904)>, <Thread(tpool_thread_4, started daemon 132390257899200)>, <Thread(tpool_thread_5, started daemon 132390249506496)>, <Thread(tpool_thread_6, started daemon 132390241113792)>, <Thread(tpool_thread_7, started daemon 132390232721088)>, <Thread(tpool_thread_8, started daemon 132390224328384)>, <Thread(tpool_thread_9, started daemon 132390215919296)>, <Thread(tpool_thread_10, started daemon 132390207510208)>, <Thread(tpool_thread_11, started daemon 132390199101120)>, <Thread(tpool_thread_12, started daemon 132390190692032)>, <Thread(tpool_thread_13, started daemon 132390182282944)>, <Thread(tpool_thread_14, started daemon 132390173873856)>, <Thread(tpool_thread_15, started daemon 132390165464768)>, <Thread(tpool_thread_16, started daemon 132390157055680)>, <Thread(tpool_thread_17, started daemon 132390148646592)>, <Thread(tpool_thread_18, started daemon 132390140237504)>, <Thread(tpool_thread_19, started daemon 132390131828416)>] {{(pid=88719) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 30 20:31:20 devstack cinder-volume[88719]: DEBUG dbcounter [-] [88719] Writing DB stats cinder:SELECT=74,cinder:INSERT=25,cinder:UPDATE=96,cinder:DELETE=6 {{(pid=88719) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 30 20:31:23 devstack cinder-volume[88719]: DEBUG dbcounter [-] [88719] Writing DB stats cinder:SELECT=81,cinder:UPDATE=86,cinder:INSERT=22,cinder:DELETE=4 {{(pid=88719) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 30 20:31:31 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-40a6a922-5776-4ff4-a53a-0e2ff0ed2ff2 tempest-VolumesActionsTest-1221656799 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 24.388s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:31:31 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-40a6a922-5776-4ff4-a53a-0e2ff0ed2ff2 tempest-VolumesActionsTest-1221656799 None] Uploaded volume to glance image-id: e12dceb9-de9d-438e-a033-d4500edddf5c. {{(pid=88719) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Jul 30 20:31:31 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-ce077495-ed75-4f0a-b116-355c9b202001 tempest-GroupSnapshotsTest-296266448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 23.491s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:31:31 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-ce077495-ed75-4f0a-b116-355c9b202001 tempest-GroupSnapshotsTest-296266448 None] Creating offline snapshot 229a1695-09d2-469e-9339-caf20824f26e of volume 6aec8396-c8b8-4d57-b369-cead782edcc3 {{(pid=88719) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 30 20:31:31 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-40a6a922-5776-4ff4-a53a-0e2ff0ed2ff2 tempest-VolumesActionsTest-1221656799 None] Copy volume to image completed successfully.
Jul 30 20:31:31 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[94a4125f-fd49-46f8-b7b8-4c1c5ccf50fe]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:31:31 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-ce077495-ed75-4f0a-b116-355c9b202001 tempest-GroupSnapshotsTest-296266448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6aec8396-c8b8-4d57-b369-cead782edcc3 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:31:32 devstack sudo[99601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6aec8396-c8b8-4d57-b369-cead782edcc3
Jul 30 20:31:32 devstack sudo[99601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:31:32 devstack sudo[99601]: pam_unix(sudo:session): session closed for user root
Jul 30 20:31:32 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-ce077495-ed75-4f0a-b116-355c9b202001 tempest-GroupSnapshotsTest-296266448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6aec8396-c8b8-4d57-b369-cead782edcc3" returned: 0 in 0.361s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:31:32 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-ce077495-ed75-4f0a-b116-355c9b202001 tempest-GroupSnapshotsTest-296266448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6aec8396-c8b8-4d57-b369-cead782edcc3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6aec8396-c8b8-4d57-b369-cead782edcc3.229a1695-09d2-469e-9339-caf20824f26e 1G {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:31:32 devstack sudo[99608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6aec8396-c8b8-4d57-b369-cead782edcc3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6aec8396-c8b8-4d57-b369-cead782edcc3.229a1695-09d2-469e-9339-caf20824f26e 1G
Jul 30 20:31:32 devstack sudo[99608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:31:32 devstack sudo[99608]: pam_unix(sudo:session): session closed for user root
Jul 30 20:31:32 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-ce077495-ed75-4f0a-b116-355c9b202001 tempest-GroupSnapshotsTest-296266448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6aec8396-c8b8-4d57-b369-cead782edcc3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6aec8396-c8b8-4d57-b369-cead782edcc3.229a1695-09d2-469e-9339-caf20824f26e 1G" returned: 0 in 0.429s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:31:32 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-ce077495-ed75-4f0a-b116-355c9b202001 tempest-GroupSnapshotsTest-296266448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6aec8396-c8b8-4d57-b369-cead782edcc3 -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6aec8396-c8b8-4d57-b369-cead782edcc3.229a1695-09d2-469e-9339-caf20824f26e {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:31:32 devstack sudo[99614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6aec8396-c8b8-4d57-b369-cead782edcc3 -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6aec8396-c8b8-4d57-b369-cead782edcc3.229a1695-09d2-469e-9339-caf20824f26e
Jul 30 20:31:32 devstack sudo[99614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:31:33 devstack sudo[99614]: pam_unix(sudo:session): session closed for user root
Jul 30 20:31:33 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-ce077495-ed75-4f0a-b116-355c9b202001 tempest-GroupSnapshotsTest-296266448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6aec8396-c8b8-4d57-b369-cead782edcc3 -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6aec8396-c8b8-4d57-b369-cead782edcc3.229a1695-09d2-469e-9339-caf20824f26e" returned: 0 in 0.309s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:31:33 devstack cinder-volume[88719]: WARNING cinder.volume.drivers.remotefs [None req-ce077495-ed75-4f0a-b116-355c9b202001 tempest-GroupSnapshotsTest-296266448 None] /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6aec8396-c8b8-4d57-b369-cead782edcc3.229a1695-09d2-469e-9339-caf20824f26e is being set with open permissions: ugo+rw: NotImplementedError
Jul 30 20:31:33 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-ce077495-ed75-4f0a-b116-355c9b202001 tempest-GroupSnapshotsTest-296266448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6aec8396-c8b8-4d57-b369-cead782edcc3.229a1695-09d2-469e-9339-caf20824f26e {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:31:33 devstack sudo[99620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6aec8396-c8b8-4d57-b369-cead782edcc3.229a1695-09d2-469e-9339-caf20824f26e
Jul 30 20:31:33 devstack sudo[99620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:31:33 devstack sudo[99620]: pam_unix(sudo:session): session closed for user root
Jul 30 20:31:33 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-ce077495-ed75-4f0a-b116-355c9b202001 tempest-GroupSnapshotsTest-296266448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6aec8396-c8b8-4d57-b369-cead782edcc3.229a1695-09d2-469e-9339-caf20824f26e" returned: 0 in 0.243s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:31:33 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-ce077495-ed75-4f0a-b116-355c9b202001 tempest-GroupSnapshotsTest-296266448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6aec8396-c8b8-4d57-b369-cead782edcc3.info {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:31:33 devstack sudo[99623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6aec8396-c8b8-4d57-b369-cead782edcc3.info
Jul 30 20:31:33 devstack sudo[99623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:31:33 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-57cd98c3-efb1-446f-88b7-8e39be080887 tempest-VolumesActionsTest-1221656799 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:31:33 devstack sudo[99623]: pam_unix(sudo:session): session closed for user root
Jul 30 20:31:33 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-ce077495-ed75-4f0a-b116-355c9b202001 tempest-GroupSnapshotsTest-296266448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6aec8396-c8b8-4d57-b369-cead782edcc3.info" returned: 0 in 0.262s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:31:33 devstack cinder-volume[88719]: WARNING cinder.volume.drivers.remotefs [None req-ce077495-ed75-4f0a-b116-355c9b202001 tempest-GroupSnapshotsTest-296266448 None] /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6aec8396-c8b8-4d57-b369-cead782edcc3.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 30 20:31:33 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-ce077495-ed75-4f0a-b116-355c9b202001 tempest-GroupSnapshotsTest-296266448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6aec8396-c8b8-4d57-b369-cead782edcc3.info {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:31:33 devstack sudo[99626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6aec8396-c8b8-4d57-b369-cead782edcc3.info
Jul 30 20:31:33 devstack sudo[99626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:31:33 devstack sudo[99626]: pam_unix(sudo:session): session closed for user root
Jul 30 20:31:33 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-ce077495-ed75-4f0a-b116-355c9b202001 tempest-GroupSnapshotsTest-296266448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6aec8396-c8b8-4d57-b369-cead782edcc3.info" returned: 0 in 0.250s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:31:33 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-ce077495-ed75-4f0a-b116-355c9b202001 tempest-GroupSnapshotsTest-296266448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.951s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:31:33 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-d3f3d3e1-c368-4158-931d-08cbc564cd47 tempest-VolumesGetTest-855358902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 25.267s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:31:33 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-d3f3d3e1-c368-4158-931d-08cbc564cd47 tempest-VolumesGetTest-855358902 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:31:08Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2082515844',display_name='tempest-VolumesGetTest-Volume-247837833',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=684b7354-83c9-44cb-bd86-2000cc60d6e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95dc6a3a598a411dbd7b034cb48fcbb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:31:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:31:08Z,use_quota=True,user_id='e1274cdacdf54e3fbb200f3552412b74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:31:33 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-d3f3d3e1-c368-4158-931d-08cbc564cd47 tempest-VolumesGetTest-855358902 None] Creating volume 684b7354-83c9-44cb-bd86-2000cc60d6e0 {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:31:33 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-d3f3d3e1-c368-4158-931d-08cbc564cd47 tempest-VolumesGetTest-855358902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:31:33 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-d3f3d3e1-c368-4158-931d-08cbc564cd47 tempest-VolumesGetTest-855358902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:31:33 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-d3f3d3e1-c368-4158-931d-08cbc564cd47 tempest-VolumesGetTest-855358902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:31:33 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-d3f3d3e1-c368-4158-931d-08cbc564cd47 tempest-VolumesGetTest-855358902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:31:33 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-d3f3d3e1-c368-4158-931d-08cbc564cd47 tempest-VolumesGetTest-855358902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:31:33 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-d3f3d3e1-c368-4158-931d-08cbc564cd47 tempest-VolumesGetTest-855358902 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:31:33 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-d3f3d3e1-c368-4158-931d-08cbc564cd47 tempest-VolumesGetTest-855358902 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:31:33 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-d3f3d3e1-c368-4158-931d-08cbc564cd47 tempest-VolumesGetTest-855358902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-684b7354-83c9-44cb-bd86-2000cc60d6e0 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:31:33 devstack sudo[99629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-684b7354-83c9-44cb-bd86-2000cc60d6e0 1073741824
Jul 30 20:31:33 devstack sudo[99629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:31:34 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-ce077495-ed75-4f0a-b116-355c9b202001 tempest-GroupSnapshotsTest-296266448 None] group_snapshot 2171251d-bcf2-4c93-a23d-9c9aaaabd599: created successfully
Jul 30 20:31:34 devstack sudo[99629]: pam_unix(sudo:session): session closed for user root
Jul 30 20:31:34 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-d3f3d3e1-c368-4158-931d-08cbc564cd47 tempest-VolumesGetTest-855358902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-684b7354-83c9-44cb-bd86-2000cc60d6e0 1073741824" returned: 0 in 0.408s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:31:34 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-d3f3d3e1-c368-4158-931d-08cbc564cd47 tempest-VolumesGetTest-855358902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-684b7354-83c9-44cb-bd86-2000cc60d6e0 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:31:34 devstack sudo[99635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-684b7354-83c9-44cb-bd86-2000cc60d6e0
Jul 30 20:31:34 devstack sudo[99635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:31:34 devstack sudo[99635]: pam_unix(sudo:session): session closed for user root
Jul 30 20:31:34 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-d3f3d3e1-c368-4158-931d-08cbc564cd47 tempest-VolumesGetTest-855358902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-684b7354-83c9-44cb-bd86-2000cc60d6e0" returned: 0 in 0.241s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:31:34 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-d3f3d3e1-c368-4158-931d-08cbc564cd47 tempest-VolumesGetTest-855358902 None] <== create_volume: return (688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:31:34 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-d3f3d3e1-c368-4158-931d-08cbc564cd47 tempest-VolumesGetTest-855358902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.690s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:31:34 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-b1d60229-3652-418c-9811-68853c5f6074 tempest-VolumesTransfersTest-1267868163 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 23.811s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:31:34 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-b1d60229-3652-418c-9811-68853c5f6074 tempest-VolumesTransfersTest-1267868163 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:31:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1342812276',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f36f9c0-ce60-4d8a-adeb-87aa5956a2e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33397095abac4d36a20c95100d5f4114',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:31:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:31:10Z,use_quota=True,user_id='9f4266c66e7446d4b3cfb830db2d17e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:31:34 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-b1d60229-3652-418c-9811-68853c5f6074 tempest-VolumesTransfersTest-1267868163 None] Creating volume 6f36f9c0-ce60-4d8a-adeb-87aa5956a2e2 {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:31:34 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-b1d60229-3652-418c-9811-68853c5f6074 tempest-VolumesTransfersTest-1267868163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:31:34 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-b1d60229-3652-418c-9811-68853c5f6074 tempest-VolumesTransfersTest-1267868163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:31:34 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-b1d60229-3652-418c-9811-68853c5f6074 tempest-VolumesTransfersTest-1267868163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:31:34 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-b1d60229-3652-418c-9811-68853c5f6074 tempest-VolumesTransfersTest-1267868163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:31:34 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-b1d60229-3652-418c-9811-68853c5f6074 tempest-VolumesTransfersTest-1267868163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:31:34 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-b1d60229-3652-418c-9811-68853c5f6074 tempest-VolumesTransfersTest-1267868163 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:31:34 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-b1d60229-3652-418c-9811-68853c5f6074 tempest-VolumesTransfersTest-1267868163 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:31:34 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-b1d60229-3652-418c-9811-68853c5f6074 tempest-VolumesTransfersTest-1267868163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6f36f9c0-ce60-4d8a-adeb-87aa5956a2e2 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:31:34 devstack sudo[99639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6f36f9c0-ce60-4d8a-adeb-87aa5956a2e2 1073741824
Jul 30 20:31:34 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-d3f3d3e1-c368-4158-931d-08cbc564cd47 tempest-VolumesGetTest-855358902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (119cd773-fff0-4b29-ada3-e36515558418) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-684b7354-83c9-44cb-bd86-2000cc60d6e0', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:31:34 devstack sudo[99639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:31:34 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-d3f3d3e1-c368-4158-931d-08cbc564cd47 tempest-VolumesGetTest-855358902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (795789b4-be6a-41c8-b3f8-56b106a6c9d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:31:34 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-d3f3d3e1-c368-4158-931d-08cbc564cd47 tempest-VolumesGetTest-855358902 None] Volume volume-684b7354-83c9-44cb-bd86-2000cc60d6e0 (684b7354-83c9-44cb-bd86-2000cc60d6e0): created successfully
Jul 30 20:31:34 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-d3f3d3e1-c368-4158-931d-08cbc564cd47 tempest-VolumesGetTest-855358902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (795789b4-be6a-41c8-b3f8-56b106a6c9d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:31:34 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-d3f3d3e1-c368-4158-931d-08cbc564cd47 tempest-VolumesGetTest-855358902 None] Flow 'volume_create_manager' (df8d9b61-b046-4767-8273-70fdab95acdb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:31:34 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-d3f3d3e1-c368-4158-931d-08cbc564cd47 tempest-VolumesGetTest-855358902 None] Created volume successfully.
Jul 30 20:31:34 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-f19ccb76-1d41-48c8-837b-27948b7518fc tempest-GroupSnapshotsTest-296266448 None] group_snapshot 2171251d-bcf2-4c93-a23d-9c9aaaabd599: deleting
Jul 30 20:31:34 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-f19ccb76-1d41-48c8-837b-27948b7518fc tempest-GroupSnapshotsTest-296266448 None] group_snapshot 2171251d-bcf2-4c93-a23d-9c9aaaabd599: deleting {{(pid=88719) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jul 30 20:31:34 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-f19ccb76-1d41-48c8-837b-27948b7518fc tempest-GroupSnapshotsTest-296266448 None] Acquiring lock "cinder-quobyte-6aec8396-c8b8-4d57-b369-cead782edcc3" by "delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:31:34 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-f19ccb76-1d41-48c8-837b-27948b7518fc tempest-GroupSnapshotsTest-296266448 None] Lock "cinder-quobyte-6aec8396-c8b8-4d57-b369-cead782edcc3" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:31:34 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-f19ccb76-1d41-48c8-837b-27948b7518fc tempest-GroupSnapshotsTest-296266448 None] Acquiring lock "cinder-quobyte-229a1695-09d2-469e-9339-caf20824f26e" by "_delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:31:34 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-f19ccb76-1d41-48c8-837b-27948b7518fc tempest-GroupSnapshotsTest-296266448 None] Lock "cinder-quobyte-229a1695-09d2-469e-9339-caf20824f26e" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:31:34 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-f19ccb76-1d41-48c8-837b-27948b7518fc tempest-GroupSnapshotsTest-296266448 None] Deleting offline snapshot 229a1695-09d2-469e-9339-caf20824f26e of volume 6aec8396-c8b8-4d57-b369-cead782edcc3 {{(pid=88719) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 30 20:31:34 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-f19ccb76-1d41-48c8-837b-27948b7518fc tempest-GroupSnapshotsTest-296266448 None] snapshot_file for this snap is: volume-6aec8396-c8b8-4d57-b369-cead782edcc3.229a1695-09d2-469e-9339-caf20824f26e {{(pid=88719) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 30 20:31:34 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d8ea8a9-8575-4e14-a5a7-6e03f04ce8ca]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:31:34 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f19ccb76-1d41-48c8-837b-27948b7518fc tempest-GroupSnapshotsTest-296266448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6aec8396-c8b8-4d57-b369-cead782edcc3.229a1695-09d2-469e-9339-caf20824f26e {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:31:35 devstack sudo[99645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6aec8396-c8b8-4d57-b369-cead782edcc3.229a1695-09d2-469e-9339-caf20824f26e
Jul 30 20:31:35 devstack sudo[99645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:31:35 devstack sudo[99639]: pam_unix(sudo:session): session closed for user root
Jul 30 20:31:35 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-b1d60229-3652-418c-9811-68853c5f6074 tempest-VolumesTransfersTest-1267868163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6f36f9c0-ce60-4d8a-adeb-87aa5956a2e2 1073741824" returned: 0 in 0.493s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:31:35 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-b1d60229-3652-418c-9811-68853c5f6074 tempest-VolumesTransfersTest-1267868163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6f36f9c0-ce60-4d8a-adeb-87aa5956a2e2 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:31:35 devstack sudo[99648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6f36f9c0-ce60-4d8a-adeb-87aa5956a2e2
Jul 30 20:31:35 devstack sudo[99648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:31:35 devstack sudo[99645]: pam_unix(sudo:session): session closed for user root
Jul 30 20:31:35 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f19ccb76-1d41-48c8-837b-27948b7518fc tempest-GroupSnapshotsTest-296266448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6aec8396-c8b8-4d57-b369-cead782edcc3.229a1695-09d2-469e-9339-caf20824f26e" returned: 0 in 0.405s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:31:35 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-f19ccb76-1d41-48c8-837b-27948b7518fc tempest-GroupSnapshotsTest-296266448 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6aec8396-c8b8-4d57-b369-cead782edcc3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88719) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 30 20:31:35 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a5471cb-10a7-4d71-b850-485a767da6cf]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:31:35 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f19ccb76-1d41-48c8-837b-27948b7518fc tempest-GroupSnapshotsTest-296266448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6aec8396-c8b8-4d57-b369-cead782edcc3 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:31:35 devstack sudo[99648]: pam_unix(sudo:session): session closed for user root
Jul 30 20:31:35 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-b1d60229-3652-418c-9811-68853c5f6074 tempest-VolumesTransfersTest-1267868163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6f36f9c0-ce60-4d8a-adeb-87aa5956a2e2" returned: 0 in 0.261s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:31:35 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-b1d60229-3652-418c-9811-68853c5f6074 tempest-VolumesTransfersTest-1267868163 None] <== create_volume: return (794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:31:35 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-b1d60229-3652-418c-9811-68853c5f6074 tempest-VolumesTransfersTest-1267868163 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.797s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:31:35 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-57cd98c3-efb1-446f-88b7-8e39be080887 tempest-VolumesActionsTest-1221656799 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.947s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:31:35 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-b1d60229-3652-418c-9811-68853c5f6074 tempest-VolumesTransfersTest-1267868163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f4ea25b-1f7e-40d3-90dc-6699296956e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f36f9c0-ce60-4d8a-adeb-87aa5956a2e2', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:31:35 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-b1d60229-3652-418c-9811-68853c5f6074 tempest-VolumesTransfersTest-1267868163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7916db4e-3bb0-45d9-841b-dfccfb5c9630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:31:35 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b12ffa6-4a74-4e5f-858d-57f7045897cb]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:31:35 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-57cd98c3-efb1-446f-88b7-8e39be080887 tempest-VolumesActionsTest-1221656799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2246a04e-ffb2-4da5-80e1-68fdc8d88bc4 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:31:35 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-b1d60229-3652-418c-9811-68853c5f6074 tempest-VolumesTransfersTest-1267868163 None] Volume volume-6f36f9c0-ce60-4d8a-adeb-87aa5956a2e2 (6f36f9c0-ce60-4d8a-adeb-87aa5956a2e2): created successfully
Jul 30 20:31:35 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-b1d60229-3652-418c-9811-68853c5f6074 tempest-VolumesTransfersTest-1267868163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7916db4e-3bb0-45d9-841b-dfccfb5c9630) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:31:35 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-b1d60229-3652-418c-9811-68853c5f6074 tempest-VolumesTransfersTest-1267868163 None] Flow 'volume_create_manager' (c6ef6927-bcdf-4e31-ab3f-50aba0af01f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:31:35 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-d82182d7-6954-4bcb-b9c3-5c9fc7c5c2cc tempest-VolumesGetTest-855358902 None] Acquiring lock "cinder-684b7354-83c9-44cb-bd86-2000cc60d6e0-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:31:35 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-b1d60229-3652-418c-9811-68853c5f6074 tempest-VolumesTransfersTest-1267868163 None] Created volume successfully.
Jul 30 20:31:35 devstack sudo[99655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6aec8396-c8b8-4d57-b369-cead782edcc3
Jul 30 20:31:35 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-d82182d7-6954-4bcb-b9c3-5c9fc7c5c2cc tempest-VolumesGetTest-855358902 None] Lock "cinder-684b7354-83c9-44cb-bd86-2000cc60d6e0-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:31:35 devstack sudo[99655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:31:35 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-d82182d7-6954-4bcb-b9c3-5c9fc7c5c2cc tempest-VolumesGetTest-855358902 None] Acquiring lock "cinder-quobyte-684b7354-83c9-44cb-bd86-2000cc60d6e0" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:31:35 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-d82182d7-6954-4bcb-b9c3-5c9fc7c5c2cc tempest-VolumesGetTest-855358902 None] Lock "cinder-quobyte-684b7354-83c9-44cb-bd86-2000cc60d6e0" acquired by "delete_volume" :: waited 0.020s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:31:35 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[70ed1e28-e078-4fe9-bbbf-f4ed498b10c7]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:31:35 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-d82182d7-6954-4bcb-b9c3-5c9fc7c5c2cc tempest-VolumesGetTest-855358902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-684b7354-83c9-44cb-bd86-2000cc60d6e0 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:31:35 devstack sudo[99656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2246a04e-ffb2-4da5-80e1-68fdc8d88bc4
Jul 30 20:31:35 devstack sudo[99656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:31:35 devstack sudo[99659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-684b7354-83c9-44cb-bd86-2000cc60d6e0
Jul 30 20:31:35 devstack sudo[99659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:31:35 devstack sudo[99655]: pam_unix(sudo:session): session closed for user root
Jul 30 20:31:35 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f19ccb76-1d41-48c8-837b-27948b7518fc tempest-GroupSnapshotsTest-296266448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6aec8396-c8b8-4d57-b369-cead782edcc3" returned: 0 in 0.402s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:31:35 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f19ccb76-1d41-48c8-837b-27948b7518fc tempest-GroupSnapshotsTest-296266448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6aec8396-c8b8-4d57-b369-cead782edcc3.229a1695-09d2-469e-9339-caf20824f26e {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:31:35 devstack sudo[99665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6aec8396-c8b8-4d57-b369-cead782edcc3.229a1695-09d2-469e-9339-caf20824f26e
Jul 30 20:31:35 devstack sudo[99665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:31:35 devstack sudo[99656]: pam_unix(sudo:session): session closed for user root
Jul 30 20:31:35 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-57cd98c3-efb1-446f-88b7-8e39be080887 tempest-VolumesActionsTest-1221656799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2246a04e-ffb2-4da5-80e1-68fdc8d88bc4" returned: 0 in 0.440s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:31:35 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a6ee61-a28b-4aaf-9a74-2c0db9e24b36]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:31:35 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-57cd98c3-efb1-446f-88b7-8e39be080887 tempest-VolumesActionsTest-1221656799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2246a04e-ffb2-4da5-80e1-68fdc8d88bc4 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:31:35 devstack sudo[99659]: pam_unix(sudo:session): session closed for user root
Jul 30 20:31:35 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-d82182d7-6954-4bcb-b9c3-5c9fc7c5c2cc tempest-VolumesGetTest-855358902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-684b7354-83c9-44cb-bd86-2000cc60d6e0" returned: 0 in 0.384s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:31:35 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-d82182d7-6954-4bcb-b9c3-5c9fc7c5c2cc tempest-VolumesGetTest-855358902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-684b7354-83c9-44cb-bd86-2000cc60d6e0 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:31:36 devstack sudo[99670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2246a04e-ffb2-4da5-80e1-68fdc8d88bc4
Jul 30 20:31:36 devstack sudo[99670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:31:36 devstack sudo[99674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-684b7354-83c9-44cb-bd86-2000cc60d6e0
Jul 30 20:31:36 devstack sudo[99674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:31:36 devstack sudo[99665]: pam_unix(sudo:session): session closed for user root
Jul 30 20:31:36 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f19ccb76-1d41-48c8-837b-27948b7518fc tempest-GroupSnapshotsTest-296266448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6aec8396-c8b8-4d57-b369-cead782edcc3.229a1695-09d2-469e-9339-caf20824f26e" returned: 0 in 0.456s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:31:36 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f19ccb76-1d41-48c8-837b-27948b7518fc tempest-GroupSnapshotsTest-296266448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6aec8396-c8b8-4d57-b369-cead782edcc3.229a1695-09d2-469e-9339-caf20824f26e {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:31:36 devstack sudo[99683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6aec8396-c8b8-4d57-b369-cead782edcc3.229a1695-09d2-469e-9339-caf20824f26e
Jul 30 20:31:36 devstack sudo[99683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:31:36 devstack sudo[99674]: pam_unix(sudo:session): session closed for user root
Jul 30 20:31:36 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-d82182d7-6954-4bcb-b9c3-5c9fc7c5c2cc tempest-VolumesGetTest-855358902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-684b7354-83c9-44cb-bd86-2000cc60d6e0" returned: 0 in 0.307s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:31:36 devstack sudo[99670]: pam_unix(sudo:session): session closed for user root
Jul 30 20:31:36 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-d82182d7-6954-4bcb-b9c3-5c9fc7c5c2cc tempest-VolumesGetTest-855358902 None] Lock "cinder-quobyte-684b7354-83c9-44cb-bd86-2000cc60d6e0" released by "delete_volume" :: held 0.744s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:31:36 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-57cd98c3-efb1-446f-88b7-8e39be080887 tempest-VolumesActionsTest-1221656799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2246a04e-ffb2-4da5-80e1-68fdc8d88bc4" returned: 0 in 0.430s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:31:36 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-57cd98c3-efb1-446f-88b7-8e39be080887 tempest-VolumesActionsTest-1221656799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2246a04e-ffb2-4da5-80e1-68fdc8d88bc4 /opt/stack/data/cinder/conversion/2246a04e-ffb2-4da5-80e1-68fdc8d88bc4.temp_image.cd5c425a-d5ca-463f-a3ad-1dfa90e13a2dysz120p3.img {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:31:36 devstack sudo[99686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2246a04e-ffb2-4da5-80e1-68fdc8d88bc4 /opt/stack/data/cinder/conversion/2246a04e-ffb2-4da5-80e1-68fdc8d88bc4.temp_image.cd5c425a-d5ca-463f-a3ad-1dfa90e13a2dysz120p3.img
Jul 30 20:31:36 devstack sudo[99686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:31:36 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-d82182d7-6954-4bcb-b9c3-5c9fc7c5c2cc tempest-VolumesGetTest-855358902 None] Created reservations ['a5ad9d5d-24a3-4f88-b08b-1a09b96faf52', '7d782cdd-55c1-4be9-81e3-2ab7e7f39c19', 'f4c06461-c3a3-4b23-bd78-d62ef15ecd58', '92a4ced7-b8c6-48bb-82ac-20fba9ed4fa0'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:31:36 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-d82182d7-6954-4bcb-b9c3-5c9fc7c5c2cc tempest-VolumesGetTest-855358902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:31:36 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-d82182d7-6954-4bcb-b9c3-5c9fc7c5c2cc tempest-VolumesGetTest-855358902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:31:36 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-d82182d7-6954-4bcb-b9c3-5c9fc7c5c2cc tempest-VolumesGetTest-855358902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:31:36 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-d82182d7-6954-4bcb-b9c3-5c9fc7c5c2cc tempest-VolumesGetTest-855358902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:31:36 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-d82182d7-6954-4bcb-b9c3-5c9fc7c5c2cc tempest-VolumesGetTest-855358902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:31:36 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-d82182d7-6954-4bcb-b9c3-5c9fc7c5c2cc tempest-VolumesGetTest-855358902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:31:36 devstack sudo[99688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:31:36 devstack sudo[99688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:31:36 devstack sudo[99683]: pam_unix(sudo:session): session closed for user root
Jul 30 20:31:36 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f19ccb76-1d41-48c8-837b-27948b7518fc tempest-GroupSnapshotsTest-296266448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6aec8396-c8b8-4d57-b369-cead782edcc3.229a1695-09d2-469e-9339-caf20824f26e" returned: 0 in 0.293s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:31:36 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-f19ccb76-1d41-48c8-837b-27948b7518fc tempest-GroupSnapshotsTest-296266448 None] Lock "cinder-quobyte-229a1695-09d2-469e-9339-caf20824f26e" released by "_delete_snapshot" :: held 1.700s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:31:36 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-f19ccb76-1d41-48c8-837b-27948b7518fc tempest-GroupSnapshotsTest-296266448 None] Lock "cinder-quobyte-6aec8396-c8b8-4d57-b369-cead782edcc3" released by "delete_snapshot" :: held 1.733s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:31:36 devstack cinder-volume[88719]: WARNING cinder.quota [None req-f19ccb76-1d41-48c8-837b-27948b7518fc tempest-GroupSnapshotsTest-296266448 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2108547337 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2108547337, it is now deprecated. Please use the default quota class for default quota.
Jul 30 20:31:36 devstack cinder-volume[88719]: WARNING cinder.quota [None req-f19ccb76-1d41-48c8-837b-27948b7518fc tempest-GroupSnapshotsTest-296266448 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2108547337 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2108547337, it is now deprecated. Please use the default quota class for default quota.
Jul 30 20:31:36 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-f19ccb76-1d41-48c8-837b-27948b7518fc tempest-GroupSnapshotsTest-296266448 None] Created reservations ['9a8bc873-f2d9-4712-b834-db5621708c55', '176bb42b-737e-4f52-8922-01fe909c75ec', '2c958802-dee9-4416-8e8f-f1e0c5861a65', 'dca32720-940f-4064-a5f5-db566f8fe6e8'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:31:36 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-d8d3dbcc-43c6-4793-aa95-a74ccf7de772 tempest-VolumesGetTest-855358902 None] Acquiring lock "cinder-2a596314-76da-48bf-be90-05c95a94a2a0-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:31:37 devstack sudo[99688]: pam_unix(sudo:session): session closed for user root
Jul 30 20:31:37 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-d8d3dbcc-43c6-4793-aa95-a74ccf7de772 tempest-VolumesGetTest-855358902 None] Lock "cinder-2a596314-76da-48bf-be90-05c95a94a2a0-delete_volume" acquired by "delete_volume" :: waited 0.082s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:31:37 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-d82182d7-6954-4bcb-b9c3-5c9fc7c5c2cc tempest-VolumesGetTest-855358902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.635s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:31:37 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-d82182d7-6954-4bcb-b9c3-5c9fc7c5c2cc tempest-VolumesGetTest-855358902 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:31:37 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-d82182d7-6954-4bcb-b9c3-5c9fc7c5c2cc tempest-VolumesGetTest-855358902 None] Deleted volume successfully.
Jul 30 20:31:37 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-f19ccb76-1d41-48c8-837b-27948b7518fc tempest-GroupSnapshotsTest-296266448 None] group_snapshot 2171251d-bcf2-4c93-a23d-9c9aaaabd599: deleted successfully
Jul 30 20:31:37 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-d82182d7-6954-4bcb-b9c3-5c9fc7c5c2cc tempest-VolumesGetTest-855358902 None] Lock "cinder-684b7354-83c9-44cb-bd86-2000cc60d6e0-delete_volume" released by "delete_volume" :: held 1.789s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:31:37 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-d8d3dbcc-43c6-4793-aa95-a74ccf7de772 tempest-VolumesGetTest-855358902 None] Acquiring lock "cinder-quobyte-2a596314-76da-48bf-be90-05c95a94a2a0" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:31:37 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-15dd99a8-b0da-41c5-a970-072f057cb836 tempest-VolumesTransfersTest-960427827 None] Transfer volume completed successfully.
Jul 30 20:31:37 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-d8d3dbcc-43c6-4793-aa95-a74ccf7de772 tempest-VolumesGetTest-855358902 None] Lock "cinder-quobyte-2a596314-76da-48bf-be90-05c95a94a2a0" acquired by "delete_volume" :: waited 0.054s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:31:37 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5fe33d8-987d-4573-bbf0-86bb5bd80a5c]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:31:37 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-d8d3dbcc-43c6-4793-aa95-a74ccf7de772 tempest-VolumesGetTest-855358902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2a596314-76da-48bf-be90-05c95a94a2a0 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:31:37 devstack sudo[99702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2a596314-76da-48bf-be90-05c95a94a2a0
Jul 30 20:31:37 devstack sudo[99702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:31:38 devstack sudo[99702]: pam_unix(sudo:session): session closed for user root
Jul 30 20:31:38 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-d8d3dbcc-43c6-4793-aa95-a74ccf7de772 tempest-VolumesGetTest-855358902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2a596314-76da-48bf-be90-05c95a94a2a0" returned: 0 in 0.752s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:31:38 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-d8d3dbcc-43c6-4793-aa95-a74ccf7de772 tempest-VolumesGetTest-855358902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2a596314-76da-48bf-be90-05c95a94a2a0 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:31:38 devstack sudo[99709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2a596314-76da-48bf-be90-05c95a94a2a0
Jul 30 20:31:38 devstack sudo[99709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:31:38 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-8c7e41b4-96e1-4ae5-a5e0-6694b26ffd1f tempest-VolumesTransfersTest-1865792470 None] Acquiring lock "cinder-6f36f9c0-ce60-4d8a-adeb-87aa5956a2e2-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:31:38 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-8c7e41b4-96e1-4ae5-a5e0-6694b26ffd1f tempest-VolumesTransfersTest-1865792470 None] Lock "cinder-6f36f9c0-ce60-4d8a-adeb-87aa5956a2e2-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:31:38 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-8c7e41b4-96e1-4ae5-a5e0-6694b26ffd1f tempest-VolumesTransfersTest-1865792470 None] Acquiring lock "cinder-quobyte-6f36f9c0-ce60-4d8a-adeb-87aa5956a2e2" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:31:38 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-8c7e41b4-96e1-4ae5-a5e0-6694b26ffd1f tempest-VolumesTransfersTest-1865792470 None] Lock "cinder-quobyte-6f36f9c0-ce60-4d8a-adeb-87aa5956a2e2" acquired by "delete_volume" :: waited 0.043s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:31:38 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8b9a278-218f-4cea-915a-6f7bc133bd3f]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:31:38 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8c7e41b4-96e1-4ae5-a5e0-6694b26ffd1f tempest-VolumesTransfersTest-1865792470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6f36f9c0-ce60-4d8a-adeb-87aa5956a2e2 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:31:38 devstack sudo[99709]: pam_unix(sudo:session): session closed for user root
Jul 30 20:31:38 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-d8d3dbcc-43c6-4793-aa95-a74ccf7de772 tempest-VolumesGetTest-855358902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2a596314-76da-48bf-be90-05c95a94a2a0" returned: 0 in 0.689s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:31:38 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-d8d3dbcc-43c6-4793-aa95-a74ccf7de772 tempest-VolumesGetTest-855358902 None] Lock "cinder-quobyte-2a596314-76da-48bf-be90-05c95a94a2a0" released by "delete_volume" :: held 1.604s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:31:39 devstack sudo[99712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6f36f9c0-ce60-4d8a-adeb-87aa5956a2e2
Jul 30 20:31:39 devstack sudo[99712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:31:39 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-d8d3dbcc-43c6-4793-aa95-a74ccf7de772 tempest-VolumesGetTest-855358902 None] Created reservations ['9e158f5d-5f49-4815-9839-c1f6ec1343d0', 'f8a65bdc-91b7-40c4-9cb1-4c2090638fda', '36fadc4a-94eb-4ff5-8d89-5bc1d85009eb', '06f871b4-e4d2-4ca0-a889-87d66b7b6dae'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:31:39 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-d8d3dbcc-43c6-4793-aa95-a74ccf7de772 tempest-VolumesGetTest-855358902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:31:39 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-d8d3dbcc-43c6-4793-aa95-a74ccf7de772 tempest-VolumesGetTest-855358902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:31:39 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-d8d3dbcc-43c6-4793-aa95-a74ccf7de772 tempest-VolumesGetTest-855358902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:31:39 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-d8d3dbcc-43c6-4793-aa95-a74ccf7de772 tempest-VolumesGetTest-855358902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:31:39 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-d8d3dbcc-43c6-4793-aa95-a74ccf7de772 tempest-VolumesGetTest-855358902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:31:39 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-d8d3dbcc-43c6-4793-aa95-a74ccf7de772 tempest-VolumesGetTest-855358902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:31:39 devstack sudo[99714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:31:39 devstack sudo[99714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:31:39 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-46c1b298-56c5-4c6a-9260-6291e3a0c664 tempest-GroupSnapshotsTest-296266448 None] Acquiring lock "cinder-quobyte-6aec8396-c8b8-4d57-b369-cead782edcc3" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:31:39 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-46c1b298-56c5-4c6a-9260-6291e3a0c664 tempest-GroupSnapshotsTest-296266448 None] Lock "cinder-quobyte-6aec8396-c8b8-4d57-b369-cead782edcc3" acquired by "delete_volume" :: waited 0.035s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:31:39 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fddd275-6530-410a-85a6-3490252c6cc2]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:31:39 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-46c1b298-56c5-4c6a-9260-6291e3a0c664 tempest-GroupSnapshotsTest-296266448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6aec8396-c8b8-4d57-b369-cead782edcc3 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:31:39 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-24d930b9-84a6-4687-a604-0f752214c42b tempest-VolumesGetTest-855358902 None] Acquiring lock "cinder-929878c3-5ccc-4334-926f-2fa20a0c305d-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:31:39 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-24d930b9-84a6-4687-a604-0f752214c42b tempest-VolumesGetTest-855358902 None] Lock "cinder-929878c3-5ccc-4334-926f-2fa20a0c305d-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:31:39 devstack sudo[99712]: pam_unix(sudo:session): session closed for user root
Jul 30 20:31:39 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8c7e41b4-96e1-4ae5-a5e0-6694b26ffd1f tempest-VolumesTransfersTest-1865792470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6f36f9c0-ce60-4d8a-adeb-87aa5956a2e2" returned: 0 in 1.102s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:31:39 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8c7e41b4-96e1-4ae5-a5e0-6694b26ffd1f tempest-VolumesTransfersTest-1865792470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6f36f9c0-ce60-4d8a-adeb-87aa5956a2e2 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:31:39 devstack sudo[99721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6f36f9c0-ce60-4d8a-adeb-87aa5956a2e2
Jul 30 20:31:39 devstack sudo[99721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:31:39 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-24d930b9-84a6-4687-a604-0f752214c42b tempest-VolumesGetTest-855358902 None] Acquiring lock "cinder-quobyte-929878c3-5ccc-4334-926f-2fa20a0c305d" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:31:39 devstack sudo[99718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6aec8396-c8b8-4d57-b369-cead782edcc3
Jul 30 20:31:39 devstack sudo[99718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:31:40 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-24d930b9-84a6-4687-a604-0f752214c42b tempest-VolumesGetTest-855358902 None] Lock "cinder-quobyte-929878c3-5ccc-4334-926f-2fa20a0c305d" acquired by "delete_volume" :: waited 0.038s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:31:40 devstack sudo[99714]: pam_unix(sudo:session): session closed for user root
Jul 30 20:31:40 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-d8d3dbcc-43c6-4793-aa95-a74ccf7de772 tempest-VolumesGetTest-855358902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.865s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:31:40 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-d8d3dbcc-43c6-4793-aa95-a74ccf7de772 tempest-VolumesGetTest-855358902 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:31:40 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-d8d3dbcc-43c6-4793-aa95-a74ccf7de772 tempest-VolumesGetTest-855358902 None] Deleted volume successfully.
Jul 30 20:31:40 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[8217305b-ef2b-4782-865f-49c60db7efba]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:31:40 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-24d930b9-84a6-4687-a604-0f752214c42b tempest-VolumesGetTest-855358902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-929878c3-5ccc-4334-926f-2fa20a0c305d {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:31:40 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-d8d3dbcc-43c6-4793-aa95-a74ccf7de772 tempest-VolumesGetTest-855358902 None] Lock "cinder-2a596314-76da-48bf-be90-05c95a94a2a0-delete_volume" released by "delete_volume" :: held 3.146s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:31:40 devstack sudo[99724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-929878c3-5ccc-4334-926f-2fa20a0c305d
Jul 30 20:31:40 devstack sudo[99724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:31:40 devstack sudo[99721]: pam_unix(sudo:session): session closed for user root
Jul 30 20:31:40 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8c7e41b4-96e1-4ae5-a5e0-6694b26ffd1f tempest-VolumesTransfersTest-1865792470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6f36f9c0-ce60-4d8a-adeb-87aa5956a2e2" returned: 0 in 0.568s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:31:40 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-8c7e41b4-96e1-4ae5-a5e0-6694b26ffd1f tempest-VolumesTransfersTest-1865792470 None] Lock "cinder-quobyte-6f36f9c0-ce60-4d8a-adeb-87aa5956a2e2" released by "delete_volume" :: held 1.778s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:31:40 devstack sudo[99718]: pam_unix(sudo:session): session closed for user root
Jul 30 20:31:40 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-46c1b298-56c5-4c6a-9260-6291e3a0c664 tempest-GroupSnapshotsTest-296266448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6aec8396-c8b8-4d57-b369-cead782edcc3" returned: 0 in 0.991s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:31:40 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-46c1b298-56c5-4c6a-9260-6291e3a0c664 tempest-GroupSnapshotsTest-296266448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6aec8396-c8b8-4d57-b369-cead782edcc3 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:31:40 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-8c7e41b4-96e1-4ae5-a5e0-6694b26ffd1f tempest-VolumesTransfersTest-1865792470 None] Created reservations ['7790c27f-ac99-45be-ada5-8f9ab69e4989', '42c009b5-361a-4b4e-a2d9-b9a0d386179b', '58173471-8faf-46ed-9d37-b95eb1a20644', '28db3fc4-c084-43e2-b720-6944af8be18c'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:31:40 devstack sudo[99731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6aec8396-c8b8-4d57-b369-cead782edcc3
Jul 30 20:31:40 devstack sudo[99731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:31:40 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-8c7e41b4-96e1-4ae5-a5e0-6694b26ffd1f tempest-VolumesTransfersTest-1865792470 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:31:40 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-8c7e41b4-96e1-4ae5-a5e0-6694b26ffd1f tempest-VolumesTransfersTest-1865792470 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:31:40 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-8c7e41b4-96e1-4ae5-a5e0-6694b26ffd1f tempest-VolumesTransfersTest-1865792470 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:31:40 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-8c7e41b4-96e1-4ae5-a5e0-6694b26ffd1f tempest-VolumesTransfersTest-1865792470 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:31:40 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-8c7e41b4-96e1-4ae5-a5e0-6694b26ffd1f tempest-VolumesTransfersTest-1865792470 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:31:40 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8c7e41b4-96e1-4ae5-a5e0-6694b26ffd1f tempest-VolumesTransfersTest-1865792470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:31:41 devstack sudo[99736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:31:41 devstack sudo[99736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:31:41 devstack sudo[99724]: pam_unix(sudo:session): session closed for user root
Jul 30 20:31:41 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-24d930b9-84a6-4687-a604-0f752214c42b tempest-VolumesGetTest-855358902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-929878c3-5ccc-4334-926f-2fa20a0c305d" returned: 0 in 1.109s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:31:41 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-24d930b9-84a6-4687-a604-0f752214c42b tempest-VolumesGetTest-855358902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-929878c3-5ccc-4334-926f-2fa20a0c305d {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:31:41 devstack sudo[99731]: pam_unix(sudo:session): session closed for user root
Jul 30 20:31:41 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-46c1b298-56c5-4c6a-9260-6291e3a0c664 tempest-GroupSnapshotsTest-296266448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6aec8396-c8b8-4d57-b369-cead782edcc3" returned: 0 in 0.659s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:31:41 devstack sudo[99739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-929878c3-5ccc-4334-926f-2fa20a0c305d
Jul 30 20:31:41 devstack sudo[99739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:31:41 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-46c1b298-56c5-4c6a-9260-6291e3a0c664 tempest-GroupSnapshotsTest-296266448 None] Lock "cinder-quobyte-6aec8396-c8b8-4d57-b369-cead782edcc3" released by "delete_volume" :: held 1.875s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:31:41 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-46c1b298-56c5-4c6a-9260-6291e3a0c664 tempest-GroupSnapshotsTest-296266448 None] Created reservations ['83bff7f5-1275-4f0c-bdf6-8e333074d961'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:31:41 devstack cinder-volume[88719]: WARNING cinder.quota [None req-46c1b298-56c5-4c6a-9260-6291e3a0c664 tempest-GroupSnapshotsTest-296266448 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2108547337 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2108547337, it is now deprecated. Please use the default quota class for default quota.
Jul 30 20:31:41 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-46c1b298-56c5-4c6a-9260-6291e3a0c664 tempest-GroupSnapshotsTest-296266448 None] Created reservations ['f08ed1f1-ed36-4b98-8f61-4cac1d02f978', '031690fe-349c-41cb-91a5-e4f676a699ea', '07885cf8-e9f6-4540-a236-9770c9b57bb4', '2a674aff-b984-4aa0-b13a-400c7ec4193b'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:31:41 devstack sudo[99736]: pam_unix(sudo:session): session closed for user root
Jul 30 20:31:41 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8c7e41b4-96e1-4ae5-a5e0-6694b26ffd1f tempest-VolumesTransfersTest-1865792470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.897s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:31:41 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-8c7e41b4-96e1-4ae5-a5e0-6694b26ffd1f tempest-VolumesTransfersTest-1865792470 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:31:41 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-8c7e41b4-96e1-4ae5-a5e0-6694b26ffd1f tempest-VolumesTransfersTest-1865792470 None] Deleted volume successfully.
Jul 30 20:31:42 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-8c7e41b4-96e1-4ae5-a5e0-6694b26ffd1f tempest-VolumesTransfersTest-1865792470 None] Lock "cinder-6f36f9c0-ce60-4d8a-adeb-87aa5956a2e2-delete_volume" released by "delete_volume" :: held 3.519s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:31:42 devstack sudo[99739]: pam_unix(sudo:session): session closed for user root
Jul 30 20:31:42 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-24d930b9-84a6-4687-a604-0f752214c42b tempest-VolumesGetTest-855358902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-929878c3-5ccc-4334-926f-2fa20a0c305d" returned: 0 in 0.944s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:31:42 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-24d930b9-84a6-4687-a604-0f752214c42b tempest-VolumesGetTest-855358902 None] Lock "cinder-quobyte-929878c3-5ccc-4334-926f-2fa20a0c305d" released by "delete_volume" :: held 2.260s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:31:42 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-46c1b298-56c5-4c6a-9260-6291e3a0c664 tempest-GroupSnapshotsTest-296266448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:31:42 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-46c1b298-56c5-4c6a-9260-6291e3a0c664 tempest-GroupSnapshotsTest-296266448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:31:42 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-46c1b298-56c5-4c6a-9260-6291e3a0c664 tempest-GroupSnapshotsTest-296266448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:31:42 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-46c1b298-56c5-4c6a-9260-6291e3a0c664 tempest-GroupSnapshotsTest-296266448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:31:42 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-46c1b298-56c5-4c6a-9260-6291e3a0c664 tempest-GroupSnapshotsTest-296266448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:31:42 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-46c1b298-56c5-4c6a-9260-6291e3a0c664 tempest-GroupSnapshotsTest-296266448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:31:42 devstack sudo[99743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:31:42 devstack sudo[99743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:31:42 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-11233bbe-1174-4d8f-8514-64571c91b76e tempest-VolumesTransfersTest-1267868163 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:31:42 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-11233bbe-1174-4d8f-8514-64571c91b76e tempest-VolumesTransfersTest-1267868163 None] Flow 'volume_create_manager' (1ad95178-bfaf-4b81-8514-9cd4704be429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:31:42 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-11233bbe-1174-4d8f-8514-64571c91b76e tempest-VolumesTransfersTest-1267868163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (156c2e58-866d-4f7d-ac2f-606b05f32cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:31:42 devstack sudo[99686]: pam_unix(sudo:session): session closed for user root
Jul 30 20:31:42 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-24d930b9-84a6-4687-a604-0f752214c42b tempest-VolumesGetTest-855358902 None] Created reservations ['a33b365e-42a5-4493-9a15-3221b075ad66', '5c38f145-70b1-4f3e-9283-f4703a8e9cbb', '26aba2bf-7f67-4108-972c-f4c0338ad22a', 'de8fc06d-7653-427c-91ad-56acc7663413'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:31:42 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-57cd98c3-efb1-446f-88b7-8e39be080887 tempest-VolumesActionsTest-1221656799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2246a04e-ffb2-4da5-80e1-68fdc8d88bc4 /opt/stack/data/cinder/conversion/2246a04e-ffb2-4da5-80e1-68fdc8d88bc4.temp_image.cd5c425a-d5ca-463f-a3ad-1dfa90e13a2dysz120p3.img" returned: 0 in 6.249s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:31:42 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-11233bbe-1174-4d8f-8514-64571c91b76e tempest-VolumesTransfersTest-1267868163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (156c2e58-866d-4f7d-ac2f-606b05f32cf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:31:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1939491083',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57d63f86-b5ad-4d74-a11b-28a03cae78e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33397095abac4d36a20c95100d5f4114',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:31:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:31:42Z,use_quota=True,user_id='9f4266c66e7446d4b3cfb830db2d17e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:31:42 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-11233bbe-1174-4d8f-8514-64571c91b76e tempest-VolumesTransfersTest-1267868163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a1cd51b-b1f7-4737-99cd-14647234f444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:31:42 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-11233bbe-1174-4d8f-8514-64571c91b76e tempest-VolumesTransfersTest-1267868163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a1cd51b-b1f7-4737-99cd-14647234f444) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:31:42 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-11233bbe-1174-4d8f-8514-64571c91b76e tempest-VolumesTransfersTest-1267868163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfd6ac3e-7dfd-4780-8703-6b44290aa6ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:31:42 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-11233bbe-1174-4d8f-8514-64571c91b76e tempest-VolumesTransfersTest-1267868163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfd6ac3e-7dfd-4780-8703-6b44290aa6ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57d63f86-b5ad-4d74-a11b-28a03cae78e1', 'volume_name': 'volume-57d63f86-b5ad-4d74-a11b-28a03cae78e1', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:31:42 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-11233bbe-1174-4d8f-8514-64571c91b76e tempest-VolumesTransfersTest-1267868163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4636076e-2778-4c4a-8980-cf345c97a561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:31:42 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-11233bbe-1174-4d8f-8514-64571c91b76e tempest-VolumesTransfersTest-1267868163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4636076e-2778-4c4a-8980-cf345c97a561) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:31:42 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-11233bbe-1174-4d8f-8514-64571c91b76e tempest-VolumesTransfersTest-1267868163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b22f8ffa-7804-4534-ad54-08ce60f86fb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:31:42 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-11233bbe-1174-4d8f-8514-64571c91b76e tempest-VolumesTransfersTest-1267868163 None] Volume 57d63f86-b5ad-4d74-a11b-28a03cae78e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57d63f86-b5ad-4d74-a11b-28a03cae78e1', 'volume_size': 1}
Jul 30 20:31:42 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-11233bbe-1174-4d8f-8514-64571c91b76e tempest-VolumesTransfersTest-1267868163 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:31:42 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[993bc710-2c9c-4e6b-8926-de0520643e66]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:31:42 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-57cd98c3-efb1-446f-88b7-8e39be080887 tempest-VolumesActionsTest-1221656799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2246a04e-ffb2-4da5-80e1-68fdc8d88bc4 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:31:42 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-24d930b9-84a6-4687-a604-0f752214c42b tempest-VolumesGetTest-855358902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:31:42 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-24d930b9-84a6-4687-a604-0f752214c42b tempest-VolumesGetTest-855358902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:31:42 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-24d930b9-84a6-4687-a604-0f752214c42b tempest-VolumesGetTest-855358902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:31:42 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-24d930b9-84a6-4687-a604-0f752214c42b tempest-VolumesGetTest-855358902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:31:42 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-24d930b9-84a6-4687-a604-0f752214c42b tempest-VolumesGetTest-855358902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:31:42 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-24d930b9-84a6-4687-a604-0f752214c42b tempest-VolumesGetTest-855358902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:31:42 devstack sudo[99743]: pam_unix(sudo:session): session closed for user root
Jul 30 20:31:42 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-46c1b298-56c5-4c6a-9260-6291e3a0c664 tempest-GroupSnapshotsTest-296266448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.390s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:31:42 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-46c1b298-56c5-4c6a-9260-6291e3a0c664 tempest-GroupSnapshotsTest-296266448 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:31:42 devstack sudo[99747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:31:42 devstack sudo[99747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:31:42 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-46c1b298-56c5-4c6a-9260-6291e3a0c664 tempest-GroupSnapshotsTest-296266448 None] Delete group completed successfully.
Jul 30 20:31:42 devstack sudo[99745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2246a04e-ffb2-4da5-80e1-68fdc8d88bc4
Jul 30 20:31:42 devstack sudo[99745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:31:43 devstack sudo[99747]: pam_unix(sudo:session): session closed for user root
Jul 30 20:31:43 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-24d930b9-84a6-4687-a604-0f752214c42b tempest-VolumesGetTest-855358902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.348s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:31:43 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-24d930b9-84a6-4687-a604-0f752214c42b tempest-VolumesGetTest-855358902 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:31:43 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-24d930b9-84a6-4687-a604-0f752214c42b tempest-VolumesGetTest-855358902 None] Deleted volume successfully.
Jul 30 20:31:43 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-24d930b9-84a6-4687-a604-0f752214c42b tempest-VolumesGetTest-855358902 None] Lock "cinder-929878c3-5ccc-4334-926f-2fa20a0c305d-delete_volume" released by "delete_volume" :: held 3.307s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:31:43 devstack sudo[99745]: pam_unix(sudo:session): session closed for user root
Jul 30 20:31:43 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-57cd98c3-efb1-446f-88b7-8e39be080887 tempest-VolumesActionsTest-1221656799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2246a04e-ffb2-4da5-80e1-68fdc8d88bc4" returned: 0 in 0.637s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:31:43 devstack cinder-volume[88719]: DEBUG cinder.image.image_utils [None req-57cd98c3-efb1-446f-88b7-8e39be080887 tempest-VolumesActionsTest-1221656799 None] Image conversion details: src /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2246a04e-ffb2-4da5-80e1-68fdc8d88bc4, size 1024.00 MB, duration 6.25 sec, destination /opt/stack/data/cinder/conversion/2246a04e-ffb2-4da5-80e1-68fdc8d88bc4.temp_image.cd5c425a-d5ca-463f-a3ad-1dfa90e13a2dysz120p3.img {{(pid=88719) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 30 20:31:43 devstack cinder-volume[88719]: INFO cinder.image.image_utils [None req-57cd98c3-efb1-446f-88b7-8e39be080887 tempest-VolumesActionsTest-1221656799 None] Converted 1024.00 MB image at 163.82 MB/s
Jul 30 20:31:43 devstack cinder-volume[88719]: DEBUG cinder.image.image_utils [None req-57cd98c3-efb1-446f-88b7-8e39be080887 tempest-VolumesActionsTest-1221656799 None] cd5c425a-d5ca-463f-a3ad-1dfa90e13a2d was raw, converting to qcow2 {{(pid=88719) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}}
Jul 30 20:31:43 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b39ddfa-5cf8-4c80-b3ce-a234a3d82a99]: (4, 'raw') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:31:43 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-57cd98c3-efb1-446f-88b7-8e39be080887 tempest-VolumesActionsTest-1221656799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/2246a04e-ffb2-4da5-80e1-68fdc8d88bc4.temp_image.cd5c425a-d5ca-463f-a3ad-1dfa90e13a2dysz120p3.img {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:31:43 devstack sudo[99754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/2246a04e-ffb2-4da5-80e1-68fdc8d88bc4.temp_image.cd5c425a-d5ca-463f-a3ad-1dfa90e13a2dysz120p3.img
Jul 30 20:31:43 devstack sudo[99754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:31:43 devstack sudo[99754]: pam_unix(sudo:session): session closed for user root
Jul 30 20:31:43 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-57cd98c3-efb1-446f-88b7-8e39be080887 tempest-VolumesActionsTest-1221656799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/2246a04e-ffb2-4da5-80e1-68fdc8d88bc4.temp_image.cd5c425a-d5ca-463f-a3ad-1dfa90e13a2dysz120p3.img" returned: 0 in 0.358s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:31:43 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-57cd98c3-efb1-446f-88b7-8e39be080887 tempest-VolumesActionsTest-1221656799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/2246a04e-ffb2-4da5-80e1-68fdc8d88bc4.temp_image.cd5c425a-d5ca-463f-a3ad-1dfa90e13a2dysz120p3.img {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:31:43 devstack sudo[99758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/2246a04e-ffb2-4da5-80e1-68fdc8d88bc4.temp_image.cd5c425a-d5ca-463f-a3ad-1dfa90e13a2dysz120p3.img
Jul 30 20:31:43 devstack sudo[99758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:31:44 devstack sudo[99758]: pam_unix(sudo:session): session closed for user root
Jul 30 20:31:44 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-57cd98c3-efb1-446f-88b7-8e39be080887 tempest-VolumesActionsTest-1221656799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/2246a04e-ffb2-4da5-80e1-68fdc8d88bc4.temp_image.cd5c425a-d5ca-463f-a3ad-1dfa90e13a2dysz120p3.img" returned: 1 in 0.380s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:31:44 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-57cd98c3-efb1-446f-88b7-8e39be080887 tempest-VolumesActionsTest-1221656799 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/2246a04e-ffb2-4da5-80e1-68fdc8d88bc4.temp_image.cd5c425a-d5ca-463f-a3ad-1dfa90e13a2dysz120p3.img' failed. Not Retrying. {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 30 20:31:44 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-57cd98c3-efb1-446f-88b7-8e39be080887 tempest-VolumesActionsTest-1221656799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/2246a04e-ffb2-4da5-80e1-68fdc8d88bc4.temp_image.cd5c425a-d5ca-463f-a3ad-1dfa90e13a2dysz120p3.img /opt/stack/data/cinder/conversion/vol_upload_as85isqd {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:31:44 devstack sudo[99763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/2246a04e-ffb2-4da5-80e1-68fdc8d88bc4.temp_image.cd5c425a-d5ca-463f-a3ad-1dfa90e13a2dysz120p3.img /opt/stack/data/cinder/conversion/vol_upload_as85isqd
Jul 30 20:31:44 devstack sudo[99763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:31:44 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-df34c53c-d31c-4248-b4d7-83ac6c304b77 tempest-VolumesGetTest-855358902 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:31:44 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-df34c53c-d31c-4248-b4d7-83ac6c304b77 tempest-VolumesGetTest-855358902 None] Flow 'volume_create_manager' (61c2bdd9-b491-480f-a33e-284b74f5940f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:31:44 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-df34c53c-d31c-4248-b4d7-83ac6c304b77 tempest-VolumesGetTest-855358902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b097dd7f-4d0f-4714-a5a3-8c093bceb668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:31:44 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-df34c53c-d31c-4248-b4d7-83ac6c304b77 tempest-VolumesGetTest-855358902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b097dd7f-4d0f-4714-a5a3-8c093bceb668) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:31:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-639855209',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88ab04e2-478e-4133-9bda-434bec875ca5,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='95dc6a3a598a411dbd7b034cb48fcbb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:31:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:31:44Z,use_quota=True,user_id='e1274cdacdf54e3fbb200f3552412b74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:31:44 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-df34c53c-d31c-4248-b4d7-83ac6c304b77 tempest-VolumesGetTest-855358902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (526786ab-057d-4b39-b91c-7ebe76790694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:31:44 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-df34c53c-d31c-4248-b4d7-83ac6c304b77 tempest-VolumesGetTest-855358902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (526786ab-057d-4b39-b91c-7ebe76790694) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:31:44 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-df34c53c-d31c-4248-b4d7-83ac6c304b77 tempest-VolumesGetTest-855358902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d39de54-1810-4031-a0ea-9586a87d9719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:31:44 devstack cinder-volume[88719]: DEBUG cinder.image.glance [None req-df34c53c-d31c-4248-b4d7-83ac6c304b77 tempest-VolumesGetTest-855358902 None] Creating Keystone auth plugin from conf {{(pid=88719) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 30 20:31:44 devstack sudo[99763]: pam_unix(sudo:session): session closed for user root
Jul 30 20:31:44 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-57cd98c3-efb1-446f-88b7-8e39be080887 tempest-VolumesActionsTest-1221656799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/2246a04e-ffb2-4da5-80e1-68fdc8d88bc4.temp_image.cd5c425a-d5ca-463f-a3ad-1dfa90e13a2dysz120p3.img /opt/stack/data/cinder/conversion/vol_upload_as85isqd" returned: 0 in 0.337s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:31:44 devstack cinder-volume[88719]: DEBUG cinder.image.image_utils [None req-57cd98c3-efb1-446f-88b7-8e39be080887 tempest-VolumesActionsTest-1221656799 None] Image conversion details: src /opt/stack/data/cinder/conversion/2246a04e-ffb2-4da5-80e1-68fdc8d88bc4.temp_image.cd5c425a-d5ca-463f-a3ad-1dfa90e13a2dysz120p3.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_as85isqd {{(pid=88719) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 30 20:31:44 devstack cinder-volume[88719]: INFO cinder.image.image_utils [None req-57cd98c3-efb1-446f-88b7-8e39be080887 tempest-VolumesActionsTest-1221656799 None] Converted 1024.00 MB image at 1024.00 MB/s
Jul 30 20:31:44 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bdae920-d0c3-47d9-b835-b4df29ec3304]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:31:44 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-57cd98c3-efb1-446f-88b7-8e39be080887 tempest-VolumesActionsTest-1221656799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_as85isqd {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:31:44 devstack sudo[99770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_as85isqd
Jul 30 20:31:44 devstack sudo[99770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:31:44 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-df34c53c-d31c-4248-b4d7-83ac6c304b77 tempest-VolumesGetTest-855358902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d39de54-1810-4031-a0ea-9586a87d9719) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '88ab04e2-478e-4133-9bda-434bec875ca5', 'volume_name': 'volume-88ab04e2-478e-4133-9bda-434bec875ca5', 'volume_size': 1, 'image_id': '1ed21181-aca9-4608-89cf-131c66236dc1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1ed21181-aca9-4608-89cf-131c66236dc1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ec1eaae7620840deac2e426a7e923b06', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1ed21181-aca9-4608-89cf-131c66236dc1', 'created_at': datetime.datetime(2026, 7, 30, 18, 17, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 18, 17, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1ed21181-aca9-4608-89cf-131c66236dc1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x78688470b290>}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:31:44 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-df34c53c-d31c-4248-b4d7-83ac6c304b77 tempest-VolumesGetTest-855358902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9116ea2-b86a-45b8-9b68-f2756e2dfbd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:31:44 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-df34c53c-d31c-4248-b4d7-83ac6c304b77 tempest-VolumesGetTest-855358902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9116ea2-b86a-45b8-9b68-f2756e2dfbd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:31:44 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-df34c53c-d31c-4248-b4d7-83ac6c304b77 tempest-VolumesGetTest-855358902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4613bb76-b97d-4666-a570-e6039a5d8108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:31:44 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-df34c53c-d31c-4248-b4d7-83ac6c304b77 tempest-VolumesGetTest-855358902 None] Volume 88ab04e2-478e-4133-9bda-434bec875ca5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-88ab04e2-478e-4133-9bda-434bec875ca5', 'volume_size': 1, 'image_id': '1ed21181-aca9-4608-89cf-131c66236dc1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1ed21181-aca9-4608-89cf-131c66236dc1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ec1eaae7620840deac2e426a7e923b06', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1ed21181-aca9-4608-89cf-131c66236dc1', 'created_at': datetime.datetime(2026, 7, 30, 18, 17, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 18, 17, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1ed21181-aca9-4608-89cf-131c66236dc1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x78688470b290>}
Jul 30 20:31:44 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-df34c53c-d31c-4248-b4d7-83ac6c304b77 tempest-VolumesGetTest-855358902 None] Trying to clone 88ab04e2-478e-4133-9bda-434bec875ca5 from image 1ed21181-aca9-4608-89cf-131c66236dc1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/1ed21181-aca9-4608-89cf-131c66236dc1', 'metadata': {}}]). {{(pid=88719) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 30 20:31:44 devstack sudo[99770]: pam_unix(sudo:session): session closed for user root
Jul 30 20:31:44 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-57cd98c3-efb1-446f-88b7-8e39be080887 tempest-VolumesActionsTest-1221656799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_as85isqd" returned: 0 in 0.376s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:31:45 devstack cinder-volume[88719]: DEBUG cinder.image.image_utils [None req-df34c53c-d31c-4248-b4d7-83ac6c304b77 tempest-VolumesGetTest-855358902 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1ed21181-aca9-4608-89cf-131c66236dc1_alll8m_2devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88719) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 30 20:31:45 devstack cinder-volume[88719]: INFO cinder.image.image_utils [None req-df34c53c-d31c-4248-b4d7-83ac6c304b77 tempest-VolumesGetTest-855358902 None] Image download 20.69 MB at 20.69 MB/s
Jul 30 20:31:45 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e083c1e-572c-409c-bebc-e7f8c76489c8]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:31:45 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-df34c53c-d31c-4248-b4d7-83ac6c304b77 tempest-VolumesGetTest-855358902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1ed21181-aca9-4608-89cf-131c66236dc1_alll8m_2devstack@QuobyteHD {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:31:45 devstack sudo[99777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1ed21181-aca9-4608-89cf-131c66236dc1_alll8m_2devstack@QuobyteHD
Jul 30 20:31:45 devstack sudo[99777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:31:45 devstack sudo[99777]: pam_unix(sudo:session): session closed for user root
Jul 30 20:31:45 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-df34c53c-d31c-4248-b4d7-83ac6c304b77 tempest-VolumesGetTest-855358902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1ed21181-aca9-4608-89cf-131c66236dc1_alll8m_2devstack@QuobyteHD" returned: 0 in 0.404s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:31:45 devstack cinder-volume[88719]: DEBUG cinder.image.image_utils [None req-df34c53c-d31c-4248-b4d7-83ac6c304b77 tempest-VolumesGetTest-855358902 None] Temporary image 1ed21181-aca9-4608-89cf-131c66236dc1 is fetched for user e1274cdacdf54e3fbb200f3552412b74. {{(pid=88719) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 30 20:31:45 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[0040b731-2800-40a2-af6c-ee4334fe74f3]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:31:45 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-df34c53c-d31c-4248-b4d7-83ac6c304b77 tempest-VolumesGetTest-855358902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1ed21181-aca9-4608-89cf-131c66236dc1_alll8m_2devstack@QuobyteHD {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:31:45 devstack sudo[99783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1ed21181-aca9-4608-89cf-131c66236dc1_alll8m_2devstack@QuobyteHD
Jul 30 20:31:45 devstack sudo[99783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:31:46 devstack sudo[99783]: pam_unix(sudo:session): session closed for user root
Jul 30 20:31:46 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-df34c53c-d31c-4248-b4d7-83ac6c304b77 tempest-VolumesGetTest-855358902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1ed21181-aca9-4608-89cf-131c66236dc1_alll8m_2devstack@QuobyteHD" returned: 0 in 0.391s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:31:46 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-df34c53c-d31c-4248-b4d7-83ac6c304b77 tempest-VolumesGetTest-855358902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:31:46 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-57cd98c3-efb1-446f-88b7-8e39be080887 tempest-VolumesActionsTest-1221656799 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 11.073s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:31:46 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-57cd98c3-efb1-446f-88b7-8e39be080887 tempest-VolumesActionsTest-1221656799 None] Uploaded volume to glance image-id: cd5c425a-d5ca-463f-a3ad-1dfa90e13a2d. {{(pid=88719) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Jul 30 20:31:46 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-11233bbe-1174-4d8f-8514-64571c91b76e tempest-VolumesTransfersTest-1267868163 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.866s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:31:46 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-11233bbe-1174-4d8f-8514-64571c91b76e tempest-VolumesTransfersTest-1267868163 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:31:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1939491083',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57d63f86-b5ad-4d74-a11b-28a03cae78e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33397095abac4d36a20c95100d5f4114',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:31:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:31:42Z,use_quota=True,user_id='9f4266c66e7446d4b3cfb830db2d17e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:31:46 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-11233bbe-1174-4d8f-8514-64571c91b76e tempest-VolumesTransfersTest-1267868163 None] Creating volume 57d63f86-b5ad-4d74-a11b-28a03cae78e1 {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:31:46 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-11233bbe-1174-4d8f-8514-64571c91b76e tempest-VolumesTransfersTest-1267868163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:31:46 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-11233bbe-1174-4d8f-8514-64571c91b76e tempest-VolumesTransfersTest-1267868163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:31:46 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-11233bbe-1174-4d8f-8514-64571c91b76e tempest-VolumesTransfersTest-1267868163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:31:46 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-11233bbe-1174-4d8f-8514-64571c91b76e tempest-VolumesTransfersTest-1267868163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:31:46 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-11233bbe-1174-4d8f-8514-64571c91b76e tempest-VolumesTransfersTest-1267868163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:31:46 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-11233bbe-1174-4d8f-8514-64571c91b76e tempest-VolumesTransfersTest-1267868163 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:31:46 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-11233bbe-1174-4d8f-8514-64571c91b76e tempest-VolumesTransfersTest-1267868163 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:31:46 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-11233bbe-1174-4d8f-8514-64571c91b76e tempest-VolumesTransfersTest-1267868163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-57d63f86-b5ad-4d74-a11b-28a03cae78e1 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:31:46 devstack sudo[99788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-57d63f86-b5ad-4d74-a11b-28a03cae78e1 1073741824
Jul 30 20:31:46 devstack sudo[99788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:31:46 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-57cd98c3-efb1-446f-88b7-8e39be080887 tempest-VolumesActionsTest-1221656799 None] Copy volume to image completed successfully.
Jul 30 20:31:46 devstack sudo[99788]: pam_unix(sudo:session): session closed for user root
Jul 30 20:31:46 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-11233bbe-1174-4d8f-8514-64571c91b76e tempest-VolumesTransfersTest-1267868163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-57d63f86-b5ad-4d74-a11b-28a03cae78e1 1073741824" returned: 0 in 0.439s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:31:46 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-11233bbe-1174-4d8f-8514-64571c91b76e tempest-VolumesTransfersTest-1267868163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-57d63f86-b5ad-4d74-a11b-28a03cae78e1 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:31:46 devstack sudo[99794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-57d63f86-b5ad-4d74-a11b-28a03cae78e1
Jul 30 20:31:46 devstack sudo[99794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:31:47 devstack sudo[99794]: pam_unix(sudo:session): session closed for user root
Jul 30 20:31:47 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-11233bbe-1174-4d8f-8514-64571c91b76e tempest-VolumesTransfersTest-1267868163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-57d63f86-b5ad-4d74-a11b-28a03cae78e1" returned: 0 in 0.247s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:31:47 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-11233bbe-1174-4d8f-8514-64571c91b76e tempest-VolumesTransfersTest-1267868163 None] <== create_volume: return (731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:31:47 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-11233bbe-1174-4d8f-8514-64571c91b76e tempest-VolumesTransfersTest-1267868163 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.735s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:31:47 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-df34c53c-d31c-4248-b4d7-83ac6c304b77 tempest-VolumesGetTest-855358902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.190s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:31:47 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-df34c53c-d31c-4248-b4d7-83ac6c304b77 tempest-VolumesGetTest-855358902 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:31:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-639855209',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88ab04e2-478e-4133-9bda-434bec875ca5,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='95dc6a3a598a411dbd7b034cb48fcbb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:31:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:31:44Z,use_quota=True,user_id='e1274cdacdf54e3fbb200f3552412b74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:31:47 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-df34c53c-d31c-4248-b4d7-83ac6c304b77 tempest-VolumesGetTest-855358902 None] Creating volume 88ab04e2-478e-4133-9bda-434bec875ca5 {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:31:47 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-df34c53c-d31c-4248-b4d7-83ac6c304b77 tempest-VolumesGetTest-855358902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:31:47 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-df34c53c-d31c-4248-b4d7-83ac6c304b77 tempest-VolumesGetTest-855358902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:31:47 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-df34c53c-d31c-4248-b4d7-83ac6c304b77 tempest-VolumesGetTest-855358902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:31:47 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-df34c53c-d31c-4248-b4d7-83ac6c304b77 tempest-VolumesGetTest-855358902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:31:47 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-df34c53c-d31c-4248-b4d7-83ac6c304b77 tempest-VolumesGetTest-855358902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:31:47 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-df34c53c-d31c-4248-b4d7-83ac6c304b77 tempest-VolumesGetTest-855358902 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:31:47 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-df34c53c-d31c-4248-b4d7-83ac6c304b77 tempest-VolumesGetTest-855358902 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:31:47 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-df34c53c-d31c-4248-b4d7-83ac6c304b77 tempest-VolumesGetTest-855358902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-88ab04e2-478e-4133-9bda-434bec875ca5 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:31:47 devstack sudo[99797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-88ab04e2-478e-4133-9bda-434bec875ca5 1073741824
Jul 30 20:31:47 devstack sudo[99797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:31:47 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-11233bbe-1174-4d8f-8514-64571c91b76e tempest-VolumesTransfersTest-1267868163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b22f8ffa-7804-4534-ad54-08ce60f86fb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57d63f86-b5ad-4d74-a11b-28a03cae78e1', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:31:47 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-11233bbe-1174-4d8f-8514-64571c91b76e tempest-VolumesTransfersTest-1267868163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87ca655f-4585-4e9b-b77c-ab3e31882865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:31:47 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-11233bbe-1174-4d8f-8514-64571c91b76e tempest-VolumesTransfersTest-1267868163 None] Volume volume-57d63f86-b5ad-4d74-a11b-28a03cae78e1 (57d63f86-b5ad-4d74-a11b-28a03cae78e1): created successfully
Jul 30 20:31:47 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-11233bbe-1174-4d8f-8514-64571c91b76e tempest-VolumesTransfersTest-1267868163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87ca655f-4585-4e9b-b77c-ab3e31882865) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:31:47 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-11233bbe-1174-4d8f-8514-64571c91b76e tempest-VolumesTransfersTest-1267868163 None] Flow 'volume_create_manager' (1ad95178-bfaf-4b81-8514-9cd4704be429) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:31:47 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-11233bbe-1174-4d8f-8514-64571c91b76e tempest-VolumesTransfersTest-1267868163 None] Created volume successfully.
Jul 30 20:31:47 devstack sudo[99797]: pam_unix(sudo:session): session closed for user root
Jul 30 20:31:47 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-df34c53c-d31c-4248-b4d7-83ac6c304b77 tempest-VolumesGetTest-855358902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-88ab04e2-478e-4133-9bda-434bec875ca5 1073741824" returned: 0 in 0.586s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:31:47 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-df34c53c-d31c-4248-b4d7-83ac6c304b77 tempest-VolumesGetTest-855358902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-88ab04e2-478e-4133-9bda-434bec875ca5 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:31:47 devstack sudo[99803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-88ab04e2-478e-4133-9bda-434bec875ca5
Jul 30 20:31:47 devstack sudo[99803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:31:48 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-95b3e34e-e119-49d0-ab09-103b10d06d09 tempest-VolumesActionsTest-1221656799 None] Acquiring lock "cinder-2246a04e-ffb2-4da5-80e1-68fdc8d88bc4-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:31:48 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-3fc91001-16fb-4eab-b189-6c403d9e8436 tempest-VolumesTransfersTest-1865792470 None] Acquiring lock "cinder-57d63f86-b5ad-4d74-a11b-28a03cae78e1-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:31:48 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-95b3e34e-e119-49d0-ab09-103b10d06d09 tempest-VolumesActionsTest-1221656799 None] Lock "cinder-2246a04e-ffb2-4da5-80e1-68fdc8d88bc4-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:31:48 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-3fc91001-16fb-4eab-b189-6c403d9e8436 tempest-VolumesTransfersTest-1865792470 None] Lock "cinder-57d63f86-b5ad-4d74-a11b-28a03cae78e1-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:31:48 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-95b3e34e-e119-49d0-ab09-103b10d06d09 tempest-VolumesActionsTest-1221656799 None] Acquiring lock "cinder-quobyte-2246a04e-ffb2-4da5-80e1-68fdc8d88bc4" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:31:48 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-3fc91001-16fb-4eab-b189-6c403d9e8436 tempest-VolumesTransfersTest-1865792470 None] Acquiring lock "cinder-quobyte-57d63f86-b5ad-4d74-a11b-28a03cae78e1" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:31:48 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-95b3e34e-e119-49d0-ab09-103b10d06d09 tempest-VolumesActionsTest-1221656799 None] Lock "cinder-quobyte-2246a04e-ffb2-4da5-80e1-68fdc8d88bc4" acquired by "delete_volume" :: waited 0.018s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:31:48 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-3fc91001-16fb-4eab-b189-6c403d9e8436 tempest-VolumesTransfersTest-1865792470 None] Lock "cinder-quobyte-57d63f86-b5ad-4d74-a11b-28a03cae78e1" acquired by "delete_volume" :: waited 0.038s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:31:48 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[1596dce1-ee8d-43c3-9fba-24ea9bd7aad2]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:31:48 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-95b3e34e-e119-49d0-ab09-103b10d06d09 tempest-VolumesActionsTest-1221656799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2246a04e-ffb2-4da5-80e1-68fdc8d88bc4 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:31:48 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e221344-2cc0-435b-8e27-d384a17cf517]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:31:48 devstack sudo[99803]: pam_unix(sudo:session): session closed for user root
Jul 30 20:31:48 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3fc91001-16fb-4eab-b189-6c403d9e8436 tempest-VolumesTransfersTest-1865792470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-57d63f86-b5ad-4d74-a11b-28a03cae78e1 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:31:48 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-df34c53c-d31c-4248-b4d7-83ac6c304b77 tempest-VolumesGetTest-855358902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-88ab04e2-478e-4133-9bda-434bec875ca5" returned: 0 in 0.370s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:31:48 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-df34c53c-d31c-4248-b4d7-83ac6c304b77 tempest-VolumesGetTest-855358902 None] <== create_volume: return (1016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:31:48 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-df34c53c-d31c-4248-b4d7-83ac6c304b77 tempest-VolumesGetTest-855358902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.019s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:31:48 devstack cinder-volume[88719]: DEBUG cinder.volume.volume_utils [None req-df34c53c-d31c-4248-b4d7-83ac6c304b77 tempest-VolumesGetTest-855358902 None] Attempting download of 1ed21181-aca9-4608-89cf-131c66236dc1 ((None, [{'url': 'file:///opt/stack/data/glance/images/1ed21181-aca9-4608-89cf-131c66236dc1', 'metadata': {}}])) to volume 88ab04e2-478e-4133-9bda-434bec875ca5. {{(pid=88719) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 30 20:31:48 devstack sudo[99806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2246a04e-ffb2-4da5-80e1-68fdc8d88bc4
Jul 30 20:31:48 devstack sudo[99806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:31:48 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[04ded9c8-b5a2-4693-8d83-dfe9e17ba25a]: (4, 'raw') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:31:48 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-df34c53c-d31c-4248-b4d7-83ac6c304b77 tempest-VolumesGetTest-855358902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1ed21181-aca9-4608-89cf-131c66236dc1_o2bbsay_ {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:31:48 devstack sudo[99807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-57d63f86-b5ad-4d74-a11b-28a03cae78e1
Jul 30 20:31:48 devstack sudo[99807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:31:48 devstack sudo[99809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1ed21181-aca9-4608-89cf-131c66236dc1_o2bbsay_
Jul 30 20:31:48 devstack sudo[99809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:31:48 devstack sudo[99807]: pam_unix(sudo:session): session closed for user root
Jul 30 20:31:48 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3fc91001-16fb-4eab-b189-6c403d9e8436 tempest-VolumesTransfersTest-1865792470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-57d63f86-b5ad-4d74-a11b-28a03cae78e1" returned: 0 in 0.447s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:31:48 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3fc91001-16fb-4eab-b189-6c403d9e8436 tempest-VolumesTransfersTest-1865792470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-57d63f86-b5ad-4d74-a11b-28a03cae78e1 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:31:48 devstack sudo[99806]: pam_unix(sudo:session): session closed for user root
Jul 30 20:31:48 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-95b3e34e-e119-49d0-ab09-103b10d06d09 tempest-VolumesActionsTest-1221656799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2246a04e-ffb2-4da5-80e1-68fdc8d88bc4" returned: 0 in 0.482s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:31:48 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-95b3e34e-e119-49d0-ab09-103b10d06d09 tempest-VolumesActionsTest-1221656799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2246a04e-ffb2-4da5-80e1-68fdc8d88bc4 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:31:48 devstack sudo[99818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-57d63f86-b5ad-4d74-a11b-28a03cae78e1
Jul 30 20:31:48 devstack sudo[99818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:31:48 devstack sudo[99819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2246a04e-ffb2-4da5-80e1-68fdc8d88bc4
Jul 30 20:31:48 devstack sudo[99819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:31:48 devstack sudo[99809]: pam_unix(sudo:session): session closed for user root
Jul 30 20:31:48 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-df34c53c-d31c-4248-b4d7-83ac6c304b77 tempest-VolumesGetTest-855358902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1ed21181-aca9-4608-89cf-131c66236dc1_o2bbsay_" returned: 0 in 0.376s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:31:48 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-df34c53c-d31c-4248-b4d7-83ac6c304b77 tempest-VolumesGetTest-855358902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1ed21181-aca9-4608-89cf-131c66236dc1_o2bbsay_ {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:31:48 devstack sudo[99824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1ed21181-aca9-4608-89cf-131c66236dc1_o2bbsay_
Jul 30 20:31:48 devstack sudo[99824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:31:48 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-cd9af71b-18b1-4f7c-81c6-794d0172629d tempest-GroupsTest-1841966773 None] Group tempest-Group1-914559239: creating
Jul 30 20:31:48 devstack sudo[99818]: pam_unix(sudo:session): session closed for user root
Jul 30 20:31:48 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3fc91001-16fb-4eab-b189-6c403d9e8436 tempest-VolumesTransfersTest-1865792470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-57d63f86-b5ad-4d74-a11b-28a03cae78e1" returned: 0 in 0.309s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:31:48 devstack sudo[99819]: pam_unix(sudo:session): session closed for user root
Jul 30 20:31:49 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-3fc91001-16fb-4eab-b189-6c403d9e8436 tempest-VolumesTransfersTest-1865792470 None] Lock "cinder-quobyte-57d63f86-b5ad-4d74-a11b-28a03cae78e1" released by "delete_volume" :: held 0.819s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:31:49 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-95b3e34e-e119-49d0-ab09-103b10d06d09 tempest-VolumesActionsTest-1221656799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2246a04e-ffb2-4da5-80e1-68fdc8d88bc4" returned: 0 in 0.325s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:31:49 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-95b3e34e-e119-49d0-ab09-103b10d06d09 tempest-VolumesActionsTest-1221656799 None] Lock "cinder-quobyte-2246a04e-ffb2-4da5-80e1-68fdc8d88bc4" released by "delete_volume" :: held 0.884s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:31:49 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-cd9af71b-18b1-4f7c-81c6-794d0172629d tempest-GroupsTest-1841966773 None] Group tempest-Group1-914559239: created successfully
Jul 30 20:31:49 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-cd9af71b-18b1-4f7c-81c6-794d0172629d tempest-GroupsTest-1841966773 None] Create group completed successfully.
Jul 30 20:31:49 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-3fc91001-16fb-4eab-b189-6c403d9e8436 tempest-VolumesTransfersTest-1865792470 None] Created reservations ['3926259f-f36b-4829-b58b-daabf554d1e3', 'b12c18f7-2630-4877-b93b-7acdbb076292', '26d1355b-a077-4d54-aec6-d083000cf6d1', '3973c10b-5205-4175-831c-1fb6ec1a343c'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:31:49 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-95b3e34e-e119-49d0-ab09-103b10d06d09 tempest-VolumesActionsTest-1221656799 None] Created reservations ['8e03900e-ecba-49cd-b3a1-79fa615aaa3f', 'afe7867a-3750-44e8-92df-1bf8c420da26', 'cf0a6ea5-08ff-4d28-bba4-452a02752d91', 'b3022b5c-8e24-4c81-a0e2-7d45ad67be59'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:31:49 devstack sudo[99824]: pam_unix(sudo:session): session closed for user root
Jul 30 20:31:49 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-df34c53c-d31c-4248-b4d7-83ac6c304b77 tempest-VolumesGetTest-855358902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1ed21181-aca9-4608-89cf-131c66236dc1_o2bbsay_" returned: 1 in 0.399s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:31:49 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-df34c53c-d31c-4248-b4d7-83ac6c304b77 tempest-VolumesGetTest-855358902 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1ed21181-aca9-4608-89cf-131c66236dc1_o2bbsay_' failed. Not Retrying. {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 30 20:31:49 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[c93a2cca-15cf-4b7a-bf3d-0f711d840549]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:31:49 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-df34c53c-d31c-4248-b4d7-83ac6c304b77 tempest-VolumesGetTest-855358902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1ed21181-aca9-4608-89cf-131c66236dc1_alll8m_2devstack@QuobyteHD {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:31:49 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-3fc91001-16fb-4eab-b189-6c403d9e8436 tempest-VolumesTransfersTest-1865792470 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:31:49 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-3fc91001-16fb-4eab-b189-6c403d9e8436 tempest-VolumesTransfersTest-1865792470 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:31:49 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-3fc91001-16fb-4eab-b189-6c403d9e8436 tempest-VolumesTransfersTest-1865792470 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:31:49 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-3fc91001-16fb-4eab-b189-6c403d9e8436 tempest-VolumesTransfersTest-1865792470 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:31:49 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-3fc91001-16fb-4eab-b189-6c403d9e8436 tempest-VolumesTransfersTest-1865792470 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:31:49 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3fc91001-16fb-4eab-b189-6c403d9e8436 tempest-VolumesTransfersTest-1865792470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:31:49 devstack sudo[99832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:31:49 devstack sudo[99832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:31:49 devstack sudo[99831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1ed21181-aca9-4608-89cf-131c66236dc1_alll8m_2devstack@QuobyteHD
Jul 30 20:31:49 devstack sudo[99831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:31:49 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-95b3e34e-e119-49d0-ab09-103b10d06d09 tempest-VolumesActionsTest-1221656799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:31:49 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-95b3e34e-e119-49d0-ab09-103b10d06d09 tempest-VolumesActionsTest-1221656799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:31:49 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-95b3e34e-e119-49d0-ab09-103b10d06d09 tempest-VolumesActionsTest-1221656799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:31:49 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-95b3e34e-e119-49d0-ab09-103b10d06d09 tempest-VolumesActionsTest-1221656799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:31:49 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-95b3e34e-e119-49d0-ab09-103b10d06d09 tempest-VolumesActionsTest-1221656799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:31:49 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-95b3e34e-e119-49d0-ab09-103b10d06d09 tempest-VolumesActionsTest-1221656799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:31:49 devstack sudo[99835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:31:49 devstack sudo[99835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:31:49 devstack sudo[99832]: pam_unix(sudo:session): session closed for user root
Jul 30 20:31:49 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3fc91001-16fb-4eab-b189-6c403d9e8436 tempest-VolumesTransfersTest-1865792470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.412s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:31:49 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-3fc91001-16fb-4eab-b189-6c403d9e8436 tempest-VolumesTransfersTest-1865792470 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:31:49 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-3fc91001-16fb-4eab-b189-6c403d9e8436 tempest-VolumesTransfersTest-1865792470 None] Deleted volume successfully.
Jul 30 20:31:49 devstack sudo[99831]: pam_unix(sudo:session): session closed for user root
Jul 30 20:31:49 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-df34c53c-d31c-4248-b4d7-83ac6c304b77 tempest-VolumesGetTest-855358902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1ed21181-aca9-4608-89cf-131c66236dc1_alll8m_2devstack@QuobyteHD" returned: 0 in 0.511s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:31:49 devstack cinder-volume[88719]: DEBUG cinder.image.image_utils [None req-df34c53c-d31c-4248-b4d7-83ac6c304b77 tempest-VolumesGetTest-855358902 None] 1ed21181-aca9-4608-89cf-131c66236dc1 was qcow2, converting to qcow2 {{(pid=88719) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 30 20:31:49 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-df34c53c-d31c-4248-b4d7-83ac6c304b77 tempest-VolumesGetTest-855358902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1ed21181-aca9-4608-89cf-131c66236dc1_alll8m_2devstack@QuobyteHD /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-88ab04e2-478e-4133-9bda-434bec875ca5 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:31:49 devstack sudo[99835]: pam_unix(sudo:session): session closed for user root
Jul 30 20:31:49 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-3fc91001-16fb-4eab-b189-6c403d9e8436 tempest-VolumesTransfersTest-1865792470 None] Lock "cinder-57d63f86-b5ad-4d74-a11b-28a03cae78e1-delete_volume" released by "delete_volume" :: held 1.615s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:31:49 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-95b3e34e-e119-49d0-ab09-103b10d06d09 tempest-VolumesActionsTest-1221656799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.401s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:31:49 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-95b3e34e-e119-49d0-ab09-103b10d06d09 tempest-VolumesActionsTest-1221656799 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:31:49 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-95b3e34e-e119-49d0-ab09-103b10d06d09 tempest-VolumesActionsTest-1221656799 None] Deleted volume successfully.
Jul 30 20:31:49 devstack sudo[99843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1ed21181-aca9-4608-89cf-131c66236dc1_alll8m_2devstack@QuobyteHD /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-88ab04e2-478e-4133-9bda-434bec875ca5
Jul 30 20:31:49 devstack sudo[99843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:31:49 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-95b3e34e-e119-49d0-ab09-103b10d06d09 tempest-VolumesActionsTest-1221656799 None] Lock "cinder-2246a04e-ffb2-4da5-80e1-68fdc8d88bc4-delete_volume" released by "delete_volume" :: held 1.669s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:31:50 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-cefffd2a-7b5b-419c-9836-cc32d64ee9d3 tempest-GroupsTest-1841966773 None] Group tempest-Group2-375844275: creating
Jul 30 20:31:50 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-cefffd2a-7b5b-419c-9836-cc32d64ee9d3 tempest-GroupsTest-1841966773 None] Group tempest-Group2-375844275: created successfully
Jul 30 20:31:50 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-cefffd2a-7b5b-419c-9836-cc32d64ee9d3 tempest-GroupsTest-1841966773 None] Create group completed successfully.
Jul 30 20:31:51 devstack sudo[99843]: pam_unix(sudo:session): session closed for user root
Jul 30 20:31:51 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-df34c53c-d31c-4248-b4d7-83ac6c304b77 tempest-VolumesGetTest-855358902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1ed21181-aca9-4608-89cf-131c66236dc1_alll8m_2devstack@QuobyteHD /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-88ab04e2-478e-4133-9bda-434bec875ca5" returned: 0 in 2.253s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:31:51 devstack cinder-volume[88719]: DEBUG cinder.image.image_utils [None req-df34c53c-d31c-4248-b4d7-83ac6c304b77 tempest-VolumesGetTest-855358902 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1ed21181-aca9-4608-89cf-131c66236dc1_alll8m_2devstack@QuobyteHD, size 112.00 MB, duration 2.25 sec, destination /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-88ab04e2-478e-4133-9bda-434bec875ca5 {{(pid=88719) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 30 20:31:51 devstack cinder-volume[88719]: INFO cinder.image.image_utils [None req-df34c53c-d31c-4248-b4d7-83ac6c304b77 tempest-VolumesGetTest-855358902 None] Converted 112.00 MB image at 49.68 MB/s
Jul 30 20:31:51 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-df34c53c-d31c-4248-b4d7-83ac6c304b77 tempest-VolumesGetTest-855358902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-88ab04e2-478e-4133-9bda-434bec875ca5 1G {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:31:51 devstack sudo[99857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-88ab04e2-478e-4133-9bda-434bec875ca5 1G
Jul 30 20:31:51 devstack sudo[99857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:31:52 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e89775d-0bd0-46db-a218-a25b1eb8f5a3 tempest-GroupsTest-1841966773 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:31:52 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2e89775d-0bd0-46db-a218-a25b1eb8f5a3 tempest-GroupsTest-1841966773 None] Flow 'volume_create_manager' (41444cf7-4849-4675-b0a3-e9a445232e80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:31:52 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2e89775d-0bd0-46db-a218-a25b1eb8f5a3 tempest-GroupsTest-1841966773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e34e793a-ed77-4d60-a00f-a1d2a71c5a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:31:52 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2e89775d-0bd0-46db-a218-a25b1eb8f5a3 tempest-GroupsTest-1841966773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e34e793a-ed77-4d60-a00f-a1d2a71c5a8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:31:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1202572279',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=b0821a41-18cd-4b11-a2de-351dd9be2bd5,host='devstack@QuobyteHD#QuobyteHD',id=90fdb9fc-df01-442d-9f69-d00726bcaf3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90b795e9b25b4cac9c4d37257bc4ec62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:31:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:31:52Z,use_quota=True,user_id='f2f1c41ad4f148a982e054c3ba13b5ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(16fcd015-ec1b-44b3-9851-10e5894ec643),volume_type_id=16fcd015-ec1b-44b3-9851-10e5894ec643)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:31:52 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2e89775d-0bd0-46db-a218-a25b1eb8f5a3 tempest-GroupsTest-1841966773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4e3b9d1-0d5a-4fda-ae47-1f2b68b9d4ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:31:52 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2e89775d-0bd0-46db-a218-a25b1eb8f5a3 tempest-GroupsTest-1841966773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4e3b9d1-0d5a-4fda-ae47-1f2b68b9d4ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:31:52 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2e89775d-0bd0-46db-a218-a25b1eb8f5a3 tempest-GroupsTest-1841966773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ab4dcb1-2045-4f8c-ae39-7b9f0dc4ff25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:31:52 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2e89775d-0bd0-46db-a218-a25b1eb8f5a3 tempest-GroupsTest-1841966773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ab4dcb1-2045-4f8c-ae39-7b9f0dc4ff25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90fdb9fc-df01-442d-9f69-d00726bcaf3b', 'volume_name': 'volume-90fdb9fc-df01-442d-9f69-d00726bcaf3b', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:31:52 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2e89775d-0bd0-46db-a218-a25b1eb8f5a3 tempest-GroupsTest-1841966773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (687db1cb-f911-4c02-9d45-842703b8a714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:31:52 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2e89775d-0bd0-46db-a218-a25b1eb8f5a3 tempest-GroupsTest-1841966773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (687db1cb-f911-4c02-9d45-842703b8a714) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:31:52 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2e89775d-0bd0-46db-a218-a25b1eb8f5a3 tempest-GroupsTest-1841966773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1b5ca36-2a99-40ca-86c6-a79c75b4a707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:31:52 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-2e89775d-0bd0-46db-a218-a25b1eb8f5a3 tempest-GroupsTest-1841966773 None] Volume 90fdb9fc-df01-442d-9f69-d00726bcaf3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90fdb9fc-df01-442d-9f69-d00726bcaf3b', 'volume_size': 1}
Jul 30 20:31:52 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-2e89775d-0bd0-46db-a218-a25b1eb8f5a3 tempest-GroupsTest-1841966773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:31:52 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-2e89775d-0bd0-46db-a218-a25b1eb8f5a3 tempest-GroupsTest-1841966773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:31:52 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-2e89775d-0bd0-46db-a218-a25b1eb8f5a3 tempest-GroupsTest-1841966773 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=b0821a41-18cd-4b11-a2de-351dd9be2bd5,created_at=2026-07-30T18:31:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1202572279',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=b0821a41-18cd-4b11-a2de-351dd9be2bd5,host='devstack@QuobyteHD#QuobyteHD',id=90fdb9fc-df01-442d-9f69-d00726bcaf3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90b795e9b25b4cac9c4d37257bc4ec62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:31:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:31:52Z,use_quota=True,user_id='f2f1c41ad4f148a982e054c3ba13b5ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(16fcd015-ec1b-44b3-9851-10e5894ec643),volume_type_id=16fcd015-ec1b-44b3-9851-10e5894ec643)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:31:52 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-2e89775d-0bd0-46db-a218-a25b1eb8f5a3 tempest-GroupsTest-1841966773 None] Creating volume 90fdb9fc-df01-442d-9f69-d00726bcaf3b {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:31:52 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-2e89775d-0bd0-46db-a218-a25b1eb8f5a3 tempest-GroupsTest-1841966773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:31:52 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-2e89775d-0bd0-46db-a218-a25b1eb8f5a3 tempest-GroupsTest-1841966773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:31:52 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-2e89775d-0bd0-46db-a218-a25b1eb8f5a3 tempest-GroupsTest-1841966773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:31:52 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-2e89775d-0bd0-46db-a218-a25b1eb8f5a3 tempest-GroupsTest-1841966773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:31:52 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-2e89775d-0bd0-46db-a218-a25b1eb8f5a3 tempest-GroupsTest-1841966773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:31:52 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-2e89775d-0bd0-46db-a218-a25b1eb8f5a3 tempest-GroupsTest-1841966773 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:31:52 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-2e89775d-0bd0-46db-a218-a25b1eb8f5a3 tempest-GroupsTest-1841966773 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:31:52 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2e89775d-0bd0-46db-a218-a25b1eb8f5a3 tempest-GroupsTest-1841966773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-90fdb9fc-df01-442d-9f69-d00726bcaf3b 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:31:52 devstack sudo[99857]: pam_unix(sudo:session): session closed for user root
Jul 30 20:31:52 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-df34c53c-d31c-4248-b4d7-83ac6c304b77 tempest-VolumesGetTest-855358902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-88ab04e2-478e-4133-9bda-434bec875ca5 1G" returned: 0 in 0.413s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:31:52 devstack cinder-volume[88719]: DEBUG cinder.volume.volume_utils [None req-df34c53c-d31c-4248-b4d7-83ac6c304b77 tempest-VolumesGetTest-855358902 None] Downloaded image 1ed21181-aca9-4608-89cf-131c66236dc1 ((None, [{'url': 'file:///opt/stack/data/glance/images/1ed21181-aca9-4608-89cf-131c66236dc1', 'metadata': {}}])) to volume 88ab04e2-478e-4133-9bda-434bec875ca5 successfully. {{(pid=88719) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 30 20:31:52 devstack cinder-volume[88719]: DEBUG cinder.image.image_utils [None req-df34c53c-d31c-4248-b4d7-83ac6c304b77 tempest-VolumesGetTest-855358902 None] Temporary image 1ed21181-aca9-4608-89cf-131c66236dc1 for user e1274cdacdf54e3fbb200f3552412b74 is deleted. {{(pid=88719) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 30 20:31:52 devstack cinder-volume[88719]: DEBUG cinder.volume.volume_utils [None req-df34c53c-d31c-4248-b4d7-83ac6c304b77 tempest-VolumesGetTest-855358902 None] Marking volume 88ab04e2-478e-4133-9bda-434bec875ca5 as bootable. {{(pid=88719) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 30 20:31:52 devstack sudo[99863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-90fdb9fc-df01-442d-9f69-d00726bcaf3b 1073741824
Jul 30 20:31:52 devstack sudo[99863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:31:52 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-df34c53c-d31c-4248-b4d7-83ac6c304b77 tempest-VolumesGetTest-855358902 None] Copying metadata from image 1ed21181-aca9-4608-89cf-131c66236dc1 to 88ab04e2-478e-4133-9bda-434bec875ca5. {{(pid=88719) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 30 20:31:52 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-df34c53c-d31c-4248-b4d7-83ac6c304b77 tempest-VolumesGetTest-855358902 None] Creating volume glance metadata for volume 88ab04e2-478e-4133-9bda-434bec875ca5 backed by image 1ed21181-aca9-4608-89cf-131c66236dc1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '1ed21181-aca9-4608-89cf-131c66236dc1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88719) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 30 20:31:52 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-df34c53c-d31c-4248-b4d7-83ac6c304b77 tempest-VolumesGetTest-855358902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4613bb76-b97d-4666-a570-e6039a5d8108) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88ab04e2-478e-4133-9bda-434bec875ca5', 'volume_size': 1, 'image_id': '1ed21181-aca9-4608-89cf-131c66236dc1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1ed21181-aca9-4608-89cf-131c66236dc1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ec1eaae7620840deac2e426a7e923b06', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1ed21181-aca9-4608-89cf-131c66236dc1', 'created_at': datetime.datetime(2026, 7, 30, 18, 17, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 18, 17, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1ed21181-aca9-4608-89cf-131c66236dc1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x78688470b290>}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:31:52 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-df34c53c-d31c-4248-b4d7-83ac6c304b77 tempest-VolumesGetTest-855358902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a34268fb-7ffe-499b-8c1b-954170625911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:31:52 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-df34c53c-d31c-4248-b4d7-83ac6c304b77 tempest-VolumesGetTest-855358902 None] Volume volume-88ab04e2-478e-4133-9bda-434bec875ca5 (88ab04e2-478e-4133-9bda-434bec875ca5): created successfully
Jul 30 20:31:52 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-df34c53c-d31c-4248-b4d7-83ac6c304b77 tempest-VolumesGetTest-855358902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a34268fb-7ffe-499b-8c1b-954170625911) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:31:52 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-df34c53c-d31c-4248-b4d7-83ac6c304b77 tempest-VolumesGetTest-855358902 None] Flow 'volume_create_manager' (61c2bdd9-b491-480f-a33e-284b74f5940f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:31:52 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-df34c53c-d31c-4248-b4d7-83ac6c304b77 tempest-VolumesGetTest-855358902 None] Created volume successfully.
Jul 30 20:31:52 devstack sudo[99863]: pam_unix(sudo:session): session closed for user root
Jul 30 20:31:52 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2e89775d-0bd0-46db-a218-a25b1eb8f5a3 tempest-GroupsTest-1841966773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-90fdb9fc-df01-442d-9f69-d00726bcaf3b 1073741824" returned: 0 in 0.654s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:31:53 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2e89775d-0bd0-46db-a218-a25b1eb8f5a3 tempest-GroupsTest-1841966773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-90fdb9fc-df01-442d-9f69-d00726bcaf3b {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:31:53 devstack sudo[99868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-90fdb9fc-df01-442d-9f69-d00726bcaf3b
Jul 30 20:31:53 devstack sudo[99868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:31:53 devstack sudo[99868]: pam_unix(sudo:session): session closed for user root
Jul 30 20:31:53 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2e89775d-0bd0-46db-a218-a25b1eb8f5a3 tempest-GroupsTest-1841966773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-90fdb9fc-df01-442d-9f69-d00726bcaf3b" returned: 0 in 0.344s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:31:53 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-2e89775d-0bd0-46db-a218-a25b1eb8f5a3 tempest-GroupsTest-1841966773 None] <== create_volume: return (1078ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:31:53 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-2e89775d-0bd0-46db-a218-a25b1eb8f5a3 tempest-GroupsTest-1841966773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.081s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:31:53 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2e89775d-0bd0-46db-a218-a25b1eb8f5a3 tempest-GroupsTest-1841966773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1b5ca36-2a99-40ca-86c6-a79c75b4a707) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90fdb9fc-df01-442d-9f69-d00726bcaf3b', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:31:53 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2e89775d-0bd0-46db-a218-a25b1eb8f5a3 tempest-GroupsTest-1841966773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9070291d-c84e-48db-ae9e-766b9fd1d100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:31:53 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-2e89775d-0bd0-46db-a218-a25b1eb8f5a3 tempest-GroupsTest-1841966773 None] Volume volume-90fdb9fc-df01-442d-9f69-d00726bcaf3b (90fdb9fc-df01-442d-9f69-d00726bcaf3b): created successfully
Jul 30 20:31:53 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2e89775d-0bd0-46db-a218-a25b1eb8f5a3 tempest-GroupsTest-1841966773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9070291d-c84e-48db-ae9e-766b9fd1d100) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:31:53 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2e89775d-0bd0-46db-a218-a25b1eb8f5a3 tempest-GroupsTest-1841966773 None] Flow 'volume_create_manager' (41444cf7-4849-4675-b0a3-e9a445232e80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:31:53 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-2e89775d-0bd0-46db-a218-a25b1eb8f5a3 tempest-GroupsTest-1841966773 None] Created volume successfully.
Jul 30 20:31:53 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-762eb141-c905-413a-ab37-9ccbaee01644 tempest-VolumesGetTest-855358902 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:31:53 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-762eb141-c905-413a-ab37-9ccbaee01644 tempest-VolumesGetTest-855358902 None] Flow 'volume_create_manager' (d404501a-f636-4b11-8cac-780feb94dff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:31:53 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-762eb141-c905-413a-ab37-9ccbaee01644 tempest-VolumesGetTest-855358902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc550a3f-f53a-4fb2-98e4-1f9419717671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:31:53 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-762eb141-c905-413a-ab37-9ccbaee01644 tempest-VolumesGetTest-855358902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc550a3f-f53a-4fb2-98e4-1f9419717671) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:31:53Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-190987365',display_name='tempest-VolumesGetTest-Volume-1535433568',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e18c9e1-2a9f-4313-80a6-8767cbb08efd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95dc6a3a598a411dbd7b034cb48fcbb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:31:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:31:54Z,use_quota=True,user_id='e1274cdacdf54e3fbb200f3552412b74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:31:53 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-762eb141-c905-413a-ab37-9ccbaee01644 tempest-VolumesGetTest-855358902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2dfff89-0de6-4f43-a47a-7f62705d6df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:31:53 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-762eb141-c905-413a-ab37-9ccbaee01644 tempest-VolumesGetTest-855358902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2dfff89-0de6-4f43-a47a-7f62705d6df9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:31:53 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-762eb141-c905-413a-ab37-9ccbaee01644 tempest-VolumesGetTest-855358902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ca6b2b9-6b3c-4630-9aaa-4452c8ad87a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:31:53 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-762eb141-c905-413a-ab37-9ccbaee01644 tempest-VolumesGetTest-855358902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ca6b2b9-6b3c-4630-9aaa-4452c8ad87a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e18c9e1-2a9f-4313-80a6-8767cbb08efd', 'volume_name': 'volume-9e18c9e1-2a9f-4313-80a6-8767cbb08efd', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:31:53 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-762eb141-c905-413a-ab37-9ccbaee01644 tempest-VolumesGetTest-855358902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (956184f2-7000-41fd-bc1d-6a4608a5d64b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:31:53 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-762eb141-c905-413a-ab37-9ccbaee01644 tempest-VolumesGetTest-855358902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (956184f2-7000-41fd-bc1d-6a4608a5d64b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:31:53 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-762eb141-c905-413a-ab37-9ccbaee01644 tempest-VolumesGetTest-855358902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (beee57ac-f380-4e29-91e3-e7835b3a0a76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:31:53 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-762eb141-c905-413a-ab37-9ccbaee01644 tempest-VolumesGetTest-855358902 None] Volume 9e18c9e1-2a9f-4313-80a6-8767cbb08efd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e18c9e1-2a9f-4313-80a6-8767cbb08efd', 'volume_size': 1}
Jul 30 20:31:53 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-762eb141-c905-413a-ab37-9ccbaee01644 tempest-VolumesGetTest-855358902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:31:53 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-762eb141-c905-413a-ab37-9ccbaee01644 tempest-VolumesGetTest-855358902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:31:53 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-762eb141-c905-413a-ab37-9ccbaee01644 tempest-VolumesGetTest-855358902 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:31:53Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-190987365',display_name='tempest-VolumesGetTest-Volume-1535433568',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e18c9e1-2a9f-4313-80a6-8767cbb08efd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95dc6a3a598a411dbd7b034cb48fcbb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:31:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:31:54Z,use_quota=True,user_id='e1274cdacdf54e3fbb200f3552412b74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:31:53 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-762eb141-c905-413a-ab37-9ccbaee01644 tempest-VolumesGetTest-855358902 None] Creating volume 9e18c9e1-2a9f-4313-80a6-8767cbb08efd {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:31:53 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-762eb141-c905-413a-ab37-9ccbaee01644 tempest-VolumesGetTest-855358902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:31:53 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-762eb141-c905-413a-ab37-9ccbaee01644 tempest-VolumesGetTest-855358902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:31:53 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-762eb141-c905-413a-ab37-9ccbaee01644 tempest-VolumesGetTest-855358902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:31:53 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-762eb141-c905-413a-ab37-9ccbaee01644 tempest-VolumesGetTest-855358902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:31:53 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-762eb141-c905-413a-ab37-9ccbaee01644 tempest-VolumesGetTest-855358902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:31:53 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-762eb141-c905-413a-ab37-9ccbaee01644 tempest-VolumesGetTest-855358902 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:31:53 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-762eb141-c905-413a-ab37-9ccbaee01644 tempest-VolumesGetTest-855358902 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:31:53 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-762eb141-c905-413a-ab37-9ccbaee01644 tempest-VolumesGetTest-855358902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-9e18c9e1-2a9f-4313-80a6-8767cbb08efd 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:31:54 devstack sudo[99871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-9e18c9e1-2a9f-4313-80a6-8767cbb08efd 1073741824
Jul 30 20:31:54 devstack sudo[99871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:31:54 devstack sudo[99871]: pam_unix(sudo:session): session closed for user root
Jul 30 20:31:54 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-762eb141-c905-413a-ab37-9ccbaee01644 tempest-VolumesGetTest-855358902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-9e18c9e1-2a9f-4313-80a6-8767cbb08efd 1073741824" returned: 0 in 0.560s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:31:54 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-762eb141-c905-413a-ab37-9ccbaee01644 tempest-VolumesGetTest-855358902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-9e18c9e1-2a9f-4313-80a6-8767cbb08efd {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:31:54 devstack sudo[99879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-9e18c9e1-2a9f-4313-80a6-8767cbb08efd
Jul 30 20:31:54 devstack sudo[99879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:31:54 devstack sudo[99879]: pam_unix(sudo:session): session closed for user root
Jul 30 20:31:54 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-762eb141-c905-413a-ab37-9ccbaee01644 tempest-VolumesGetTest-855358902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-9e18c9e1-2a9f-4313-80a6-8767cbb08efd" returned: 0 in 0.317s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:31:54 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-762eb141-c905-413a-ab37-9ccbaee01644 tempest-VolumesGetTest-855358902 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:31:54 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-762eb141-c905-413a-ab37-9ccbaee01644 tempest-VolumesGetTest-855358902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:31:54 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-762eb141-c905-413a-ab37-9ccbaee01644 tempest-VolumesGetTest-855358902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (beee57ac-f380-4e29-91e3-e7835b3a0a76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e18c9e1-2a9f-4313-80a6-8767cbb08efd', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:31:54 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-762eb141-c905-413a-ab37-9ccbaee01644 tempest-VolumesGetTest-855358902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba30d7dd-3dcf-4846-b1b0-aace7ae876d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:31:54 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-762eb141-c905-413a-ab37-9ccbaee01644 tempest-VolumesGetTest-855358902 None] Volume volume-9e18c9e1-2a9f-4313-80a6-8767cbb08efd (9e18c9e1-2a9f-4313-80a6-8767cbb08efd): created successfully
Jul 30 20:31:54 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-762eb141-c905-413a-ab37-9ccbaee01644 tempest-VolumesGetTest-855358902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba30d7dd-3dcf-4846-b1b0-aace7ae876d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:31:54 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-762eb141-c905-413a-ab37-9ccbaee01644 tempest-VolumesGetTest-855358902 None] Flow 'volume_create_manager' (d404501a-f636-4b11-8cac-780feb94dff2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:31:54 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-762eb141-c905-413a-ab37-9ccbaee01644 tempest-VolumesGetTest-855358902 None] Created volume successfully.
Jul 30 20:31:55 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-db71acdf-a4b5-4b4b-b7c7-85cfd2f5fd59 tempest-GroupsTest-1841966773 None] Acquiring lock "cinder-quobyte-90fdb9fc-df01-442d-9f69-d00726bcaf3b" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:31:55 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-db71acdf-a4b5-4b4b-b7c7-85cfd2f5fd59 tempest-GroupsTest-1841966773 None] Lock "cinder-quobyte-90fdb9fc-df01-442d-9f69-d00726bcaf3b" acquired by "delete_volume" :: waited 0.021s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:31:55 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9f2fdff-ff81-438c-b2aa-1bb27ca7248d]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:31:55 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-db71acdf-a4b5-4b4b-b7c7-85cfd2f5fd59 tempest-GroupsTest-1841966773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-90fdb9fc-df01-442d-9f69-d00726bcaf3b {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:31:55 devstack sudo[99882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-90fdb9fc-df01-442d-9f69-d00726bcaf3b
Jul 30 20:31:55 devstack sudo[99882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:31:55 devstack sudo[99882]: pam_unix(sudo:session): session closed for user root
Jul 30 20:31:55 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-db71acdf-a4b5-4b4b-b7c7-85cfd2f5fd59 tempest-GroupsTest-1841966773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-90fdb9fc-df01-442d-9f69-d00726bcaf3b" returned: 0 in 0.438s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:31:55 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-db71acdf-a4b5-4b4b-b7c7-85cfd2f5fd59 tempest-GroupsTest-1841966773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-90fdb9fc-df01-442d-9f69-d00726bcaf3b {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:31:55 devstack sudo[99887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-90fdb9fc-df01-442d-9f69-d00726bcaf3b
Jul 30 20:31:55 devstack sudo[99887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:31:56 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-7f77ed85-eef4-4746-a8d2-c9eaecf9d552 tempest-VolumesGetTest-855358902 None] Acquiring lock "cinder-9e18c9e1-2a9f-4313-80a6-8767cbb08efd-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:31:56 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-7f77ed85-eef4-4746-a8d2-c9eaecf9d552 tempest-VolumesGetTest-855358902 None] Lock "cinder-9e18c9e1-2a9f-4313-80a6-8767cbb08efd-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:31:56 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-7f77ed85-eef4-4746-a8d2-c9eaecf9d552 tempest-VolumesGetTest-855358902 None] Acquiring lock "cinder-quobyte-9e18c9e1-2a9f-4313-80a6-8767cbb08efd" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:31:56 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-7f77ed85-eef4-4746-a8d2-c9eaecf9d552 tempest-VolumesGetTest-855358902 None] Lock "cinder-quobyte-9e18c9e1-2a9f-4313-80a6-8767cbb08efd" acquired by "delete_volume" :: waited 0.019s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:31:56 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[33068dfb-b696-4212-a253-99812cd36055]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:31:56 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-7f77ed85-eef4-4746-a8d2-c9eaecf9d552 tempest-VolumesGetTest-855358902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-9e18c9e1-2a9f-4313-80a6-8767cbb08efd {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:31:56 devstack sudo[99887]: pam_unix(sudo:session): session closed for user root
Jul 30 20:31:56 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-db71acdf-a4b5-4b4b-b7c7-85cfd2f5fd59 tempest-GroupsTest-1841966773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-90fdb9fc-df01-442d-9f69-d00726bcaf3b" returned: 0 in 0.393s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:31:56 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-db71acdf-a4b5-4b4b-b7c7-85cfd2f5fd59 tempest-GroupsTest-1841966773 None] Lock "cinder-quobyte-90fdb9fc-df01-442d-9f69-d00726bcaf3b" released by "delete_volume" :: held 0.884s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:31:56 devstack sudo[99890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-9e18c9e1-2a9f-4313-80a6-8767cbb08efd
Jul 30 20:31:56 devstack sudo[99890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:31:56 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-db71acdf-a4b5-4b4b-b7c7-85cfd2f5fd59 tempest-GroupsTest-1841966773 None] Created reservations ['cb655c00-0205-4832-8abb-bba0a0c99988'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:31:56 devstack cinder-volume[88719]: WARNING cinder.quota [None req-db71acdf-a4b5-4b4b-b7c7-85cfd2f5fd59 tempest-GroupsTest-1841966773 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-136193613 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-136193613, it is now deprecated. Please use the default quota class for default quota.
Jul 30 20:31:56 devstack cinder-volume[88719]: WARNING cinder.quota [None req-db71acdf-a4b5-4b4b-b7c7-85cfd2f5fd59 tempest-GroupsTest-1841966773 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-136193613 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-136193613, it is now deprecated. Please use the default quota class for default quota.
Jul 30 20:31:56 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-db71acdf-a4b5-4b4b-b7c7-85cfd2f5fd59 tempest-GroupsTest-1841966773 None] Created reservations ['0b25f88c-fd67-4e9c-8c2e-8406a12d2e02', 'a984597b-99ce-4a96-8e03-ea3d5ef4a181', '9430e8e9-3bc6-4716-9dee-acab6ae0e42c', '6669d26e-e345-408a-b072-c04876cac6f1'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:31:56 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-db71acdf-a4b5-4b4b-b7c7-85cfd2f5fd59 tempest-GroupsTest-1841966773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:31:56 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-db71acdf-a4b5-4b4b-b7c7-85cfd2f5fd59 tempest-GroupsTest-1841966773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:31:56 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-db71acdf-a4b5-4b4b-b7c7-85cfd2f5fd59 tempest-GroupsTest-1841966773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:31:56 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-db71acdf-a4b5-4b4b-b7c7-85cfd2f5fd59 tempest-GroupsTest-1841966773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:31:56 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-db71acdf-a4b5-4b4b-b7c7-85cfd2f5fd59 tempest-GroupsTest-1841966773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:31:56 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-db71acdf-a4b5-4b4b-b7c7-85cfd2f5fd59 tempest-GroupsTest-1841966773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:31:56 devstack sudo[99894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:31:56 devstack sudo[99894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:31:56 devstack sudo[99890]: pam_unix(sudo:session): session closed for user root
Jul 30 20:31:56 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-7f77ed85-eef4-4746-a8d2-c9eaecf9d552 tempest-VolumesGetTest-855358902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-9e18c9e1-2a9f-4313-80a6-8767cbb08efd" returned: 0 in 0.482s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:31:56 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-7f77ed85-eef4-4746-a8d2-c9eaecf9d552 tempest-VolumesGetTest-855358902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-9e18c9e1-2a9f-4313-80a6-8767cbb08efd {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:31:56 devstack sudo[99897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-9e18c9e1-2a9f-4313-80a6-8767cbb08efd
Jul 30 20:31:56 devstack sudo[99897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:31:56 devstack sudo[99894]: pam_unix(sudo:session): session closed for user root
Jul 30 20:31:56 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-db71acdf-a4b5-4b4b-b7c7-85cfd2f5fd59 tempest-GroupsTest-1841966773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.286s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:31:56 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-db71acdf-a4b5-4b4b-b7c7-85cfd2f5fd59 tempest-GroupsTest-1841966773 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:31:56 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-db71acdf-a4b5-4b4b-b7c7-85cfd2f5fd59 tempest-GroupsTest-1841966773 None] Delete group completed successfully.
Jul 30 20:31:57 devstack sudo[99897]: pam_unix(sudo:session): session closed for user root
Jul 30 20:31:57 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-7f77ed85-eef4-4746-a8d2-c9eaecf9d552 tempest-VolumesGetTest-855358902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-9e18c9e1-2a9f-4313-80a6-8767cbb08efd" returned: 0 in 0.310s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:31:57 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-7f77ed85-eef4-4746-a8d2-c9eaecf9d552 tempest-VolumesGetTest-855358902 None] Lock "cinder-quobyte-9e18c9e1-2a9f-4313-80a6-8767cbb08efd" released by "delete_volume" :: held 0.848s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:31:57 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-7f77ed85-eef4-4746-a8d2-c9eaecf9d552 tempest-VolumesGetTest-855358902 None] Created reservations ['7c6d733a-5468-4aff-b892-2927a10d23d1', '45eaaf96-327f-4168-a1b5-e245b34762a7', '37f163a2-0efe-401c-9f13-a49a8b2cdeda', '8340da16-5a1c-4424-a4db-af5d48ea1ad7'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:31:57 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-7f77ed85-eef4-4746-a8d2-c9eaecf9d552 tempest-VolumesGetTest-855358902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:31:57 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-7f77ed85-eef4-4746-a8d2-c9eaecf9d552 tempest-VolumesGetTest-855358902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:31:57 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-7f77ed85-eef4-4746-a8d2-c9eaecf9d552 tempest-VolumesGetTest-855358902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:31:57 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-7f77ed85-eef4-4746-a8d2-c9eaecf9d552 tempest-VolumesGetTest-855358902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:31:57 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-7f77ed85-eef4-4746-a8d2-c9eaecf9d552 tempest-VolumesGetTest-855358902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:31:57 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-7f77ed85-eef4-4746-a8d2-c9eaecf9d552 tempest-VolumesGetTest-855358902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:31:57 devstack sudo[99901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:31:57 devstack sudo[99901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:31:57 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-f004d297-5f9c-46df-9afd-5f6b4bfdeaa6 tempest-VolumesGetTest-855358902 None] Acquiring lock "cinder-88ab04e2-478e-4133-9bda-434bec875ca5-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:31:57 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-f004d297-5f9c-46df-9afd-5f6b4bfdeaa6 tempest-VolumesGetTest-855358902 None] Lock "cinder-88ab04e2-478e-4133-9bda-434bec875ca5-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:31:57 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-f004d297-5f9c-46df-9afd-5f6b4bfdeaa6 tempest-VolumesGetTest-855358902 None] Acquiring lock "cinder-quobyte-88ab04e2-478e-4133-9bda-434bec875ca5" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:31:57 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-f004d297-5f9c-46df-9afd-5f6b4bfdeaa6 tempest-VolumesGetTest-855358902 None] Lock "cinder-quobyte-88ab04e2-478e-4133-9bda-434bec875ca5" acquired by "delete_volume" :: waited 0.017s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:31:57 devstack sudo[99901]: pam_unix(sudo:session): session closed for user root
Jul 30 20:31:57 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-7f77ed85-eef4-4746-a8d2-c9eaecf9d552 tempest-VolumesGetTest-855358902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.376s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:31:57 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-7f77ed85-eef4-4746-a8d2-c9eaecf9d552 tempest-VolumesGetTest-855358902 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:31:57 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-7f77ed85-eef4-4746-a8d2-c9eaecf9d552 tempest-VolumesGetTest-855358902 None] Deleted volume successfully.
Jul 30 20:31:57 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[da388a50-fa45-4cf2-a5a5-857e0e70e287]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:31:57 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f004d297-5f9c-46df-9afd-5f6b4bfdeaa6 tempest-VolumesGetTest-855358902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-88ab04e2-478e-4133-9bda-434bec875ca5 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:31:57 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-7f77ed85-eef4-4746-a8d2-c9eaecf9d552 tempest-VolumesGetTest-855358902 None] Lock "cinder-9e18c9e1-2a9f-4313-80a6-8767cbb08efd-delete_volume" released by "delete_volume" :: held 1.503s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:31:57 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7e8ef9c-221c-4568-ac21-e05a87bac8e7 tempest-VolumesCloneTest-1963593569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:31:57 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-c7e8ef9c-221c-4568-ac21-e05a87bac8e7 tempest-VolumesCloneTest-1963593569 None] Flow 'volume_create_manager' (6dfb5545-ea9d-444c-9037-a3004c8bd0bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:31:57 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-c7e8ef9c-221c-4568-ac21-e05a87bac8e7 tempest-VolumesCloneTest-1963593569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6404fb22-ed0c-4814-a328-0ee44c5f64ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:31:57 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-c7e8ef9c-221c-4568-ac21-e05a87bac8e7 tempest-VolumesCloneTest-1963593569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6404fb22-ed0c-4814-a328-0ee44c5f64ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:31:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-936497142',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c7cebc2-ad68-4f23-97ba-42145a855f1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63131686b405472abbd34180dd3136e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:31:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:31:58Z,use_quota=True,user_id='86e12245e71f4f6e8731edbac02c295b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:31:57 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-c7e8ef9c-221c-4568-ac21-e05a87bac8e7 tempest-VolumesCloneTest-1963593569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81395116-f721-44f0-b66e-42c623367251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:31:57 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-c7e8ef9c-221c-4568-ac21-e05a87bac8e7 tempest-VolumesCloneTest-1963593569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81395116-f721-44f0-b66e-42c623367251) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:31:57 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-c7e8ef9c-221c-4568-ac21-e05a87bac8e7 tempest-VolumesCloneTest-1963593569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ecb42aa-df85-4853-8c85-81f22625bc5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:31:57 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-c7e8ef9c-221c-4568-ac21-e05a87bac8e7 tempest-VolumesCloneTest-1963593569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ecb42aa-df85-4853-8c85-81f22625bc5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c7cebc2-ad68-4f23-97ba-42145a855f1a', 'volume_name': 'volume-0c7cebc2-ad68-4f23-97ba-42145a855f1a', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:31:57 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-c7e8ef9c-221c-4568-ac21-e05a87bac8e7 tempest-VolumesCloneTest-1963593569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc4952b7-4b31-452d-b495-d0b247746bb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:31:57 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-c7e8ef9c-221c-4568-ac21-e05a87bac8e7 tempest-VolumesCloneTest-1963593569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc4952b7-4b31-452d-b495-d0b247746bb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:31:57 devstack sudo[99904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-88ab04e2-478e-4133-9bda-434bec875ca5
Jul 30 20:31:57 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-c7e8ef9c-221c-4568-ac21-e05a87bac8e7 tempest-VolumesCloneTest-1963593569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d334d85-8ca3-4130-9747-b225f9cc93e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:31:57 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-c7e8ef9c-221c-4568-ac21-e05a87bac8e7 tempest-VolumesCloneTest-1963593569 None] Volume 0c7cebc2-ad68-4f23-97ba-42145a855f1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c7cebc2-ad68-4f23-97ba-42145a855f1a', 'volume_size': 1}
Jul 30 20:31:57 devstack sudo[99904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:31:57 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-c7e8ef9c-221c-4568-ac21-e05a87bac8e7 tempest-VolumesCloneTest-1963593569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:31:57 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-c7e8ef9c-221c-4568-ac21-e05a87bac8e7 tempest-VolumesCloneTest-1963593569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:31:57 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-c7e8ef9c-221c-4568-ac21-e05a87bac8e7 tempest-VolumesCloneTest-1963593569 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:31:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-936497142',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c7cebc2-ad68-4f23-97ba-42145a855f1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63131686b405472abbd34180dd3136e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:31:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:31:58Z,use_quota=True,user_id='86e12245e71f4f6e8731edbac02c295b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:31:57 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-c7e8ef9c-221c-4568-ac21-e05a87bac8e7 tempest-VolumesCloneTest-1963593569 None] Creating volume 0c7cebc2-ad68-4f23-97ba-42145a855f1a {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:31:57 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-c7e8ef9c-221c-4568-ac21-e05a87bac8e7 tempest-VolumesCloneTest-1963593569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:31:57 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-c7e8ef9c-221c-4568-ac21-e05a87bac8e7 tempest-VolumesCloneTest-1963593569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:31:57 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-c7e8ef9c-221c-4568-ac21-e05a87bac8e7 tempest-VolumesCloneTest-1963593569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:31:57 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-c7e8ef9c-221c-4568-ac21-e05a87bac8e7 tempest-VolumesCloneTest-1963593569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:31:57 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-c7e8ef9c-221c-4568-ac21-e05a87bac8e7 tempest-VolumesCloneTest-1963593569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:31:57 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-c7e8ef9c-221c-4568-ac21-e05a87bac8e7 tempest-VolumesCloneTest-1963593569 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:31:57 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-c7e8ef9c-221c-4568-ac21-e05a87bac8e7 tempest-VolumesCloneTest-1963593569 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:31:57 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-c7e8ef9c-221c-4568-ac21-e05a87bac8e7 tempest-VolumesCloneTest-1963593569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0c7cebc2-ad68-4f23-97ba-42145a855f1a 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:31:57 devstack sudo[99906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0c7cebc2-ad68-4f23-97ba-42145a855f1a 1073741824
Jul 30 20:31:57 devstack sudo[99906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:31:57 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-772cda2d-1a6f-4a2e-880b-524cb81537f4 tempest-GroupsTest-1841966773 None] Created reservations ['a879e5b1-9479-4a7d-ad57-f0fd5c3ffe82'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:31:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-772cda2d-1a6f-4a2e-880b-524cb81537f4 tempest-GroupsTest-1841966773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:31:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-772cda2d-1a6f-4a2e-880b-524cb81537f4 tempest-GroupsTest-1841966773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:31:58 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-772cda2d-1a6f-4a2e-880b-524cb81537f4 tempest-GroupsTest-1841966773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:31:58 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-772cda2d-1a6f-4a2e-880b-524cb81537f4 tempest-GroupsTest-1841966773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:31:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-772cda2d-1a6f-4a2e-880b-524cb81537f4 tempest-GroupsTest-1841966773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:31:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-772cda2d-1a6f-4a2e-880b-524cb81537f4 tempest-GroupsTest-1841966773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:31:58 devstack sudo[99912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:31:58 devstack sudo[99912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:31:58 devstack sudo[99904]: pam_unix(sudo:session): session closed for user root
Jul 30 20:31:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f004d297-5f9c-46df-9afd-5f6b4bfdeaa6 tempest-VolumesGetTest-855358902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-88ab04e2-478e-4133-9bda-434bec875ca5" returned: 0 in 0.521s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:31:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f004d297-5f9c-46df-9afd-5f6b4bfdeaa6 tempest-VolumesGetTest-855358902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-88ab04e2-478e-4133-9bda-434bec875ca5 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:31:58 devstack sudo[99914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-88ab04e2-478e-4133-9bda-434bec875ca5
Jul 30 20:31:58 devstack sudo[99914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:31:58 devstack sudo[99912]: pam_unix(sudo:session): session closed for user root
Jul 30 20:31:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-772cda2d-1a6f-4a2e-880b-524cb81537f4 tempest-GroupsTest-1841966773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.416s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:31:58 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-772cda2d-1a6f-4a2e-880b-524cb81537f4 tempest-GroupsTest-1841966773 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:31:58 devstack sudo[99914]: pam_unix(sudo:session): session closed for user root
Jul 30 20:31:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f004d297-5f9c-46df-9afd-5f6b4bfdeaa6 tempest-VolumesGetTest-855358902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-88ab04e2-478e-4133-9bda-434bec875ca5" returned: 0 in 0.342s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:31:58 devstack sudo[99906]: pam_unix(sudo:session): session closed for user root
Jul 30 20:31:58 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-772cda2d-1a6f-4a2e-880b-524cb81537f4 tempest-GroupsTest-1841966773 None] Delete group completed successfully.
Jul 30 20:31:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-c7e8ef9c-221c-4568-ac21-e05a87bac8e7 tempest-VolumesCloneTest-1963593569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0c7cebc2-ad68-4f23-97ba-42145a855f1a 1073741824" returned: 0 in 0.727s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:31:58 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-f004d297-5f9c-46df-9afd-5f6b4bfdeaa6 tempest-VolumesGetTest-855358902 None] Lock "cinder-quobyte-88ab04e2-478e-4133-9bda-434bec875ca5" released by "delete_volume" :: held 0.933s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:31:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-c7e8ef9c-221c-4568-ac21-e05a87bac8e7 tempest-VolumesCloneTest-1963593569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0c7cebc2-ad68-4f23-97ba-42145a855f1a {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:31:58 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-f004d297-5f9c-46df-9afd-5f6b4bfdeaa6 tempest-VolumesGetTest-855358902 None] Created reservations ['38a7bc20-91dd-4f75-ae28-87aa2e6e49be', '5d1236ec-8d24-4c78-bb82-e8619ef324c0', '043c4f86-86ba-4dd0-82ea-2e02af56979a', 'e3f96167-f33b-4a42-ad19-8a3eed56d685'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:31:58 devstack sudo[99922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0c7cebc2-ad68-4f23-97ba-42145a855f1a
Jul 30 20:31:58 devstack sudo[99922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:31:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-f004d297-5f9c-46df-9afd-5f6b4bfdeaa6 tempest-VolumesGetTest-855358902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:31:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-f004d297-5f9c-46df-9afd-5f6b4bfdeaa6 tempest-VolumesGetTest-855358902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:31:58 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-f004d297-5f9c-46df-9afd-5f6b4bfdeaa6 tempest-VolumesGetTest-855358902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:31:58 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-f004d297-5f9c-46df-9afd-5f6b4bfdeaa6 tempest-VolumesGetTest-855358902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:31:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-f004d297-5f9c-46df-9afd-5f6b4bfdeaa6 tempest-VolumesGetTest-855358902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:31:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f004d297-5f9c-46df-9afd-5f6b4bfdeaa6 tempest-VolumesGetTest-855358902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:31:58 devstack sudo[99958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:31:58 devstack sudo[99958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:31:58 devstack sudo[99922]: pam_unix(sudo:session): session closed for user root
Jul 30 20:31:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-c7e8ef9c-221c-4568-ac21-e05a87bac8e7 tempest-VolumesCloneTest-1963593569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0c7cebc2-ad68-4f23-97ba-42145a855f1a" returned: 0 in 0.387s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:31:58 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-c7e8ef9c-221c-4568-ac21-e05a87bac8e7 tempest-VolumesCloneTest-1963593569 None] <== create_volume: return (1186ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:31:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-c7e8ef9c-221c-4568-ac21-e05a87bac8e7 tempest-VolumesCloneTest-1963593569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.190s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:31:58 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-c7e8ef9c-221c-4568-ac21-e05a87bac8e7 tempest-VolumesCloneTest-1963593569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d334d85-8ca3-4130-9747-b225f9cc93e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c7cebc2-ad68-4f23-97ba-42145a855f1a', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:31:58 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-c7e8ef9c-221c-4568-ac21-e05a87bac8e7 tempest-VolumesCloneTest-1963593569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9c15fa6-8e6e-4967-9560-3d79dfd1f0df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:31:59 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-c7e8ef9c-221c-4568-ac21-e05a87bac8e7 tempest-VolumesCloneTest-1963593569 None] Volume volume-0c7cebc2-ad68-4f23-97ba-42145a855f1a (0c7cebc2-ad68-4f23-97ba-42145a855f1a): created successfully
Jul 30 20:31:59 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-c7e8ef9c-221c-4568-ac21-e05a87bac8e7 tempest-VolumesCloneTest-1963593569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9c15fa6-8e6e-4967-9560-3d79dfd1f0df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:31:59 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-c7e8ef9c-221c-4568-ac21-e05a87bac8e7 tempest-VolumesCloneTest-1963593569 None] Flow 'volume_create_manager' (6dfb5545-ea9d-444c-9037-a3004c8bd0bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:31:59 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-c7e8ef9c-221c-4568-ac21-e05a87bac8e7 tempest-VolumesCloneTest-1963593569 None] Created volume successfully.
Jul 30 20:31:59 devstack sudo[99958]: pam_unix(sudo:session): session closed for user root
Jul 30 20:31:59 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f004d297-5f9c-46df-9afd-5f6b4bfdeaa6 tempest-VolumesGetTest-855358902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.402s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:31:59 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-f004d297-5f9c-46df-9afd-5f6b4bfdeaa6 tempest-VolumesGetTest-855358902 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:31:59 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-f004d297-5f9c-46df-9afd-5f6b4bfdeaa6 tempest-VolumesGetTest-855358902 None] Deleted volume successfully.
Jul 30 20:31:59 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-f004d297-5f9c-46df-9afd-5f6b4bfdeaa6 tempest-VolumesGetTest-855358902 None] Lock "cinder-88ab04e2-478e-4133-9bda-434bec875ca5-delete_volume" released by "delete_volume" :: held 1.723s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:31:59 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-041d4fee-158f-49ec-a892-90dd816c019a tempest-GroupsTest-1841966773 None] Group tempest-GroupsTest-Group-159510948: creating
Jul 30 20:31:59 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-041d4fee-158f-49ec-a892-90dd816c019a tempest-GroupsTest-1841966773 None] Group tempest-GroupsTest-Group-159510948: created successfully
Jul 30 20:31:59 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-041d4fee-158f-49ec-a892-90dd816c019a tempest-GroupsTest-1841966773 None] Create group completed successfully.
Jul 30 20:32:00 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-26202686-ad93-490a-8fd8-8994fe566e0f tempest-VolumesCloneTest-1963593569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:32:00 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-77618e3d-3aa5-4b53-96e8-3d4f1c6f6109 tempest-VolumesNegativeTest-881901340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:32:00 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-77618e3d-3aa5-4b53-96e8-3d4f1c6f6109 tempest-VolumesNegativeTest-881901340 None] Flow 'volume_create_manager' (5fd45680-cf27-45f7-8d5c-5d0f40bb4a0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:32:00 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-77618e3d-3aa5-4b53-96e8-3d4f1c6f6109 tempest-VolumesNegativeTest-881901340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b3b454c-eeb0-4f42-b9b8-822287c0d0c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:32:00 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-26202686-ad93-490a-8fd8-8994fe566e0f tempest-VolumesCloneTest-1963593569 None] Flow 'volume_create_manager' (860bb73a-410e-4839-85a8-ae5c5967ff5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:32:00 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-26202686-ad93-490a-8fd8-8994fe566e0f tempest-VolumesCloneTest-1963593569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba0a199d-36cc-418f-b6bb-cdaf7e943309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:32:00 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-77618e3d-3aa5-4b53-96e8-3d4f1c6f6109 tempest-VolumesNegativeTest-881901340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b3b454c-eeb0-4f42-b9b8-822287c0d0c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:32:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-2127144100',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c3759c8-976f-4dab-aec4-2e43449b6537,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e703c33ba2214e5cb79d4df011b67f84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:32:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:32:01Z,use_quota=True,user_id='48e0ff59ab4d4cafbdf486cd992bb348',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:32:00 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-77618e3d-3aa5-4b53-96e8-3d4f1c6f6109 tempest-VolumesNegativeTest-881901340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0121e68e-28dd-4946-a9e9-2f8b60b35f69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:32:00 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-77618e3d-3aa5-4b53-96e8-3d4f1c6f6109 tempest-VolumesNegativeTest-881901340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0121e68e-28dd-4946-a9e9-2f8b60b35f69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:32:00 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-77618e3d-3aa5-4b53-96e8-3d4f1c6f6109 tempest-VolumesNegativeTest-881901340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9acc3b3b-4e1d-4daf-bb4d-914c408c2603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:32:00 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-77618e3d-3aa5-4b53-96e8-3d4f1c6f6109 tempest-VolumesNegativeTest-881901340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9acc3b3b-4e1d-4daf-bb4d-914c408c2603) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c3759c8-976f-4dab-aec4-2e43449b6537', 'volume_name': 'volume-1c3759c8-976f-4dab-aec4-2e43449b6537', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:32:00 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-77618e3d-3aa5-4b53-96e8-3d4f1c6f6109 tempest-VolumesNegativeTest-881901340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af396007-b9e1-4f6e-81fd-527b2f7e24f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:32:00 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-77618e3d-3aa5-4b53-96e8-3d4f1c6f6109 tempest-VolumesNegativeTest-881901340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af396007-b9e1-4f6e-81fd-527b2f7e24f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:32:00 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-77618e3d-3aa5-4b53-96e8-3d4f1c6f6109 tempest-VolumesNegativeTest-881901340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae587a98-3116-4af7-8069-132f26feb473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:32:00 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-77618e3d-3aa5-4b53-96e8-3d4f1c6f6109 tempest-VolumesNegativeTest-881901340 None] Volume 1c3759c8-976f-4dab-aec4-2e43449b6537: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c3759c8-976f-4dab-aec4-2e43449b6537', 'volume_size': 1}
Jul 30 20:32:00 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-77618e3d-3aa5-4b53-96e8-3d4f1c6f6109 tempest-VolumesNegativeTest-881901340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:32:00 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-77618e3d-3aa5-4b53-96e8-3d4f1c6f6109 tempest-VolumesNegativeTest-881901340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:32:00 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-77618e3d-3aa5-4b53-96e8-3d4f1c6f6109 tempest-VolumesNegativeTest-881901340 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:32:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-2127144100',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c3759c8-976f-4dab-aec4-2e43449b6537,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e703c33ba2214e5cb79d4df011b67f84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:32:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:32:01Z,use_quota=True,user_id='48e0ff59ab4d4cafbdf486cd992bb348',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:32:00 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-77618e3d-3aa5-4b53-96e8-3d4f1c6f6109 tempest-VolumesNegativeTest-881901340 None] Creating volume 1c3759c8-976f-4dab-aec4-2e43449b6537 {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:32:00 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-77618e3d-3aa5-4b53-96e8-3d4f1c6f6109 tempest-VolumesNegativeTest-881901340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:32:00 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-77618e3d-3aa5-4b53-96e8-3d4f1c6f6109 tempest-VolumesNegativeTest-881901340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:32:00 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-77618e3d-3aa5-4b53-96e8-3d4f1c6f6109 tempest-VolumesNegativeTest-881901340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:32:00 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-77618e3d-3aa5-4b53-96e8-3d4f1c6f6109 tempest-VolumesNegativeTest-881901340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:32:00 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-77618e3d-3aa5-4b53-96e8-3d4f1c6f6109 tempest-VolumesNegativeTest-881901340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:32:00 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-77618e3d-3aa5-4b53-96e8-3d4f1c6f6109 tempest-VolumesNegativeTest-881901340 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:32:00 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-77618e3d-3aa5-4b53-96e8-3d4f1c6f6109 tempest-VolumesNegativeTest-881901340 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:32:00 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-77618e3d-3aa5-4b53-96e8-3d4f1c6f6109 tempest-VolumesNegativeTest-881901340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1c3759c8-976f-4dab-aec4-2e43449b6537 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:00 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-26202686-ad93-490a-8fd8-8994fe566e0f tempest-VolumesCloneTest-1963593569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba0a199d-36cc-418f-b6bb-cdaf7e943309) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:32:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-156078938',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd85b150-0d5f-462e-8c8f-50b15a595799,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63131686b405472abbd34180dd3136e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:32:00Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=0c7cebc2-ad68-4f23-97ba-42145a855f1a,status='creating',terminated_at=None,updated_at=2026-07-30T18:32:00Z,use_quota=True,user_id='86e12245e71f4f6e8731edbac02c295b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:32:00 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-26202686-ad93-490a-8fd8-8994fe566e0f tempest-VolumesCloneTest-1963593569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (030e567d-0e89-42a0-9685-eb3b0950a361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:32:00 devstack sudo[99967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1c3759c8-976f-4dab-aec4-2e43449b6537 1073741824
Jul 30 20:32:00 devstack sudo[99967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:00 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-26202686-ad93-490a-8fd8-8994fe566e0f tempest-VolumesCloneTest-1963593569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (030e567d-0e89-42a0-9685-eb3b0950a361) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:32:00 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-26202686-ad93-490a-8fd8-8994fe566e0f tempest-VolumesCloneTest-1963593569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9684baff-32ed-46ca-9c6d-a2d88db2b5be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:32:00 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-26202686-ad93-490a-8fd8-8994fe566e0f tempest-VolumesCloneTest-1963593569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9684baff-32ed-46ca-9c6d-a2d88db2b5be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'cd85b150-0d5f-462e-8c8f-50b15a595799', 'volume_name': 'volume-cd85b150-0d5f-462e-8c8f-50b15a595799', 'volume_size': 2, 'source_volid': '0c7cebc2-ad68-4f23-97ba-42145a855f1a', 'source_volstatus': 'available'}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:32:00 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-26202686-ad93-490a-8fd8-8994fe566e0f tempest-VolumesCloneTest-1963593569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d9cbb24-3436-4283-81c1-0f4761b66390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:32:00 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-26202686-ad93-490a-8fd8-8994fe566e0f tempest-VolumesCloneTest-1963593569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d9cbb24-3436-4283-81c1-0f4761b66390) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:32:00 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-26202686-ad93-490a-8fd8-8994fe566e0f tempest-VolumesCloneTest-1963593569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b8e5221-0ae3-4002-a7cb-55c08f53e44a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:32:00 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-26202686-ad93-490a-8fd8-8994fe566e0f tempest-VolumesCloneTest-1963593569 None] Volume cd85b150-0d5f-462e-8c8f-50b15a595799: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-cd85b150-0d5f-462e-8c8f-50b15a595799', 'volume_size': 2, 'source_volid': '0c7cebc2-ad68-4f23-97ba-42145a855f1a', 'source_volstatus': 'available'}
Jul 30 20:32:00 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-26202686-ad93-490a-8fd8-8994fe566e0f tempest-VolumesCloneTest-1963593569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:32:01 devstack sudo[99967]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:01 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-77618e3d-3aa5-4b53-96e8-3d4f1c6f6109 tempest-VolumesNegativeTest-881901340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1c3759c8-976f-4dab-aec4-2e43449b6537 1073741824" returned: 0 in 0.586s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:01 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-77618e3d-3aa5-4b53-96e8-3d4f1c6f6109 tempest-VolumesNegativeTest-881901340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1c3759c8-976f-4dab-aec4-2e43449b6537 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:01 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-304cb6ad-b027-46ce-9c17-87ada706e1d5 tempest-GroupsTest-1841966773 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:32:01 devstack sudo[99974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1c3759c8-976f-4dab-aec4-2e43449b6537
Jul 30 20:32:01 devstack sudo[99974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:01 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-304cb6ad-b027-46ce-9c17-87ada706e1d5 tempest-GroupsTest-1841966773 None] Flow 'volume_create_manager' (89f15145-6a11-411b-bb82-994600ef9fcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:32:01 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-304cb6ad-b027-46ce-9c17-87ada706e1d5 tempest-GroupsTest-1841966773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edba79f5-c05f-49a6-88df-78d58bb2a151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:32:01 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-304cb6ad-b027-46ce-9c17-87ada706e1d5 tempest-GroupsTest-1841966773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edba79f5-c05f-49a6-88df-78d58bb2a151) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:32:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-339931225',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=e333a04e-7191-452c-9f33-7eab72faec8a,host='devstack@QuobyteHD#QuobyteHD',id=c387843f-e689-4ded-8b1f-96842fe0ef79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90b795e9b25b4cac9c4d37257bc4ec62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:32:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:32:01Z,use_quota=True,user_id='f2f1c41ad4f148a982e054c3ba13b5ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f310336-9d64-4aa5-bf2a-bee4c407ae4b),volume_type_id=8f310336-9d64-4aa5-bf2a-bee4c407ae4b)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:32:01 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-304cb6ad-b027-46ce-9c17-87ada706e1d5 tempest-GroupsTest-1841966773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10589641-04e2-4529-bf82-e326c46ed118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:32:01 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-304cb6ad-b027-46ce-9c17-87ada706e1d5 tempest-GroupsTest-1841966773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10589641-04e2-4529-bf82-e326c46ed118) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:32:01 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-304cb6ad-b027-46ce-9c17-87ada706e1d5 tempest-GroupsTest-1841966773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9f0c0eb-e648-42fb-9760-dda22bb488f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:32:01 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-304cb6ad-b027-46ce-9c17-87ada706e1d5 tempest-GroupsTest-1841966773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9f0c0eb-e648-42fb-9760-dda22bb488f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c387843f-e689-4ded-8b1f-96842fe0ef79', 'volume_name': 'volume-c387843f-e689-4ded-8b1f-96842fe0ef79', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:32:01 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-304cb6ad-b027-46ce-9c17-87ada706e1d5 tempest-GroupsTest-1841966773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b5ede9e-3371-4692-8233-9c0fe16556c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:32:01 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-304cb6ad-b027-46ce-9c17-87ada706e1d5 tempest-GroupsTest-1841966773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b5ede9e-3371-4692-8233-9c0fe16556c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:32:01 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-304cb6ad-b027-46ce-9c17-87ada706e1d5 tempest-GroupsTest-1841966773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8587f172-83dc-4a21-b165-7c245425771a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:32:01 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-304cb6ad-b027-46ce-9c17-87ada706e1d5 tempest-GroupsTest-1841966773 None] Volume c387843f-e689-4ded-8b1f-96842fe0ef79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c387843f-e689-4ded-8b1f-96842fe0ef79', 'volume_size': 1}
Jul 30 20:32:01 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-304cb6ad-b027-46ce-9c17-87ada706e1d5 tempest-GroupsTest-1841966773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:32:01 devstack sudo[99974]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:01 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-77618e3d-3aa5-4b53-96e8-3d4f1c6f6109 tempest-VolumesNegativeTest-881901340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1c3759c8-976f-4dab-aec4-2e43449b6537" returned: 0 in 0.290s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:01 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-77618e3d-3aa5-4b53-96e8-3d4f1c6f6109 tempest-VolumesNegativeTest-881901340 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:32:01 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-77618e3d-3aa5-4b53-96e8-3d4f1c6f6109 tempest-VolumesNegativeTest-881901340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:32:01 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-26202686-ad93-490a-8fd8-8994fe566e0f tempest-VolumesCloneTest-1963593569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.841s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:32:01 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-26202686-ad93-490a-8fd8-8994fe566e0f tempest-VolumesCloneTest-1963593569 None] Cloning volume 0c7cebc2-ad68-4f23-97ba-42145a855f1a to volume cd85b150-0d5f-462e-8c8f-50b15a595799
Jul 30 20:32:01 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-77618e3d-3aa5-4b53-96e8-3d4f1c6f6109 tempest-VolumesNegativeTest-881901340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae587a98-3116-4af7-8069-132f26feb473) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c3759c8-976f-4dab-aec4-2e43449b6537', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:32:01 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-77618e3d-3aa5-4b53-96e8-3d4f1c6f6109 tempest-VolumesNegativeTest-881901340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddeaa3d9-1c40-4ee3-937b-fb3493042645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:32:01 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-26202686-ad93-490a-8fd8-8994fe566e0f tempest-VolumesCloneTest-1963593569 None] Creating offline snapshot 427ab785-3da4-4f0c-8477-eb98625c8347 of volume 0c7cebc2-ad68-4f23-97ba-42145a855f1a {{(pid=88719) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 30 20:32:01 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-77618e3d-3aa5-4b53-96e8-3d4f1c6f6109 tempest-VolumesNegativeTest-881901340 None] Volume volume-1c3759c8-976f-4dab-aec4-2e43449b6537 (1c3759c8-976f-4dab-aec4-2e43449b6537): created successfully
Jul 30 20:32:01 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-77618e3d-3aa5-4b53-96e8-3d4f1c6f6109 tempest-VolumesNegativeTest-881901340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddeaa3d9-1c40-4ee3-937b-fb3493042645) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:32:01 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-77618e3d-3aa5-4b53-96e8-3d4f1c6f6109 tempest-VolumesNegativeTest-881901340 None] Flow 'volume_create_manager' (5fd45680-cf27-45f7-8d5c-5d0f40bb4a0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:32:01 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a60ae95-8082-45cc-ad04-872dfbc67d13]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:32:01 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-26202686-ad93-490a-8fd8-8994fe566e0f tempest-VolumesCloneTest-1963593569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0c7cebc2-ad68-4f23-97ba-42145a855f1a {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:01 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-77618e3d-3aa5-4b53-96e8-3d4f1c6f6109 tempest-VolumesNegativeTest-881901340 None] Created volume successfully.
Jul 30 20:32:01 devstack sudo[99977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0c7cebc2-ad68-4f23-97ba-42145a855f1a
Jul 30 20:32:01 devstack sudo[99977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:02 devstack sudo[99977]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:02 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-26202686-ad93-490a-8fd8-8994fe566e0f tempest-VolumesCloneTest-1963593569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0c7cebc2-ad68-4f23-97ba-42145a855f1a" returned: 0 in 0.403s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:02 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-26202686-ad93-490a-8fd8-8994fe566e0f tempest-VolumesCloneTest-1963593569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0c7cebc2-ad68-4f23-97ba-42145a855f1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0c7cebc2-ad68-4f23-97ba-42145a855f1a.427ab785-3da4-4f0c-8477-eb98625c8347 1G {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:02 devstack sudo[99982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0c7cebc2-ad68-4f23-97ba-42145a855f1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0c7cebc2-ad68-4f23-97ba-42145a855f1a.427ab785-3da4-4f0c-8477-eb98625c8347 1G
Jul 30 20:32:02 devstack sudo[99982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:02 devstack sudo[99982]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:02 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-26202686-ad93-490a-8fd8-8994fe566e0f tempest-VolumesCloneTest-1963593569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0c7cebc2-ad68-4f23-97ba-42145a855f1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0c7cebc2-ad68-4f23-97ba-42145a855f1a.427ab785-3da4-4f0c-8477-eb98625c8347 1G" returned: 0 in 0.496s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:02 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-26202686-ad93-490a-8fd8-8994fe566e0f tempest-VolumesCloneTest-1963593569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c7cebc2-ad68-4f23-97ba-42145a855f1a -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0c7cebc2-ad68-4f23-97ba-42145a855f1a.427ab785-3da4-4f0c-8477-eb98625c8347 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:02 devstack sudo[99988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c7cebc2-ad68-4f23-97ba-42145a855f1a -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0c7cebc2-ad68-4f23-97ba-42145a855f1a.427ab785-3da4-4f0c-8477-eb98625c8347
Jul 30 20:32:02 devstack sudo[99988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:02 devstack sudo[99988]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:02 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-26202686-ad93-490a-8fd8-8994fe566e0f tempest-VolumesCloneTest-1963593569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c7cebc2-ad68-4f23-97ba-42145a855f1a -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0c7cebc2-ad68-4f23-97ba-42145a855f1a.427ab785-3da4-4f0c-8477-eb98625c8347" returned: 0 in 0.340s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:02 devstack cinder-volume[88719]: WARNING cinder.volume.drivers.remotefs [None req-26202686-ad93-490a-8fd8-8994fe566e0f tempest-VolumesCloneTest-1963593569 None] /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0c7cebc2-ad68-4f23-97ba-42145a855f1a.427ab785-3da4-4f0c-8477-eb98625c8347 is being set with open permissions: ugo+rw
Jul 30 20:32:02 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-26202686-ad93-490a-8fd8-8994fe566e0f tempest-VolumesCloneTest-1963593569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0c7cebc2-ad68-4f23-97ba-42145a855f1a.427ab785-3da4-4f0c-8477-eb98625c8347 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:02 devstack sudo[99993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0c7cebc2-ad68-4f23-97ba-42145a855f1a.427ab785-3da4-4f0c-8477-eb98625c8347
Jul 30 20:32:03 devstack sudo[99993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:03 devstack sudo[99993]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:03 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-26202686-ad93-490a-8fd8-8994fe566e0f tempest-VolumesCloneTest-1963593569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0c7cebc2-ad68-4f23-97ba-42145a855f1a.427ab785-3da4-4f0c-8477-eb98625c8347" returned: 0 in 0.325s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:03 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-26202686-ad93-490a-8fd8-8994fe566e0f tempest-VolumesCloneTest-1963593569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0c7cebc2-ad68-4f23-97ba-42145a855f1a.info {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:03 devstack sudo[99999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0c7cebc2-ad68-4f23-97ba-42145a855f1a.info
Jul 30 20:32:03 devstack sudo[99999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:03 devstack sudo[99999]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:03 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-26202686-ad93-490a-8fd8-8994fe566e0f tempest-VolumesCloneTest-1963593569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0c7cebc2-ad68-4f23-97ba-42145a855f1a.info" returned: 0 in 0.375s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:03 devstack cinder-volume[88719]: WARNING cinder.volume.drivers.remotefs [None req-26202686-ad93-490a-8fd8-8994fe566e0f tempest-VolumesCloneTest-1963593569 None] /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0c7cebc2-ad68-4f23-97ba-42145a855f1a.info is being set with open permissions: ugo+rw
Jul 30 20:32:03 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-26202686-ad93-490a-8fd8-8994fe566e0f tempest-VolumesCloneTest-1963593569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0c7cebc2-ad68-4f23-97ba-42145a855f1a.info {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:03 devstack sudo[100002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0c7cebc2-ad68-4f23-97ba-42145a855f1a.info
Jul 30 20:32:03 devstack sudo[100002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:04 devstack sudo[100002]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:04 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-26202686-ad93-490a-8fd8-8994fe566e0f tempest-VolumesCloneTest-1963593569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0c7cebc2-ad68-4f23-97ba-42145a855f1a.info" returned: 0 in 0.344s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:04 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-26202686-ad93-490a-8fd8-8994fe566e0f tempest-VolumesCloneTest-1963593569 None] Acquiring lock "cinder-quobyte-cd85b150-0d5f-462e-8c8f-50b15a595799" by "_copy_volume_from_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:32:04 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-26202686-ad93-490a-8fd8-8994fe566e0f tempest-VolumesCloneTest-1963593569 None] Lock "cinder-quobyte-cd85b150-0d5f-462e-8c8f-50b15a595799" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:32:04 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-26202686-ad93-490a-8fd8-8994fe566e0f tempest-VolumesCloneTest-1963593569 None] snapshot: 427ab785-3da4-4f0c-8477-eb98625c8347, volume: cd85b150-0d5f-462e-8c8f-50b15a595799,  {{(pid=88719) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}}
Jul 30 20:32:04 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-26202686-ad93-490a-8fd8-8994fe566e0f tempest-VolumesCloneTest-1963593569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:32:04 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-26202686-ad93-490a-8fd8-8994fe566e0f tempest-VolumesCloneTest-1963593569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:32:04 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-26202686-ad93-490a-8fd8-8994fe566e0f tempest-VolumesCloneTest-1963593569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:32:04 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-26202686-ad93-490a-8fd8-8994fe566e0f tempest-VolumesCloneTest-1963593569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:32:04 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-26202686-ad93-490a-8fd8-8994fe566e0f tempest-VolumesCloneTest-1963593569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:32:04 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[b74ae510-42d2-4666-b30e-227697e1662b]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:32:04 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-26202686-ad93-490a-8fd8-8994fe566e0f tempest-VolumesCloneTest-1963593569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0c7cebc2-ad68-4f23-97ba-42145a855f1a.427ab785-3da4-4f0c-8477-eb98625c8347 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:04 devstack sudo[100005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0c7cebc2-ad68-4f23-97ba-42145a855f1a.427ab785-3da4-4f0c-8477-eb98625c8347
Jul 30 20:32:04 devstack sudo[100005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:04 devstack sudo[100005]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:04 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-26202686-ad93-490a-8fd8-8994fe566e0f tempest-VolumesCloneTest-1963593569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0c7cebc2-ad68-4f23-97ba-42145a855f1a.427ab785-3da4-4f0c-8477-eb98625c8347" returned: 0 in 0.512s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:04 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-26202686-ad93-490a-8fd8-8994fe566e0f tempest-VolumesCloneTest-1963593569 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0c7cebc2-ad68-4f23-97ba-42145a855f1a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88719) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 30 20:32:04 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3b84789-998c-40e1-9062-2025d0f5c08c]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:32:04 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-26202686-ad93-490a-8fd8-8994fe566e0f tempest-VolumesCloneTest-1963593569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0c7cebc2-ad68-4f23-97ba-42145a855f1a {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:04 devstack sudo[100011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0c7cebc2-ad68-4f23-97ba-42145a855f1a
Jul 30 20:32:04 devstack sudo[100011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:05 devstack sudo[100011]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:05 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-26202686-ad93-490a-8fd8-8994fe566e0f tempest-VolumesCloneTest-1963593569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0c7cebc2-ad68-4f23-97ba-42145a855f1a" returned: 0 in 0.449s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:05 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-26202686-ad93-490a-8fd8-8994fe566e0f tempest-VolumesCloneTest-1963593569 None] will copy from snapshot at /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0c7cebc2-ad68-4f23-97ba-42145a855f1a {{(pid=88719) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}}
Jul 30 20:32:05 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-26202686-ad93-490a-8fd8-8994fe566e0f tempest-VolumesCloneTest-1963593569 None] Creating direct copy from snapshot {{(pid=88719) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}}
Jul 30 20:32:05 devstack cinder-volume[88719]: DEBUG cinder.utils [None req-26202686-ad93-490a-8fd8-8994fe566e0f tempest-VolumesCloneTest-1963593569 None] Path /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-cd85b150-0d5f-462e-8c8f-50b15a595799 not found in is_blk_device check {{(pid=88719) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 30 20:32:05 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-26202686-ad93-490a-8fd8-8994fe566e0f tempest-VolumesCloneTest-1963593569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0c7cebc2-ad68-4f23-97ba-42145a855f1a /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-cd85b150-0d5f-462e-8c8f-50b15a595799 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:05 devstack sudo[100017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0c7cebc2-ad68-4f23-97ba-42145a855f1a /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-cd85b150-0d5f-462e-8c8f-50b15a595799
Jul 30 20:32:05 devstack sudo[100017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:11 devstack sudo[100017]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:11 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-26202686-ad93-490a-8fd8-8994fe566e0f tempest-VolumesCloneTest-1963593569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0c7cebc2-ad68-4f23-97ba-42145a855f1a /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-cd85b150-0d5f-462e-8c8f-50b15a595799" returned: 0 in 6.034s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:11 devstack cinder-volume[88719]: DEBUG cinder.image.image_utils [None req-26202686-ad93-490a-8fd8-8994fe566e0f tempest-VolumesCloneTest-1963593569 None] Image conversion details: src /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0c7cebc2-ad68-4f23-97ba-42145a855f1a, size 1024.00 MB, duration 6.04 sec, destination /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-cd85b150-0d5f-462e-8c8f-50b15a595799 {{(pid=88719) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 30 20:32:11 devstack cinder-volume[88719]: INFO cinder.image.image_utils [None req-26202686-ad93-490a-8fd8-8994fe566e0f tempest-VolumesCloneTest-1963593569 None] Converted 1024.00 MB image at 169.66 MB/s
Jul 30 20:32:11 devstack cinder-volume[88719]: WARNING cinder.volume.drivers.remotefs [None req-26202686-ad93-490a-8fd8-8994fe566e0f tempest-VolumesCloneTest-1963593569 None] /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-cd85b150-0d5f-462e-8c8f-50b15a595799 is being set with open permissions: ugo+rw
Jul 30 20:32:11 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-26202686-ad93-490a-8fd8-8994fe566e0f tempest-VolumesCloneTest-1963593569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-cd85b150-0d5f-462e-8c8f-50b15a595799 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:11 devstack sudo[100053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-cd85b150-0d5f-462e-8c8f-50b15a595799
Jul 30 20:32:11 devstack sudo[100053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:11 devstack sudo[100053]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:11 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-26202686-ad93-490a-8fd8-8994fe566e0f tempest-VolumesCloneTest-1963593569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-cd85b150-0d5f-462e-8c8f-50b15a595799" returned: 0 in 0.330s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:11 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-26202686-ad93-490a-8fd8-8994fe566e0f tempest-VolumesCloneTest-1963593569 None] Lock "cinder-quobyte-cd85b150-0d5f-462e-8c8f-50b15a595799" released by "_copy_volume_from_snapshot" :: held 7.446s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:32:11 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-26202686-ad93-490a-8fd8-8994fe566e0f tempest-VolumesCloneTest-1963593569 None] Acquiring lock "cinder-quobyte-427ab785-3da4-4f0c-8477-eb98625c8347" by "_delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:32:11 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-26202686-ad93-490a-8fd8-8994fe566e0f tempest-VolumesCloneTest-1963593569 None] Lock "cinder-quobyte-427ab785-3da4-4f0c-8477-eb98625c8347" acquired by "_delete_snapshot" :: waited 0.060s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:32:11 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-26202686-ad93-490a-8fd8-8994fe566e0f tempest-VolumesCloneTest-1963593569 None] Deleting offline snapshot 427ab785-3da4-4f0c-8477-eb98625c8347 of volume 0c7cebc2-ad68-4f23-97ba-42145a855f1a {{(pid=88719) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 30 20:32:11 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-26202686-ad93-490a-8fd8-8994fe566e0f tempest-VolumesCloneTest-1963593569 None] snapshot_file for this snap is: volume-0c7cebc2-ad68-4f23-97ba-42145a855f1a.427ab785-3da4-4f0c-8477-eb98625c8347 {{(pid=88719) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 30 20:32:11 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc579e37-a842-408f-b172-7ff80160557e]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:32:11 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-26202686-ad93-490a-8fd8-8994fe566e0f tempest-VolumesCloneTest-1963593569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0c7cebc2-ad68-4f23-97ba-42145a855f1a.427ab785-3da4-4f0c-8477-eb98625c8347 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:11 devstack sudo[100070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0c7cebc2-ad68-4f23-97ba-42145a855f1a.427ab785-3da4-4f0c-8477-eb98625c8347
Jul 30 20:32:11 devstack sudo[100070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:12 devstack sudo[100070]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:12 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-26202686-ad93-490a-8fd8-8994fe566e0f tempest-VolumesCloneTest-1963593569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0c7cebc2-ad68-4f23-97ba-42145a855f1a.427ab785-3da4-4f0c-8477-eb98625c8347" returned: 0 in 0.707s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:12 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-26202686-ad93-490a-8fd8-8994fe566e0f tempest-VolumesCloneTest-1963593569 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0c7cebc2-ad68-4f23-97ba-42145a855f1a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88719) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 30 20:32:12 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[82bfd8b8-1c46-4a99-9b05-cdc6ed161fef]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:32:12 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-26202686-ad93-490a-8fd8-8994fe566e0f tempest-VolumesCloneTest-1963593569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0c7cebc2-ad68-4f23-97ba-42145a855f1a {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:12 devstack sudo[100108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0c7cebc2-ad68-4f23-97ba-42145a855f1a
Jul 30 20:32:12 devstack sudo[100108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:13 devstack cinder-volume[88719]: DEBUG dbcounter [-] [88719] Writing DB stats cinder:SELECT=108,cinder:UPDATE=125,cinder:DELETE=10,cinder:INSERT=33 {{(pid=88719) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 30 20:32:13 devstack sudo[100108]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:13 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-26202686-ad93-490a-8fd8-8994fe566e0f tempest-VolumesCloneTest-1963593569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0c7cebc2-ad68-4f23-97ba-42145a855f1a" returned: 0 in 0.904s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:13 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-26202686-ad93-490a-8fd8-8994fe566e0f tempest-VolumesCloneTest-1963593569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0c7cebc2-ad68-4f23-97ba-42145a855f1a.427ab785-3da4-4f0c-8477-eb98625c8347 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:13 devstack sudo[100146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0c7cebc2-ad68-4f23-97ba-42145a855f1a.427ab785-3da4-4f0c-8477-eb98625c8347
Jul 30 20:32:13 devstack sudo[100146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:13 devstack sudo[100146]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:13 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-26202686-ad93-490a-8fd8-8994fe566e0f tempest-VolumesCloneTest-1963593569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0c7cebc2-ad68-4f23-97ba-42145a855f1a.427ab785-3da4-4f0c-8477-eb98625c8347" returned: 0 in 0.571s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:13 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-26202686-ad93-490a-8fd8-8994fe566e0f tempest-VolumesCloneTest-1963593569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0c7cebc2-ad68-4f23-97ba-42145a855f1a.427ab785-3da4-4f0c-8477-eb98625c8347 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:14 devstack sudo[100151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0c7cebc2-ad68-4f23-97ba-42145a855f1a.427ab785-3da4-4f0c-8477-eb98625c8347
Jul 30 20:32:14 devstack sudo[100151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:14 devstack sudo[100151]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:14 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-26202686-ad93-490a-8fd8-8994fe566e0f tempest-VolumesCloneTest-1963593569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0c7cebc2-ad68-4f23-97ba-42145a855f1a.427ab785-3da4-4f0c-8477-eb98625c8347" returned: 0 in 0.405s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:14 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-26202686-ad93-490a-8fd8-8994fe566e0f tempest-VolumesCloneTest-1963593569 None] Lock "cinder-quobyte-427ab785-3da4-4f0c-8477-eb98625c8347" released by "_delete_snapshot" :: held 2.801s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:32:14 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-26202686-ad93-490a-8fd8-8994fe566e0f tempest-VolumesCloneTest-1963593569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.950s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:32:14 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-304cb6ad-b027-46ce-9c17-87ada706e1d5 tempest-GroupsTest-1841966773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.108s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:32:14 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-304cb6ad-b027-46ce-9c17-87ada706e1d5 tempest-GroupsTest-1841966773 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=e333a04e-7191-452c-9f33-7eab72faec8a,created_at=2026-07-30T18:32:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-339931225',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=e333a04e-7191-452c-9f33-7eab72faec8a,host='devstack@QuobyteHD#QuobyteHD',id=c387843f-e689-4ded-8b1f-96842fe0ef79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90b795e9b25b4cac9c4d37257bc4ec62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:32:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:32:01Z,use_quota=True,user_id='f2f1c41ad4f148a982e054c3ba13b5ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f310336-9d64-4aa5-bf2a-bee4c407ae4b),volume_type_id=8f310336-9d64-4aa5-bf2a-bee4c407ae4b)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:32:14 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-304cb6ad-b027-46ce-9c17-87ada706e1d5 tempest-GroupsTest-1841966773 None] Creating volume c387843f-e689-4ded-8b1f-96842fe0ef79 {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:32:14 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-304cb6ad-b027-46ce-9c17-87ada706e1d5 tempest-GroupsTest-1841966773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:32:14 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-304cb6ad-b027-46ce-9c17-87ada706e1d5 tempest-GroupsTest-1841966773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:32:14 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-304cb6ad-b027-46ce-9c17-87ada706e1d5 tempest-GroupsTest-1841966773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:32:14 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-304cb6ad-b027-46ce-9c17-87ada706e1d5 tempest-GroupsTest-1841966773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:32:14 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-304cb6ad-b027-46ce-9c17-87ada706e1d5 tempest-GroupsTest-1841966773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:32:14 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-304cb6ad-b027-46ce-9c17-87ada706e1d5 tempest-GroupsTest-1841966773 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:32:14 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-304cb6ad-b027-46ce-9c17-87ada706e1d5 tempest-GroupsTest-1841966773 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:32:14 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-304cb6ad-b027-46ce-9c17-87ada706e1d5 tempest-GroupsTest-1841966773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c387843f-e689-4ded-8b1f-96842fe0ef79 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:14 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-26202686-ad93-490a-8fd8-8994fe566e0f tempest-VolumesCloneTest-1963593569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b8e5221-0ae3-4002-a7cb-55c08f53e44a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd85b150-0d5f-462e-8c8f-50b15a595799', 'volume_size': 2, 'source_volid': '0c7cebc2-ad68-4f23-97ba-42145a855f1a', 'source_volstatus': 'available'}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:32:14 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-26202686-ad93-490a-8fd8-8994fe566e0f tempest-VolumesCloneTest-1963593569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74f2ce00-088d-48c1-86ea-317a04695281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:32:14 devstack sudo[100158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c387843f-e689-4ded-8b1f-96842fe0ef79 1073741824
Jul 30 20:32:14 devstack sudo[100158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:14 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-26202686-ad93-490a-8fd8-8994fe566e0f tempest-VolumesCloneTest-1963593569 None] Volume volume-cd85b150-0d5f-462e-8c8f-50b15a595799 (cd85b150-0d5f-462e-8c8f-50b15a595799): created successfully
Jul 30 20:32:14 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-26202686-ad93-490a-8fd8-8994fe566e0f tempest-VolumesCloneTest-1963593569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74f2ce00-088d-48c1-86ea-317a04695281) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:32:14 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-26202686-ad93-490a-8fd8-8994fe566e0f tempest-VolumesCloneTest-1963593569 None] Flow 'volume_create_manager' (860bb73a-410e-4839-85a8-ae5c5967ff5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:32:14 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-26202686-ad93-490a-8fd8-8994fe566e0f tempest-VolumesCloneTest-1963593569 None] Created volume successfully.
Jul 30 20:32:15 devstack sudo[100158]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:15 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-304cb6ad-b027-46ce-9c17-87ada706e1d5 tempest-GroupsTest-1841966773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c387843f-e689-4ded-8b1f-96842fe0ef79 1073741824" returned: 0 in 0.920s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:15 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-304cb6ad-b027-46ce-9c17-87ada706e1d5 tempest-GroupsTest-1841966773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c387843f-e689-4ded-8b1f-96842fe0ef79 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:15 devstack sudo[100164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c387843f-e689-4ded-8b1f-96842fe0ef79
Jul 30 20:32:15 devstack sudo[100164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:16 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-3b9462fb-0d13-4da6-abde-8a2cb241cd23 tempest-VolumesCloneTest-1963593569 None] Acquiring lock "cinder-cd85b150-0d5f-462e-8c8f-50b15a595799-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:32:16 devstack sudo[100164]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-304cb6ad-b027-46ce-9c17-87ada706e1d5 tempest-GroupsTest-1841966773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c387843f-e689-4ded-8b1f-96842fe0ef79" returned: 0 in 0.595s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:16 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-304cb6ad-b027-46ce-9c17-87ada706e1d5 tempest-GroupsTest-1841966773 None] <== create_volume: return (1603ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:32:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-304cb6ad-b027-46ce-9c17-87ada706e1d5 tempest-GroupsTest-1841966773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.615s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:32:16 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-304cb6ad-b027-46ce-9c17-87ada706e1d5 tempest-GroupsTest-1841966773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8587f172-83dc-4a21-b165-7c245425771a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c387843f-e689-4ded-8b1f-96842fe0ef79', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:32:16 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-304cb6ad-b027-46ce-9c17-87ada706e1d5 tempest-GroupsTest-1841966773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (484c1669-148d-4a05-8326-3a3b1c0521d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:32:16 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-3b9462fb-0d13-4da6-abde-8a2cb241cd23 tempest-VolumesCloneTest-1963593569 None] Lock "cinder-cd85b150-0d5f-462e-8c8f-50b15a595799-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:32:16 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-304cb6ad-b027-46ce-9c17-87ada706e1d5 tempest-GroupsTest-1841966773 None] Volume volume-c387843f-e689-4ded-8b1f-96842fe0ef79 (c387843f-e689-4ded-8b1f-96842fe0ef79): created successfully
Jul 30 20:32:16 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-304cb6ad-b027-46ce-9c17-87ada706e1d5 tempest-GroupsTest-1841966773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (484c1669-148d-4a05-8326-3a3b1c0521d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:32:16 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-304cb6ad-b027-46ce-9c17-87ada706e1d5 tempest-GroupsTest-1841966773 None] Flow 'volume_create_manager' (89f15145-6a11-411b-bb82-994600ef9fcb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:32:16 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-304cb6ad-b027-46ce-9c17-87ada706e1d5 tempest-GroupsTest-1841966773 None] Created volume successfully.
Jul 30 20:32:16 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-3b9462fb-0d13-4da6-abde-8a2cb241cd23 tempest-VolumesCloneTest-1963593569 None] Acquiring lock "cinder-quobyte-cd85b150-0d5f-462e-8c8f-50b15a595799" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:32:16 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-3b9462fb-0d13-4da6-abde-8a2cb241cd23 tempest-VolumesCloneTest-1963593569 None] Lock "cinder-quobyte-cd85b150-0d5f-462e-8c8f-50b15a595799" acquired by "delete_volume" :: waited 0.026s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:32:16 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ea5fad-4c5d-493a-9128-117ebb55d57f]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:32:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3b9462fb-0d13-4da6-abde-8a2cb241cd23 tempest-VolumesCloneTest-1963593569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-cd85b150-0d5f-462e-8c8f-50b15a595799 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:16 devstack cinder-volume[88719]: DEBUG oslo_service.periodic_task [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88719) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 30 20:32:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:32:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:32:16 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:32:16 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:32:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:32:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:16 devstack sudo[100168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:32:16 devstack sudo[100168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:16 devstack sudo[100167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-cd85b150-0d5f-462e-8c8f-50b15a595799
Jul 30 20:32:16 devstack sudo[100167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:17 devstack sudo[100168]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:17 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.658s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:17 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:32:17 devstack cinder-volume[88719]: DEBUG oslo_service.periodic_task [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Running periodic task VolumeManager._thread_info {{(pid=88719) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 30 20:32:17 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] thread count: 28 {{(pid=88719) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 30 20:32:17 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] thread info: [<_MainThread(MainThread, started 132390416908416)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132390306497536)>, <Thread(Thread-3 (stat_writer), started daemon 132390304471680)>, <Thread(Rabbit-heartbeat, started daemon 132390303393408)>, <Thread(Thread-5 (_runner), started daemon 132390303543168)>, <Thread(Thread-7 (_runner), started daemon 132390303563392)>, <Thread(fd_logger, started daemon 132390301344640)>, <Thread(privsep_reader, started daemon 132390301560640)>, <Thread(tpool_thread_0, started daemon 132390291470016)>, <Thread(tpool_thread_1, started daemon 132390283077312)>, <Thread(tpool_thread_2, started daemon 132390274684608)>, <Thread(tpool_thread_3, started daemon 132390266291904)>, <Thread(tpool_thread_4, started daemon 132390257899200)>, <Thread(tpool_thread_5, started daemon 132390249506496)>, <Thread(tpool_thread_6, started daemon 132390241113792)>, <Thread(tpool_thread_7, started daemon 132390232721088)>, <Thread(tpool_thread_8, started daemon 132390224328384)>, <Thread(tpool_thread_9, started daemon 132390215919296)>, <Thread(tpool_thread_10, started daemon 132390207510208)>, <Thread(tpool_thread_11, started daemon 132390199101120)>, <Thread(tpool_thread_12, started daemon 132390190692032)>, <Thread(tpool_thread_13, started daemon 132390182282944)>, <Thread(tpool_thread_14, started daemon 132390173873856)>, <Thread(tpool_thread_15, started daemon 132390165464768)>, <Thread(tpool_thread_16, started daemon 132390157055680)>, <Thread(tpool_thread_17, started daemon 132390148646592)>, <Thread(tpool_thread_18, started daemon 132390140237504)>, <Thread(tpool_thread_19, started daemon 132390131828416)>] {{(pid=88719) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 30 20:32:17 devstack sudo[100167]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:17 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3b9462fb-0d13-4da6-abde-8a2cb241cd23 tempest-VolumesCloneTest-1963593569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-cd85b150-0d5f-462e-8c8f-50b15a595799" returned: 0 in 0.870s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:17 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3b9462fb-0d13-4da6-abde-8a2cb241cd23 tempest-VolumesCloneTest-1963593569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-cd85b150-0d5f-462e-8c8f-50b15a595799 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:17 devstack sudo[100176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-cd85b150-0d5f-462e-8c8f-50b15a595799
Jul 30 20:32:17 devstack sudo[100176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:17 devstack sudo[100176]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:17 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3b9462fb-0d13-4da6-abde-8a2cb241cd23 tempest-VolumesCloneTest-1963593569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-cd85b150-0d5f-462e-8c8f-50b15a595799" returned: 0 in 0.510s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:17 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-3b9462fb-0d13-4da6-abde-8a2cb241cd23 tempest-VolumesCloneTest-1963593569 None] Lock "cinder-quobyte-cd85b150-0d5f-462e-8c8f-50b15a595799" released by "delete_volume" :: held 1.469s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:32:18 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-3b9462fb-0d13-4da6-abde-8a2cb241cd23 tempest-VolumesCloneTest-1963593569 None] Created reservations ['71cb58c0-571c-4cb4-a04f-5b6d20e1abd1', '64f16ea1-3335-4542-9a5d-7f1bba33c65b', '65aa846f-3147-4fb6-b869-d3cbbab02bbe', '119ac314-df6a-457e-9903-1d81b4eb8088'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:32:18 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-3b9462fb-0d13-4da6-abde-8a2cb241cd23 tempest-VolumesCloneTest-1963593569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:32:18 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-3b9462fb-0d13-4da6-abde-8a2cb241cd23 tempest-VolumesCloneTest-1963593569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:32:18 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-3b9462fb-0d13-4da6-abde-8a2cb241cd23 tempest-VolumesCloneTest-1963593569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:32:18 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-3b9462fb-0d13-4da6-abde-8a2cb241cd23 tempest-VolumesCloneTest-1963593569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:32:18 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-3b9462fb-0d13-4da6-abde-8a2cb241cd23 tempest-VolumesCloneTest-1963593569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:32:18 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3b9462fb-0d13-4da6-abde-8a2cb241cd23 tempest-VolumesCloneTest-1963593569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:18 devstack sudo[100203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:32:18 devstack sudo[100203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:18 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-c86e8305-6b94-4203-8e2c-6b698618a560 tempest-GroupsTest-1841966773 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:32:18 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-c86e8305-6b94-4203-8e2c-6b698618a560 tempest-GroupsTest-1841966773 None] Flow 'volume_create_manager' (e5820622-d9ed-474f-bba6-8f2d49892d49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:32:18 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-c86e8305-6b94-4203-8e2c-6b698618a560 tempest-GroupsTest-1841966773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3be7928d-cfd1-447b-981a-e9b85afa35b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:32:18 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-c86e8305-6b94-4203-8e2c-6b698618a560 tempest-GroupsTest-1841966773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3be7928d-cfd1-447b-981a-e9b85afa35b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:32:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1779787588',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=e333a04e-7191-452c-9f33-7eab72faec8a,host='devstack@QuobyteHD#QuobyteHD',id=bd071bc6-647a-4c79-a412-797b8bdae8fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90b795e9b25b4cac9c4d37257bc4ec62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:32:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:32:18Z,use_quota=True,user_id='f2f1c41ad4f148a982e054c3ba13b5ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f310336-9d64-4aa5-bf2a-bee4c407ae4b),volume_type_id=8f310336-9d64-4aa5-bf2a-bee4c407ae4b)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:32:18 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-c86e8305-6b94-4203-8e2c-6b698618a560 tempest-GroupsTest-1841966773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d36f9d1-e459-41f7-beee-074ad62b6518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:32:18 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-c86e8305-6b94-4203-8e2c-6b698618a560 tempest-GroupsTest-1841966773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d36f9d1-e459-41f7-beee-074ad62b6518) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:32:18 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-c86e8305-6b94-4203-8e2c-6b698618a560 tempest-GroupsTest-1841966773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (198b9e8f-b13b-47b0-a3fb-c8818ad435d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:32:18 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-c86e8305-6b94-4203-8e2c-6b698618a560 tempest-GroupsTest-1841966773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (198b9e8f-b13b-47b0-a3fb-c8818ad435d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd071bc6-647a-4c79-a412-797b8bdae8fe', 'volume_name': 'volume-bd071bc6-647a-4c79-a412-797b8bdae8fe', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:32:18 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-c86e8305-6b94-4203-8e2c-6b698618a560 tempest-GroupsTest-1841966773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70b69fed-e34b-41af-8ea3-4017ce410235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:32:18 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-c86e8305-6b94-4203-8e2c-6b698618a560 tempest-GroupsTest-1841966773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70b69fed-e34b-41af-8ea3-4017ce410235) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:32:18 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-c86e8305-6b94-4203-8e2c-6b698618a560 tempest-GroupsTest-1841966773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b7358da-024d-4b4b-9be3-db169fff6e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:32:18 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-c86e8305-6b94-4203-8e2c-6b698618a560 tempest-GroupsTest-1841966773 None] Volume bd071bc6-647a-4c79-a412-797b8bdae8fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd071bc6-647a-4c79-a412-797b8bdae8fe', 'volume_size': 1}
Jul 30 20:32:18 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-c86e8305-6b94-4203-8e2c-6b698618a560 tempest-GroupsTest-1841966773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:32:18 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-c86e8305-6b94-4203-8e2c-6b698618a560 tempest-GroupsTest-1841966773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:32:18 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-c86e8305-6b94-4203-8e2c-6b698618a560 tempest-GroupsTest-1841966773 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=e333a04e-7191-452c-9f33-7eab72faec8a,created_at=2026-07-30T18:32:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1779787588',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=e333a04e-7191-452c-9f33-7eab72faec8a,host='devstack@QuobyteHD#QuobyteHD',id=bd071bc6-647a-4c79-a412-797b8bdae8fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90b795e9b25b4cac9c4d37257bc4ec62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:32:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:32:18Z,use_quota=True,user_id='f2f1c41ad4f148a982e054c3ba13b5ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f310336-9d64-4aa5-bf2a-bee4c407ae4b),volume_type_id=8f310336-9d64-4aa5-bf2a-bee4c407ae4b)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:32:18 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-c86e8305-6b94-4203-8e2c-6b698618a560 tempest-GroupsTest-1841966773 None] Creating volume bd071bc6-647a-4c79-a412-797b8bdae8fe {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:32:18 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-c86e8305-6b94-4203-8e2c-6b698618a560 tempest-GroupsTest-1841966773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:32:18 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-c86e8305-6b94-4203-8e2c-6b698618a560 tempest-GroupsTest-1841966773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:32:18 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-c86e8305-6b94-4203-8e2c-6b698618a560 tempest-GroupsTest-1841966773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:32:18 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-c86e8305-6b94-4203-8e2c-6b698618a560 tempest-GroupsTest-1841966773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:32:18 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-c86e8305-6b94-4203-8e2c-6b698618a560 tempest-GroupsTest-1841966773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:32:18 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-c86e8305-6b94-4203-8e2c-6b698618a560 tempest-GroupsTest-1841966773 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:32:18 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-c86e8305-6b94-4203-8e2c-6b698618a560 tempest-GroupsTest-1841966773 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:32:18 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-c86e8305-6b94-4203-8e2c-6b698618a560 tempest-GroupsTest-1841966773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-bd071bc6-647a-4c79-a412-797b8bdae8fe 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:18 devstack sudo[100205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-bd071bc6-647a-4c79-a412-797b8bdae8fe 1073741824
Jul 30 20:32:18 devstack sudo[100205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:18 devstack sudo[100203]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:18 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3b9462fb-0d13-4da6-abde-8a2cb241cd23 tempest-VolumesCloneTest-1963593569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.438s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:18 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-3b9462fb-0d13-4da6-abde-8a2cb241cd23 tempest-VolumesCloneTest-1963593569 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:32:18 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-3b9462fb-0d13-4da6-abde-8a2cb241cd23 tempest-VolumesCloneTest-1963593569 None] Deleted volume successfully.
Jul 30 20:32:18 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-cebbf3a2-259a-435c-be2e-411306802aef tempest-VolumesCloneTest-1963593569 None] Acquiring lock "cinder-0c7cebc2-ad68-4f23-97ba-42145a855f1a-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:32:18 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-cebbf3a2-259a-435c-be2e-411306802aef tempest-VolumesCloneTest-1963593569 None] Lock "cinder-0c7cebc2-ad68-4f23-97ba-42145a855f1a-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:32:18 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-3b9462fb-0d13-4da6-abde-8a2cb241cd23 tempest-VolumesCloneTest-1963593569 None] Lock "cinder-cd85b150-0d5f-462e-8c8f-50b15a595799-delete_volume" released by "delete_volume" :: held 2.494s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:32:18 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-cebbf3a2-259a-435c-be2e-411306802aef tempest-VolumesCloneTest-1963593569 None] Acquiring lock "cinder-quobyte-0c7cebc2-ad68-4f23-97ba-42145a855f1a" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:32:18 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-cebbf3a2-259a-435c-be2e-411306802aef tempest-VolumesCloneTest-1963593569 None] Lock "cinder-quobyte-0c7cebc2-ad68-4f23-97ba-42145a855f1a" acquired by "delete_volume" :: waited 0.027s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:32:18 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[08584457-fbc4-4177-969a-fcffe6ca4a74]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:32:18 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-cebbf3a2-259a-435c-be2e-411306802aef tempest-VolumesCloneTest-1963593569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0c7cebc2-ad68-4f23-97ba-42145a855f1a {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:19 devstack sudo[100211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0c7cebc2-ad68-4f23-97ba-42145a855f1a
Jul 30 20:32:19 devstack sudo[100211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:19 devstack sudo[100205]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:19 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-c86e8305-6b94-4203-8e2c-6b698618a560 tempest-GroupsTest-1841966773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-bd071bc6-647a-4c79-a412-797b8bdae8fe 1073741824" returned: 0 in 0.679s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:19 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-c86e8305-6b94-4203-8e2c-6b698618a560 tempest-GroupsTest-1841966773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-bd071bc6-647a-4c79-a412-797b8bdae8fe {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:19 devstack sudo[100213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-bd071bc6-647a-4c79-a412-797b8bdae8fe
Jul 30 20:32:19 devstack sudo[100213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:19 devstack sudo[100211]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:19 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-cebbf3a2-259a-435c-be2e-411306802aef tempest-VolumesCloneTest-1963593569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0c7cebc2-ad68-4f23-97ba-42145a855f1a" returned: 0 in 0.530s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:19 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-cebbf3a2-259a-435c-be2e-411306802aef tempest-VolumesCloneTest-1963593569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0c7cebc2-ad68-4f23-97ba-42145a855f1a {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:19 devstack sudo[100219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0c7cebc2-ad68-4f23-97ba-42145a855f1a
Jul 30 20:32:19 devstack sudo[100219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:19 devstack sudo[100213]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:19 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-c86e8305-6b94-4203-8e2c-6b698618a560 tempest-GroupsTest-1841966773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-bd071bc6-647a-4c79-a412-797b8bdae8fe" returned: 0 in 0.327s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:19 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-c86e8305-6b94-4203-8e2c-6b698618a560 tempest-GroupsTest-1841966773 None] <== create_volume: return (1073ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:32:19 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-c86e8305-6b94-4203-8e2c-6b698618a560 tempest-GroupsTest-1841966773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.076s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:32:19 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-c86e8305-6b94-4203-8e2c-6b698618a560 tempest-GroupsTest-1841966773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b7358da-024d-4b4b-9be3-db169fff6e7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd071bc6-647a-4c79-a412-797b8bdae8fe', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:32:19 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-c86e8305-6b94-4203-8e2c-6b698618a560 tempest-GroupsTest-1841966773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9f0bebb-b72e-4d1d-b9d5-07bfa9ba889f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:32:19 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-c86e8305-6b94-4203-8e2c-6b698618a560 tempest-GroupsTest-1841966773 None] Volume volume-bd071bc6-647a-4c79-a412-797b8bdae8fe (bd071bc6-647a-4c79-a412-797b8bdae8fe): created successfully
Jul 30 20:32:19 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-c86e8305-6b94-4203-8e2c-6b698618a560 tempest-GroupsTest-1841966773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9f0bebb-b72e-4d1d-b9d5-07bfa9ba889f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:32:19 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-c86e8305-6b94-4203-8e2c-6b698618a560 tempest-GroupsTest-1841966773 None] Flow 'volume_create_manager' (e5820622-d9ed-474f-bba6-8f2d49892d49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:32:19 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-c86e8305-6b94-4203-8e2c-6b698618a560 tempest-GroupsTest-1841966773 None] Created volume successfully.
Jul 30 20:32:19 devstack sudo[100219]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:19 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-cebbf3a2-259a-435c-be2e-411306802aef tempest-VolumesCloneTest-1963593569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0c7cebc2-ad68-4f23-97ba-42145a855f1a" returned: 0 in 0.320s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:19 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-cebbf3a2-259a-435c-be2e-411306802aef tempest-VolumesCloneTest-1963593569 None] Lock "cinder-quobyte-0c7cebc2-ad68-4f23-97ba-42145a855f1a" released by "delete_volume" :: held 0.951s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:32:19 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-cebbf3a2-259a-435c-be2e-411306802aef tempest-VolumesCloneTest-1963593569 None] Created reservations ['306a0d6b-df32-4e98-b46d-7dec98528adc', 'b11cbbe9-693f-4fa6-a35c-782c7d916611', '567ca939-4439-4d35-bd77-f69ffdefabe0', 'f9bd551b-4e23-4380-ab42-54608b2ca4f0'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:32:20 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-cebbf3a2-259a-435c-be2e-411306802aef tempest-VolumesCloneTest-1963593569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:32:20 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-cebbf3a2-259a-435c-be2e-411306802aef tempest-VolumesCloneTest-1963593569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:32:20 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-cebbf3a2-259a-435c-be2e-411306802aef tempest-VolumesCloneTest-1963593569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:32:20 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-cebbf3a2-259a-435c-be2e-411306802aef tempest-VolumesCloneTest-1963593569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:32:20 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-cebbf3a2-259a-435c-be2e-411306802aef tempest-VolumesCloneTest-1963593569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:32:20 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-cebbf3a2-259a-435c-be2e-411306802aef tempest-VolumesCloneTest-1963593569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:20 devstack sudo[100223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:32:20 devstack sudo[100223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:20 devstack sudo[100223]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:20 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-cebbf3a2-259a-435c-be2e-411306802aef tempest-VolumesCloneTest-1963593569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.359s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:20 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-cebbf3a2-259a-435c-be2e-411306802aef tempest-VolumesCloneTest-1963593569 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:32:20 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-cebbf3a2-259a-435c-be2e-411306802aef tempest-VolumesCloneTest-1963593569 None] Deleted volume successfully.
Jul 30 20:32:20 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-cebbf3a2-259a-435c-be2e-411306802aef tempest-VolumesCloneTest-1963593569 None] Lock "cinder-0c7cebc2-ad68-4f23-97ba-42145a855f1a-delete_volume" released by "delete_volume" :: held 1.754s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:32:21 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-cd87944f-77df-4d7f-b6cb-d27c5a2d60ff tempest-GroupsTest-1841966773 None] Update group completed successfully.
Jul 30 20:32:22 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-6324ba8e-bd00-4149-8bfc-0746f02daa8e tempest-GroupsTest-1841966773 None] Update group completed successfully.
Jul 30 20:32:24 devstack cinder-volume[88719]: DEBUG dbcounter [-] [88719] Writing DB stats cinder:SELECT=125,cinder:UPDATE=158,cinder:INSERT=42,cinder:DELETE=9 {{(pid=88719) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 30 20:32:24 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-9580df0a-5735-447e-9562-cf97396fc324 tempest-GroupsTest-1841966773 None] Acquiring lock "cinder-quobyte-bd071bc6-647a-4c79-a412-797b8bdae8fe" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:32:24 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-9580df0a-5735-447e-9562-cf97396fc324 tempest-GroupsTest-1841966773 None] Lock "cinder-quobyte-bd071bc6-647a-4c79-a412-797b8bdae8fe" acquired by "delete_volume" :: waited 0.033s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:32:24 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[74fd3c0b-85a7-444c-8078-4fe66600a9b4]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:32:24 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-9580df0a-5735-447e-9562-cf97396fc324 tempest-GroupsTest-1841966773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-bd071bc6-647a-4c79-a412-797b8bdae8fe {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:24 devstack sudo[100227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-bd071bc6-647a-4c79-a412-797b8bdae8fe
Jul 30 20:32:24 devstack sudo[100227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:25 devstack sudo[100227]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:25 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-9580df0a-5735-447e-9562-cf97396fc324 tempest-GroupsTest-1841966773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-bd071bc6-647a-4c79-a412-797b8bdae8fe" returned: 0 in 0.689s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:25 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-9580df0a-5735-447e-9562-cf97396fc324 tempest-GroupsTest-1841966773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-bd071bc6-647a-4c79-a412-797b8bdae8fe {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:25 devstack sudo[100234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-bd071bc6-647a-4c79-a412-797b8bdae8fe
Jul 30 20:32:25 devstack sudo[100234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:25 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3680628-86ff-43ac-8855-ce66ccb21381 tempest-VolumesExtendTest-747499218 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:32:25 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-a3680628-86ff-43ac-8855-ce66ccb21381 tempest-VolumesExtendTest-747499218 None] Flow 'volume_create_manager' (c08855cd-1e92-4c58-85ee-8391fbfd7d9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:32:25 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-a3680628-86ff-43ac-8855-ce66ccb21381 tempest-VolumesExtendTest-747499218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a18e7ae-4792-48b5-a557-7da608e2b178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:32:25 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-a3680628-86ff-43ac-8855-ce66ccb21381 tempest-VolumesExtendTest-747499218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a18e7ae-4792-48b5-a557-7da608e2b178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:32:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-962448753',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efa959c0-bc46-489c-845f-72ce2c734fa5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3319e5ade4ff4c1a89995e89fb60888c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:32:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:32:25Z,use_quota=True,user_id='17f7740322ba424b8b8cef8781ca89cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:32:25 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-a3680628-86ff-43ac-8855-ce66ccb21381 tempest-VolumesExtendTest-747499218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87693304-541c-423b-8714-aa75e48a3b72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:32:25 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-a3680628-86ff-43ac-8855-ce66ccb21381 tempest-VolumesExtendTest-747499218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87693304-541c-423b-8714-aa75e48a3b72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:32:25 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-a3680628-86ff-43ac-8855-ce66ccb21381 tempest-VolumesExtendTest-747499218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (342526b6-49d6-49a5-9a32-e477aac43c86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:32:25 devstack cinder-volume[88719]: DEBUG cinder.image.glance [None req-a3680628-86ff-43ac-8855-ce66ccb21381 tempest-VolumesExtendTest-747499218 None] Creating Keystone auth plugin from conf {{(pid=88719) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 30 20:32:25 devstack sudo[100234]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:25 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-9580df0a-5735-447e-9562-cf97396fc324 tempest-GroupsTest-1841966773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-bd071bc6-647a-4c79-a412-797b8bdae8fe" returned: 0 in 0.341s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:25 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-9580df0a-5735-447e-9562-cf97396fc324 tempest-GroupsTest-1841966773 None] Lock "cinder-quobyte-bd071bc6-647a-4c79-a412-797b8bdae8fe" released by "delete_volume" :: held 1.091s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:32:25 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-9580df0a-5735-447e-9562-cf97396fc324 tempest-GroupsTest-1841966773 None] Acquiring lock "cinder-quobyte-c387843f-e689-4ded-8b1f-96842fe0ef79" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:32:25 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-9580df0a-5735-447e-9562-cf97396fc324 tempest-GroupsTest-1841966773 None] Lock "cinder-quobyte-c387843f-e689-4ded-8b1f-96842fe0ef79" acquired by "delete_volume" :: waited 0.033s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:32:25 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b2458ad-5472-4c47-9be6-7324c14494f9]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:32:25 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-9580df0a-5735-447e-9562-cf97396fc324 tempest-GroupsTest-1841966773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c387843f-e689-4ded-8b1f-96842fe0ef79 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:25 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-a3680628-86ff-43ac-8855-ce66ccb21381 tempest-VolumesExtendTest-747499218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (342526b6-49d6-49a5-9a32-e477aac43c86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'efa959c0-bc46-489c-845f-72ce2c734fa5', 'volume_name': 'volume-efa959c0-bc46-489c-845f-72ce2c734fa5', 'volume_size': 1, 'image_id': '1ed21181-aca9-4608-89cf-131c66236dc1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1ed21181-aca9-4608-89cf-131c66236dc1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ec1eaae7620840deac2e426a7e923b06', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1ed21181-aca9-4608-89cf-131c66236dc1', 'created_at': datetime.datetime(2026, 7, 30, 18, 17, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 18, 17, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1ed21181-aca9-4608-89cf-131c66236dc1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x78687a39ad50>}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:32:25 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-a3680628-86ff-43ac-8855-ce66ccb21381 tempest-VolumesExtendTest-747499218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56ee8222-a0cd-4d2d-b452-9b5aaf969c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:32:25 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-a3680628-86ff-43ac-8855-ce66ccb21381 tempest-VolumesExtendTest-747499218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56ee8222-a0cd-4d2d-b452-9b5aaf969c59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:32:25 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-a3680628-86ff-43ac-8855-ce66ccb21381 tempest-VolumesExtendTest-747499218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6595ac04-2e13-4d3a-987a-861c405a4692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:32:25 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-a3680628-86ff-43ac-8855-ce66ccb21381 tempest-VolumesExtendTest-747499218 None] Volume efa959c0-bc46-489c-845f-72ce2c734fa5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-efa959c0-bc46-489c-845f-72ce2c734fa5', 'volume_size': 1, 'image_id': '1ed21181-aca9-4608-89cf-131c66236dc1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1ed21181-aca9-4608-89cf-131c66236dc1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ec1eaae7620840deac2e426a7e923b06', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1ed21181-aca9-4608-89cf-131c66236dc1', 'created_at': datetime.datetime(2026, 7, 30, 18, 17, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 18, 17, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1ed21181-aca9-4608-89cf-131c66236dc1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x78687a39ad50>}
Jul 30 20:32:25 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3680628-86ff-43ac-8855-ce66ccb21381 tempest-VolumesExtendTest-747499218 None] Trying to clone efa959c0-bc46-489c-845f-72ce2c734fa5 from image 1ed21181-aca9-4608-89cf-131c66236dc1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/1ed21181-aca9-4608-89cf-131c66236dc1', 'metadata': {}}]). {{(pid=88719) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 30 20:32:25 devstack sudo[100237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c387843f-e689-4ded-8b1f-96842fe0ef79
Jul 30 20:32:25 devstack sudo[100237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:26 devstack sudo[100237]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:26 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-9580df0a-5735-447e-9562-cf97396fc324 tempest-GroupsTest-1841966773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c387843f-e689-4ded-8b1f-96842fe0ef79" returned: 0 in 0.687s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:26 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-9580df0a-5735-447e-9562-cf97396fc324 tempest-GroupsTest-1841966773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c387843f-e689-4ded-8b1f-96842fe0ef79 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:26 devstack sudo[100244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c387843f-e689-4ded-8b1f-96842fe0ef79
Jul 30 20:32:26 devstack sudo[100244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:26 devstack cinder-volume[88719]: DEBUG cinder.image.image_utils [None req-a3680628-86ff-43ac-8855-ce66ccb21381 tempest-VolumesExtendTest-747499218 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1ed21181-aca9-4608-89cf-131c66236dc1_ixzrzz80devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88719) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 30 20:32:26 devstack cinder-volume[88719]: INFO cinder.image.image_utils [None req-a3680628-86ff-43ac-8855-ce66ccb21381 tempest-VolumesExtendTest-747499218 None] Image download 20.69 MB at 20.69 MB/s
Jul 30 20:32:26 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a277cd3-1bcb-4004-af79-01a5f88e5a33]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:32:26 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-a3680628-86ff-43ac-8855-ce66ccb21381 tempest-VolumesExtendTest-747499218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1ed21181-aca9-4608-89cf-131c66236dc1_ixzrzz80devstack@QuobyteHD {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:26 devstack sudo[100244]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:26 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-9580df0a-5735-447e-9562-cf97396fc324 tempest-GroupsTest-1841966773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c387843f-e689-4ded-8b1f-96842fe0ef79" returned: 0 in 0.340s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:26 devstack sudo[100246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1ed21181-aca9-4608-89cf-131c66236dc1_ixzrzz80devstack@QuobyteHD
Jul 30 20:32:26 devstack sudo[100246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:26 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-9580df0a-5735-447e-9562-cf97396fc324 tempest-GroupsTest-1841966773 None] Lock "cinder-quobyte-c387843f-e689-4ded-8b1f-96842fe0ef79" released by "delete_volume" :: held 1.092s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:32:26 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-9580df0a-5735-447e-9562-cf97396fc324 tempest-GroupsTest-1841966773 None] Created reservations ['e5b36d35-72f8-4e4c-8d96-4becc1086270'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:32:26 devstack cinder-volume[88719]: WARNING cinder.quota [None req-9580df0a-5735-447e-9562-cf97396fc324 tempest-GroupsTest-1841966773 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1294804226 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1294804226, it is now deprecated. Please use the default quota class for default quota.
Jul 30 20:32:26 devstack cinder-volume[88719]: WARNING cinder.quota [None req-9580df0a-5735-447e-9562-cf97396fc324 tempest-GroupsTest-1841966773 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1294804226 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1294804226, it is now deprecated. Please use the default quota class for default quota.
Jul 30 20:32:26 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-9580df0a-5735-447e-9562-cf97396fc324 tempest-GroupsTest-1841966773 None] Created reservations ['2db7e388-9f4b-44e8-a7f8-de1205f146cf', 'cfee3bf4-b798-46d9-b55c-001f390f186b', 'add00cef-496f-4756-832f-4f11fc17f921', '63f6cce1-070a-4995-aef7-392a1992b8ba'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:32:26 devstack sudo[100246]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:26 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-a3680628-86ff-43ac-8855-ce66ccb21381 tempest-VolumesExtendTest-747499218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1ed21181-aca9-4608-89cf-131c66236dc1_ixzrzz80devstack@QuobyteHD" returned: 0 in 0.539s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:26 devstack cinder-volume[88719]: DEBUG cinder.image.image_utils [None req-a3680628-86ff-43ac-8855-ce66ccb21381 tempest-VolumesExtendTest-747499218 None] Temporary image 1ed21181-aca9-4608-89cf-131c66236dc1 is fetched for user 17f7740322ba424b8b8cef8781ca89cd. {{(pid=88719) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 30 20:32:27 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-9580df0a-5735-447e-9562-cf97396fc324 tempest-GroupsTest-1841966773 None] Created reservations ['c8ed18ae-eb2c-4769-a11a-282e4f134160', '3206d2fc-643d-4e03-a8c6-f000c3af79b3', 'b754f8f4-1e5e-43bd-8ed3-1b81d7f8c64f', 'ceece390-eac6-4235-a297-5bab23926746'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:32:27 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcc3a4b9-522f-40a6-b991-56a76671b24f]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:32:27 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-a3680628-86ff-43ac-8855-ce66ccb21381 tempest-VolumesExtendTest-747499218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1ed21181-aca9-4608-89cf-131c66236dc1_ixzrzz80devstack@QuobyteHD {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:27 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-9580df0a-5735-447e-9562-cf97396fc324 tempest-GroupsTest-1841966773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:32:27 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-9580df0a-5735-447e-9562-cf97396fc324 tempest-GroupsTest-1841966773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:32:27 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-9580df0a-5735-447e-9562-cf97396fc324 tempest-GroupsTest-1841966773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:32:27 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-9580df0a-5735-447e-9562-cf97396fc324 tempest-GroupsTest-1841966773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:32:27 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-9580df0a-5735-447e-9562-cf97396fc324 tempest-GroupsTest-1841966773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:32:27 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-9580df0a-5735-447e-9562-cf97396fc324 tempest-GroupsTest-1841966773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:27 devstack sudo[100253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:32:27 devstack sudo[100253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:27 devstack sudo[100252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1ed21181-aca9-4608-89cf-131c66236dc1_ixzrzz80devstack@QuobyteHD
Jul 30 20:32:27 devstack sudo[100252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:27 devstack sudo[100253]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:27 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-9580df0a-5735-447e-9562-cf97396fc324 tempest-GroupsTest-1841966773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.425s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:27 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-9580df0a-5735-447e-9562-cf97396fc324 tempest-GroupsTest-1841966773 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:32:27 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-9580df0a-5735-447e-9562-cf97396fc324 tempest-GroupsTest-1841966773 None] Delete group completed successfully.
Jul 30 20:32:27 devstack sudo[100252]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:27 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-a3680628-86ff-43ac-8855-ce66ccb21381 tempest-VolumesExtendTest-747499218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1ed21181-aca9-4608-89cf-131c66236dc1_ixzrzz80devstack@QuobyteHD" returned: 0 in 0.684s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:27 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-a3680628-86ff-43ac-8855-ce66ccb21381 tempest-VolumesExtendTest-747499218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:32:27 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-a3680628-86ff-43ac-8855-ce66ccb21381 tempest-VolumesExtendTest-747499218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:32:27 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-a3680628-86ff-43ac-8855-ce66ccb21381 tempest-VolumesExtendTest-747499218 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:32:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-962448753',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efa959c0-bc46-489c-845f-72ce2c734fa5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3319e5ade4ff4c1a89995e89fb60888c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:32:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:32:25Z,use_quota=True,user_id='17f7740322ba424b8b8cef8781ca89cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:32:27 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-a3680628-86ff-43ac-8855-ce66ccb21381 tempest-VolumesExtendTest-747499218 None] Creating volume efa959c0-bc46-489c-845f-72ce2c734fa5 {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:32:27 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-a3680628-86ff-43ac-8855-ce66ccb21381 tempest-VolumesExtendTest-747499218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:32:27 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-a3680628-86ff-43ac-8855-ce66ccb21381 tempest-VolumesExtendTest-747499218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:32:27 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-a3680628-86ff-43ac-8855-ce66ccb21381 tempest-VolumesExtendTest-747499218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:32:27 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-a3680628-86ff-43ac-8855-ce66ccb21381 tempest-VolumesExtendTest-747499218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:32:27 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-a3680628-86ff-43ac-8855-ce66ccb21381 tempest-VolumesExtendTest-747499218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:32:27 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-a3680628-86ff-43ac-8855-ce66ccb21381 tempest-VolumesExtendTest-747499218 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:32:27 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-a3680628-86ff-43ac-8855-ce66ccb21381 tempest-VolumesExtendTest-747499218 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:32:27 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-a3680628-86ff-43ac-8855-ce66ccb21381 tempest-VolumesExtendTest-747499218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-efa959c0-bc46-489c-845f-72ce2c734fa5 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:27 devstack sudo[100261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-efa959c0-bc46-489c-845f-72ce2c734fa5 1073741824
Jul 30 20:32:27 devstack sudo[100261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:28 devstack sudo[100261]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:28 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-a3680628-86ff-43ac-8855-ce66ccb21381 tempest-VolumesExtendTest-747499218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-efa959c0-bc46-489c-845f-72ce2c734fa5 1073741824" returned: 0 in 0.605s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:28 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-a3680628-86ff-43ac-8855-ce66ccb21381 tempest-VolumesExtendTest-747499218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-efa959c0-bc46-489c-845f-72ce2c734fa5 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:28 devstack sudo[100267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-efa959c0-bc46-489c-845f-72ce2c734fa5
Jul 30 20:32:28 devstack sudo[100267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:28 devstack sudo[100267]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:28 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-a3680628-86ff-43ac-8855-ce66ccb21381 tempest-VolumesExtendTest-747499218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-efa959c0-bc46-489c-845f-72ce2c734fa5" returned: 0 in 0.359s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:28 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-a3680628-86ff-43ac-8855-ce66ccb21381 tempest-VolumesExtendTest-747499218 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:32:28 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-a3680628-86ff-43ac-8855-ce66ccb21381 tempest-VolumesExtendTest-747499218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.046s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:32:28 devstack cinder-volume[88719]: DEBUG cinder.volume.volume_utils [None req-a3680628-86ff-43ac-8855-ce66ccb21381 tempest-VolumesExtendTest-747499218 None] Attempting download of 1ed21181-aca9-4608-89cf-131c66236dc1 ((None, [{'url': 'file:///opt/stack/data/glance/images/1ed21181-aca9-4608-89cf-131c66236dc1', 'metadata': {}}])) to volume efa959c0-bc46-489c-845f-72ce2c734fa5. {{(pid=88719) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 30 20:32:28 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9e6495f-4005-4b3b-babb-87a547767e83]: (4, 'raw') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:32:28 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-a3680628-86ff-43ac-8855-ce66ccb21381 tempest-VolumesExtendTest-747499218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1ed21181-aca9-4608-89cf-131c66236dc1_fjmb1rec {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:29 devstack sudo[100270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1ed21181-aca9-4608-89cf-131c66236dc1_fjmb1rec
Jul 30 20:32:29 devstack sudo[100270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:29 devstack sudo[100270]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:29 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-a3680628-86ff-43ac-8855-ce66ccb21381 tempest-VolumesExtendTest-747499218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1ed21181-aca9-4608-89cf-131c66236dc1_fjmb1rec" returned: 0 in 0.545s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:29 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-a3680628-86ff-43ac-8855-ce66ccb21381 tempest-VolumesExtendTest-747499218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1ed21181-aca9-4608-89cf-131c66236dc1_fjmb1rec {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:29 devstack sudo[100274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1ed21181-aca9-4608-89cf-131c66236dc1_fjmb1rec
Jul 30 20:32:29 devstack sudo[100274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:30 devstack sudo[100274]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:30 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-a3680628-86ff-43ac-8855-ce66ccb21381 tempest-VolumesExtendTest-747499218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1ed21181-aca9-4608-89cf-131c66236dc1_fjmb1rec" returned: 1 in 0.587s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:30 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-a3680628-86ff-43ac-8855-ce66ccb21381 tempest-VolumesExtendTest-747499218 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1ed21181-aca9-4608-89cf-131c66236dc1_fjmb1rec' failed. Not Retrying. {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 30 20:32:30 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[06121120-6e0e-45b2-8344-d5e26a7f6f8f]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:32:30 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-a3680628-86ff-43ac-8855-ce66ccb21381 tempest-VolumesExtendTest-747499218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1ed21181-aca9-4608-89cf-131c66236dc1_ixzrzz80devstack@QuobyteHD {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:30 devstack sudo[100278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1ed21181-aca9-4608-89cf-131c66236dc1_ixzrzz80devstack@QuobyteHD
Jul 30 20:32:30 devstack sudo[100278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:30 devstack sudo[100278]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:30 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-a3680628-86ff-43ac-8855-ce66ccb21381 tempest-VolumesExtendTest-747499218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1ed21181-aca9-4608-89cf-131c66236dc1_ixzrzz80devstack@QuobyteHD" returned: 0 in 0.493s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:30 devstack cinder-volume[88719]: DEBUG cinder.image.image_utils [None req-a3680628-86ff-43ac-8855-ce66ccb21381 tempest-VolumesExtendTest-747499218 None] 1ed21181-aca9-4608-89cf-131c66236dc1 was qcow2, converting to qcow2 {{(pid=88719) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 30 20:32:30 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-a3680628-86ff-43ac-8855-ce66ccb21381 tempest-VolumesExtendTest-747499218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1ed21181-aca9-4608-89cf-131c66236dc1_ixzrzz80devstack@QuobyteHD /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-efa959c0-bc46-489c-845f-72ce2c734fa5 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:30 devstack sudo[100283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1ed21181-aca9-4608-89cf-131c66236dc1_ixzrzz80devstack@QuobyteHD /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-efa959c0-bc46-489c-845f-72ce2c734fa5
Jul 30 20:32:30 devstack sudo[100283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:31 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-1321d3c4-f0d4-4eca-81b7-bee29a9b5999 tempest-VolumesNegativeTest-881901340 None] Acquiring lock "cinder-1c3759c8-976f-4dab-aec4-2e43449b6537-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:32:31 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-1321d3c4-f0d4-4eca-81b7-bee29a9b5999 tempest-VolumesNegativeTest-881901340 None] Lock "cinder-1c3759c8-976f-4dab-aec4-2e43449b6537-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:32:31 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-1321d3c4-f0d4-4eca-81b7-bee29a9b5999 tempest-VolumesNegativeTest-881901340 None] Acquiring lock "cinder-quobyte-1c3759c8-976f-4dab-aec4-2e43449b6537" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:32:31 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-1321d3c4-f0d4-4eca-81b7-bee29a9b5999 tempest-VolumesNegativeTest-881901340 None] Lock "cinder-quobyte-1c3759c8-976f-4dab-aec4-2e43449b6537" acquired by "delete_volume" :: waited 0.027s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:32:31 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[2069d77e-a638-4b66-ab6b-e9732364eb99]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:32:31 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-1321d3c4-f0d4-4eca-81b7-bee29a9b5999 tempest-VolumesNegativeTest-881901340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1c3759c8-976f-4dab-aec4-2e43449b6537 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:31 devstack sudo[100289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1c3759c8-976f-4dab-aec4-2e43449b6537
Jul 30 20:32:31 devstack sudo[100289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:31 devstack sudo[100289]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:31 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-1321d3c4-f0d4-4eca-81b7-bee29a9b5999 tempest-VolumesNegativeTest-881901340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1c3759c8-976f-4dab-aec4-2e43449b6537" returned: 0 in 0.463s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:31 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-1321d3c4-f0d4-4eca-81b7-bee29a9b5999 tempest-VolumesNegativeTest-881901340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1c3759c8-976f-4dab-aec4-2e43449b6537 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:31 devstack sudo[100296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1c3759c8-976f-4dab-aec4-2e43449b6537
Jul 30 20:32:31 devstack sudo[100296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:32 devstack sudo[100296]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:32 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-1321d3c4-f0d4-4eca-81b7-bee29a9b5999 tempest-VolumesNegativeTest-881901340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1c3759c8-976f-4dab-aec4-2e43449b6537" returned: 0 in 0.335s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:32 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-1321d3c4-f0d4-4eca-81b7-bee29a9b5999 tempest-VolumesNegativeTest-881901340 None] Lock "cinder-quobyte-1c3759c8-976f-4dab-aec4-2e43449b6537" released by "delete_volume" :: held 0.870s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:32:32 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-1321d3c4-f0d4-4eca-81b7-bee29a9b5999 tempest-VolumesNegativeTest-881901340 None] Created reservations ['3262d325-489f-4e54-a5b4-c02c62119b56', 'ceeaad56-bf2d-4656-a3fb-146e89fdd458', '24371421-737a-42a0-a55a-2b8289f5860f', '72ae3ce2-67a8-4f00-ae1d-10889f7c3266'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:32:32 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-1321d3c4-f0d4-4eca-81b7-bee29a9b5999 tempest-VolumesNegativeTest-881901340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:32:32 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-1321d3c4-f0d4-4eca-81b7-bee29a9b5999 tempest-VolumesNegativeTest-881901340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:32:32 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-1321d3c4-f0d4-4eca-81b7-bee29a9b5999 tempest-VolumesNegativeTest-881901340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:32:32 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-1321d3c4-f0d4-4eca-81b7-bee29a9b5999 tempest-VolumesNegativeTest-881901340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:32:32 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-1321d3c4-f0d4-4eca-81b7-bee29a9b5999 tempest-VolumesNegativeTest-881901340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:32:32 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-1321d3c4-f0d4-4eca-81b7-bee29a9b5999 tempest-VolumesNegativeTest-881901340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:32 devstack sudo[100300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:32:32 devstack sudo[100300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:32 devstack sudo[100300]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:32 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-1321d3c4-f0d4-4eca-81b7-bee29a9b5999 tempest-VolumesNegativeTest-881901340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.318s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:32 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-1321d3c4-f0d4-4eca-81b7-bee29a9b5999 tempest-VolumesNegativeTest-881901340 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:32:32 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-1321d3c4-f0d4-4eca-81b7-bee29a9b5999 tempest-VolumesNegativeTest-881901340 None] Deleted volume successfully.
Jul 30 20:32:32 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-1321d3c4-f0d4-4eca-81b7-bee29a9b5999 tempest-VolumesNegativeTest-881901340 None] Lock "cinder-1c3759c8-976f-4dab-aec4-2e43449b6537-delete_volume" released by "delete_volume" :: held 1.527s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:32:33 devstack sudo[100283]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:33 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-a3680628-86ff-43ac-8855-ce66ccb21381 tempest-VolumesExtendTest-747499218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1ed21181-aca9-4608-89cf-131c66236dc1_ixzrzz80devstack@QuobyteHD /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-efa959c0-bc46-489c-845f-72ce2c734fa5" returned: 0 in 2.450s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:33 devstack cinder-volume[88719]: DEBUG cinder.image.image_utils [None req-a3680628-86ff-43ac-8855-ce66ccb21381 tempest-VolumesExtendTest-747499218 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1ed21181-aca9-4608-89cf-131c66236dc1_ixzrzz80devstack@QuobyteHD, size 112.00 MB, duration 2.45 sec, destination /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-efa959c0-bc46-489c-845f-72ce2c734fa5 {{(pid=88719) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 30 20:32:33 devstack cinder-volume[88719]: INFO cinder.image.image_utils [None req-a3680628-86ff-43ac-8855-ce66ccb21381 tempest-VolumesExtendTest-747499218 None] Converted 112.00 MB image at 45.69 MB/s
Jul 30 20:32:33 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-a3680628-86ff-43ac-8855-ce66ccb21381 tempest-VolumesExtendTest-747499218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-efa959c0-bc46-489c-845f-72ce2c734fa5 1G {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:33 devstack sudo[100303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-efa959c0-bc46-489c-845f-72ce2c734fa5 1G
Jul 30 20:32:33 devstack sudo[100303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:33 devstack sudo[100303]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:33 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-a3680628-86ff-43ac-8855-ce66ccb21381 tempest-VolumesExtendTest-747499218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-efa959c0-bc46-489c-845f-72ce2c734fa5 1G" returned: 0 in 0.377s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:33 devstack cinder-volume[88719]: DEBUG cinder.volume.volume_utils [None req-a3680628-86ff-43ac-8855-ce66ccb21381 tempest-VolumesExtendTest-747499218 None] Downloaded image 1ed21181-aca9-4608-89cf-131c66236dc1 ((None, [{'url': 'file:///opt/stack/data/glance/images/1ed21181-aca9-4608-89cf-131c66236dc1', 'metadata': {}}])) to volume efa959c0-bc46-489c-845f-72ce2c734fa5 successfully. {{(pid=88719) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 30 20:32:33 devstack cinder-volume[88719]: DEBUG cinder.image.image_utils [None req-a3680628-86ff-43ac-8855-ce66ccb21381 tempest-VolumesExtendTest-747499218 None] Temporary image 1ed21181-aca9-4608-89cf-131c66236dc1 for user 17f7740322ba424b8b8cef8781ca89cd is deleted. {{(pid=88719) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 30 20:32:33 devstack cinder-volume[88719]: DEBUG cinder.volume.volume_utils [None req-a3680628-86ff-43ac-8855-ce66ccb21381 tempest-VolumesExtendTest-747499218 None] Marking volume efa959c0-bc46-489c-845f-72ce2c734fa5 as bootable. {{(pid=88719) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 30 20:32:33 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3680628-86ff-43ac-8855-ce66ccb21381 tempest-VolumesExtendTest-747499218 None] Copying metadata from image 1ed21181-aca9-4608-89cf-131c66236dc1 to efa959c0-bc46-489c-845f-72ce2c734fa5. {{(pid=88719) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 30 20:32:33 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3680628-86ff-43ac-8855-ce66ccb21381 tempest-VolumesExtendTest-747499218 None] Creating volume glance metadata for volume efa959c0-bc46-489c-845f-72ce2c734fa5 backed by image 1ed21181-aca9-4608-89cf-131c66236dc1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '1ed21181-aca9-4608-89cf-131c66236dc1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88719) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 30 20:32:33 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-a3680628-86ff-43ac-8855-ce66ccb21381 tempest-VolumesExtendTest-747499218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6595ac04-2e13-4d3a-987a-861c405a4692) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efa959c0-bc46-489c-845f-72ce2c734fa5', 'volume_size': 1, 'image_id': '1ed21181-aca9-4608-89cf-131c66236dc1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1ed21181-aca9-4608-89cf-131c66236dc1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ec1eaae7620840deac2e426a7e923b06', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1ed21181-aca9-4608-89cf-131c66236dc1', 'created_at': datetime.datetime(2026, 7, 30, 18, 17, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 18, 17, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1ed21181-aca9-4608-89cf-131c66236dc1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x78687a39ad50>}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:32:33 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-a3680628-86ff-43ac-8855-ce66ccb21381 tempest-VolumesExtendTest-747499218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c6474f6-0483-450d-9048-35725c95b6d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:32:33 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-a3680628-86ff-43ac-8855-ce66ccb21381 tempest-VolumesExtendTest-747499218 None] Volume volume-efa959c0-bc46-489c-845f-72ce2c734fa5 (efa959c0-bc46-489c-845f-72ce2c734fa5): created successfully
Jul 30 20:32:33 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-a3680628-86ff-43ac-8855-ce66ccb21381 tempest-VolumesExtendTest-747499218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c6474f6-0483-450d-9048-35725c95b6d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:32:33 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-a3680628-86ff-43ac-8855-ce66ccb21381 tempest-VolumesExtendTest-747499218 None] Flow 'volume_create_manager' (c08855cd-1e92-4c58-85ee-8391fbfd7d9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:32:33 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-a3680628-86ff-43ac-8855-ce66ccb21381 tempest-VolumesExtendTest-747499218 None] Created volume successfully.
Jul 30 20:32:34 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-ceb43a11-9d2e-4cd6-b2b1-d11abdcf619f tempest-VolumesExtendTest-747499218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:32:34 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-ceb43a11-9d2e-4cd6-b2b1-d11abdcf619f tempest-VolumesExtendTest-747499218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:32:34 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8a840b7-3167-4cf6-aa7d-946e01e8f75d]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:32:34 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-ceb43a11-9d2e-4cd6-b2b1-d11abdcf619f tempest-VolumesExtendTest-747499218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-efa959c0-bc46-489c-845f-72ce2c734fa5 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:34 devstack sudo[100308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-efa959c0-bc46-489c-845f-72ce2c734fa5
Jul 30 20:32:34 devstack sudo[100308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:34 devstack sudo[100308]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:34 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-ceb43a11-9d2e-4cd6-b2b1-d11abdcf619f tempest-VolumesExtendTest-747499218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-efa959c0-bc46-489c-845f-72ce2c734fa5" returned: 0 in 0.482s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:34 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-ceb43a11-9d2e-4cd6-b2b1-d11abdcf619f tempest-VolumesExtendTest-747499218 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-efa959c0-bc46-489c-845f-72ce2c734fa5 2G {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:34 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-ceb43a11-9d2e-4cd6-b2b1-d11abdcf619f tempest-VolumesExtendTest-747499218 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-efa959c0-bc46-489c-845f-72ce2c734fa5 2G" returned: 0 in 0.145s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:34 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-ceb43a11-9d2e-4cd6-b2b1-d11abdcf619f tempest-VolumesExtendTest-747499218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.654s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:32:34 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-ceb43a11-9d2e-4cd6-b2b1-d11abdcf619f tempest-VolumesExtendTest-747499218 None] Extend volume completed successfully.
Jul 30 20:32:35 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-845cc345-94ef-4ba1-81e2-8e3e5ed41e35 tempest-VolumesExtendTest-747499218 None] Acquiring lock "cinder-efa959c0-bc46-489c-845f-72ce2c734fa5-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:32:35 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-845cc345-94ef-4ba1-81e2-8e3e5ed41e35 tempest-VolumesExtendTest-747499218 None] Lock "cinder-efa959c0-bc46-489c-845f-72ce2c734fa5-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:32:35 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-845cc345-94ef-4ba1-81e2-8e3e5ed41e35 tempest-VolumesExtendTest-747499218 None] Acquiring lock "cinder-quobyte-efa959c0-bc46-489c-845f-72ce2c734fa5" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:32:35 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-845cc345-94ef-4ba1-81e2-8e3e5ed41e35 tempest-VolumesExtendTest-747499218 None] Lock "cinder-quobyte-efa959c0-bc46-489c-845f-72ce2c734fa5" acquired by "delete_volume" :: waited 0.026s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:32:35 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[a67437c8-6c50-49d2-b386-74460ed6123e]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:32:35 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-845cc345-94ef-4ba1-81e2-8e3e5ed41e35 tempest-VolumesExtendTest-747499218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-efa959c0-bc46-489c-845f-72ce2c734fa5 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:35 devstack sudo[100322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-efa959c0-bc46-489c-845f-72ce2c734fa5
Jul 30 20:32:35 devstack sudo[100322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:35 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9442bbd-bf49-46ec-9176-755538382fce tempest-SnapshotsActionsTest-570958061 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:32:35 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e9442bbd-bf49-46ec-9176-755538382fce tempest-SnapshotsActionsTest-570958061 None] Flow 'volume_create_manager' (d5bbd7ab-99b8-440c-a06d-55298e035c96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:32:35 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e9442bbd-bf49-46ec-9176-755538382fce tempest-SnapshotsActionsTest-570958061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2baccaad-25e7-4d97-a284-b3c12720f9f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:32:36 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e9442bbd-bf49-46ec-9176-755538382fce tempest-SnapshotsActionsTest-570958061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2baccaad-25e7-4d97-a284-b3c12720f9f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:32:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1316965993',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=088699a2-98b7-48e0-986a-b14388fd3b58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b55af850393a42ec8df60bc9b67069b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:32:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:32:36Z,use_quota=True,user_id='4227fad536fc4a438be7290847e9d0e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:32:36 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e9442bbd-bf49-46ec-9176-755538382fce tempest-SnapshotsActionsTest-570958061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb80611b-124b-4d97-a787-7c986fb620b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:32:36 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e9442bbd-bf49-46ec-9176-755538382fce tempest-SnapshotsActionsTest-570958061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb80611b-124b-4d97-a787-7c986fb620b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:32:36 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e9442bbd-bf49-46ec-9176-755538382fce tempest-SnapshotsActionsTest-570958061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59722d83-cbe9-4e2a-89a1-826bedffdddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:32:36 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e9442bbd-bf49-46ec-9176-755538382fce tempest-SnapshotsActionsTest-570958061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59722d83-cbe9-4e2a-89a1-826bedffdddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '088699a2-98b7-48e0-986a-b14388fd3b58', 'volume_name': 'volume-088699a2-98b7-48e0-986a-b14388fd3b58', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:32:36 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e9442bbd-bf49-46ec-9176-755538382fce tempest-SnapshotsActionsTest-570958061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1aeec78-0ea0-44f0-8bdb-275465727e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:32:36 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e9442bbd-bf49-46ec-9176-755538382fce tempest-SnapshotsActionsTest-570958061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1aeec78-0ea0-44f0-8bdb-275465727e74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:32:36 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e9442bbd-bf49-46ec-9176-755538382fce tempest-SnapshotsActionsTest-570958061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb8cd702-836b-42f7-9c4a-2321ff201c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:32:36 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-e9442bbd-bf49-46ec-9176-755538382fce tempest-SnapshotsActionsTest-570958061 None] Volume 088699a2-98b7-48e0-986a-b14388fd3b58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-088699a2-98b7-48e0-986a-b14388fd3b58', 'volume_size': 1}
Jul 30 20:32:36 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-e9442bbd-bf49-46ec-9176-755538382fce tempest-SnapshotsActionsTest-570958061 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:32:36 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-e9442bbd-bf49-46ec-9176-755538382fce tempest-SnapshotsActionsTest-570958061 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:32:36 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-e9442bbd-bf49-46ec-9176-755538382fce tempest-SnapshotsActionsTest-570958061 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:32:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1316965993',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=088699a2-98b7-48e0-986a-b14388fd3b58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b55af850393a42ec8df60bc9b67069b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:32:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:32:36Z,use_quota=True,user_id='4227fad536fc4a438be7290847e9d0e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:32:36 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-e9442bbd-bf49-46ec-9176-755538382fce tempest-SnapshotsActionsTest-570958061 None] Creating volume 088699a2-98b7-48e0-986a-b14388fd3b58 {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:32:36 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-e9442bbd-bf49-46ec-9176-755538382fce tempest-SnapshotsActionsTest-570958061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:32:36 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-e9442bbd-bf49-46ec-9176-755538382fce tempest-SnapshotsActionsTest-570958061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:32:36 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-e9442bbd-bf49-46ec-9176-755538382fce tempest-SnapshotsActionsTest-570958061 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:32:36 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-e9442bbd-bf49-46ec-9176-755538382fce tempest-SnapshotsActionsTest-570958061 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:32:36 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-e9442bbd-bf49-46ec-9176-755538382fce tempest-SnapshotsActionsTest-570958061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:32:36 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-e9442bbd-bf49-46ec-9176-755538382fce tempest-SnapshotsActionsTest-570958061 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:32:36 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-e9442bbd-bf49-46ec-9176-755538382fce tempest-SnapshotsActionsTest-570958061 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:32:36 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-e9442bbd-bf49-46ec-9176-755538382fce tempest-SnapshotsActionsTest-570958061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:36 devstack sudo[100322]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:36 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-845cc345-94ef-4ba1-81e2-8e3e5ed41e35 tempest-VolumesExtendTest-747499218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-efa959c0-bc46-489c-845f-72ce2c734fa5" returned: 0 in 0.511s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:36 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-845cc345-94ef-4ba1-81e2-8e3e5ed41e35 tempest-VolumesExtendTest-747499218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-efa959c0-bc46-489c-845f-72ce2c734fa5 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:36 devstack sudo[100328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58 1073741824
Jul 30 20:32:36 devstack sudo[100328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:36 devstack sudo[100329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-efa959c0-bc46-489c-845f-72ce2c734fa5
Jul 30 20:32:36 devstack sudo[100329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:36 devstack sudo[100329]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:36 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-845cc345-94ef-4ba1-81e2-8e3e5ed41e35 tempest-VolumesExtendTest-747499218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-efa959c0-bc46-489c-845f-72ce2c734fa5" returned: 0 in 0.386s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:36 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-845cc345-94ef-4ba1-81e2-8e3e5ed41e35 tempest-VolumesExtendTest-747499218 None] Lock "cinder-quobyte-efa959c0-bc46-489c-845f-72ce2c734fa5" released by "delete_volume" :: held 0.971s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:32:36 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-845cc345-94ef-4ba1-81e2-8e3e5ed41e35 tempest-VolumesExtendTest-747499218 None] Created reservations ['299a4d8c-ea17-427c-94d9-c81f65d0d0ae', 'b2608f00-6eb7-4bc4-9a4d-3243d5d09612', '75a5315f-6690-4b81-bc61-6ad9b96a3d9c', 'e7132353-f9c5-4120-8d09-bbdd39fef14a'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:32:36 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-845cc345-94ef-4ba1-81e2-8e3e5ed41e35 tempest-VolumesExtendTest-747499218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:32:36 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-845cc345-94ef-4ba1-81e2-8e3e5ed41e35 tempest-VolumesExtendTest-747499218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:32:36 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-845cc345-94ef-4ba1-81e2-8e3e5ed41e35 tempest-VolumesExtendTest-747499218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:32:36 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-845cc345-94ef-4ba1-81e2-8e3e5ed41e35 tempest-VolumesExtendTest-747499218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:32:36 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-845cc345-94ef-4ba1-81e2-8e3e5ed41e35 tempest-VolumesExtendTest-747499218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:32:36 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-845cc345-94ef-4ba1-81e2-8e3e5ed41e35 tempest-VolumesExtendTest-747499218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:36 devstack sudo[100328]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:36 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-e9442bbd-bf49-46ec-9176-755538382fce tempest-SnapshotsActionsTest-570958061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58 1073741824" returned: 0 in 0.781s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:36 devstack sudo[100341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:32:36 devstack sudo[100341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:36 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-e9442bbd-bf49-46ec-9176-755538382fce tempest-SnapshotsActionsTest-570958061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:36 devstack sudo[100343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58
Jul 30 20:32:36 devstack sudo[100343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:37 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8e3b736-a988-42d9-a477-ff468112b976 tempest-VolumesSnapshotListTestJSON-2060127140 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:32:37 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-d8e3b736-a988-42d9-a477-ff468112b976 tempest-VolumesSnapshotListTestJSON-2060127140 None] Flow 'volume_create_manager' (6c585ea5-a481-4b56-b3a3-6809af627395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:32:37 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-d8e3b736-a988-42d9-a477-ff468112b976 tempest-VolumesSnapshotListTestJSON-2060127140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2947fdd4-4a57-4db1-81aa-dd18b734b22e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:32:37 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-d8e3b736-a988-42d9-a477-ff468112b976 tempest-VolumesSnapshotListTestJSON-2060127140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2947fdd4-4a57-4db1-81aa-dd18b734b22e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:32:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-246901739',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f73ee1f-ae3b-4535-ac0f-7a2205655901,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd2c15267332456baf56c483b508d191',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:32:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:32:37Z,use_quota=True,user_id='1046fa03a7dd4be39d9340dd95f991ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:32:37 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-d8e3b736-a988-42d9-a477-ff468112b976 tempest-VolumesSnapshotListTestJSON-2060127140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c20195d5-078e-4717-bf31-d91fb2241a69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:32:37 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-d8e3b736-a988-42d9-a477-ff468112b976 tempest-VolumesSnapshotListTestJSON-2060127140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c20195d5-078e-4717-bf31-d91fb2241a69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:32:37 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-d8e3b736-a988-42d9-a477-ff468112b976 tempest-VolumesSnapshotListTestJSON-2060127140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03057574-4ec1-487d-8a16-e9d2d7a43a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:32:37 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-d8e3b736-a988-42d9-a477-ff468112b976 tempest-VolumesSnapshotListTestJSON-2060127140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03057574-4ec1-487d-8a16-e9d2d7a43a63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f73ee1f-ae3b-4535-ac0f-7a2205655901', 'volume_name': 'volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:32:37 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-d8e3b736-a988-42d9-a477-ff468112b976 tempest-VolumesSnapshotListTestJSON-2060127140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6372d7d5-0aa1-48dd-8000-7d7ae777338f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:32:37 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-d8e3b736-a988-42d9-a477-ff468112b976 tempest-VolumesSnapshotListTestJSON-2060127140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6372d7d5-0aa1-48dd-8000-7d7ae777338f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:32:37 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-d8e3b736-a988-42d9-a477-ff468112b976 tempest-VolumesSnapshotListTestJSON-2060127140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (164474b1-89a8-4e8d-a43e-bc0200dcc4fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:32:37 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-d8e3b736-a988-42d9-a477-ff468112b976 tempest-VolumesSnapshotListTestJSON-2060127140 None] Volume 2f73ee1f-ae3b-4535-ac0f-7a2205655901: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901', 'volume_size': 1}
Jul 30 20:32:37 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-d8e3b736-a988-42d9-a477-ff468112b976 tempest-VolumesSnapshotListTestJSON-2060127140 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:32:37 devstack sudo[100341]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:37 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-845cc345-94ef-4ba1-81e2-8e3e5ed41e35 tempest-VolumesExtendTest-747499218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.463s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:37 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-845cc345-94ef-4ba1-81e2-8e3e5ed41e35 tempest-VolumesExtendTest-747499218 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:32:37 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-845cc345-94ef-4ba1-81e2-8e3e5ed41e35 tempest-VolumesExtendTest-747499218 None] Deleted volume successfully.
Jul 30 20:32:37 devstack sudo[100343]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:37 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-845cc345-94ef-4ba1-81e2-8e3e5ed41e35 tempest-VolumesExtendTest-747499218 None] Lock "cinder-efa959c0-bc46-489c-845f-72ce2c734fa5-delete_volume" released by "delete_volume" :: held 1.877s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:32:37 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-e9442bbd-bf49-46ec-9176-755538382fce tempest-SnapshotsActionsTest-570958061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58" returned: 0 in 0.394s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:37 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-e9442bbd-bf49-46ec-9176-755538382fce tempest-SnapshotsActionsTest-570958061 None] <== create_volume: return (1273ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:32:37 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-e9442bbd-bf49-46ec-9176-755538382fce tempest-SnapshotsActionsTest-570958061 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.275s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:32:37 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-d8e3b736-a988-42d9-a477-ff468112b976 tempest-VolumesSnapshotListTestJSON-2060127140 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.107s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:32:37 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-d8e3b736-a988-42d9-a477-ff468112b976 tempest-VolumesSnapshotListTestJSON-2060127140 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:32:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-246901739',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f73ee1f-ae3b-4535-ac0f-7a2205655901,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd2c15267332456baf56c483b508d191',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:32:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:32:37Z,use_quota=True,user_id='1046fa03a7dd4be39d9340dd95f991ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:32:37 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-d8e3b736-a988-42d9-a477-ff468112b976 tempest-VolumesSnapshotListTestJSON-2060127140 None] Creating volume 2f73ee1f-ae3b-4535-ac0f-7a2205655901 {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:32:37 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-d8e3b736-a988-42d9-a477-ff468112b976 tempest-VolumesSnapshotListTestJSON-2060127140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:32:37 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-d8e3b736-a988-42d9-a477-ff468112b976 tempest-VolumesSnapshotListTestJSON-2060127140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:32:37 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-d8e3b736-a988-42d9-a477-ff468112b976 tempest-VolumesSnapshotListTestJSON-2060127140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:32:37 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-d8e3b736-a988-42d9-a477-ff468112b976 tempest-VolumesSnapshotListTestJSON-2060127140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:32:37 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-d8e3b736-a988-42d9-a477-ff468112b976 tempest-VolumesSnapshotListTestJSON-2060127140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:32:37 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-d8e3b736-a988-42d9-a477-ff468112b976 tempest-VolumesSnapshotListTestJSON-2060127140 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:32:37 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-d8e3b736-a988-42d9-a477-ff468112b976 tempest-VolumesSnapshotListTestJSON-2060127140 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:32:37 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-d8e3b736-a988-42d9-a477-ff468112b976 tempest-VolumesSnapshotListTestJSON-2060127140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:37 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e9442bbd-bf49-46ec-9176-755538382fce tempest-SnapshotsActionsTest-570958061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb8cd702-836b-42f7-9c4a-2321ff201c79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-088699a2-98b7-48e0-986a-b14388fd3b58', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:32:37 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e9442bbd-bf49-46ec-9176-755538382fce tempest-SnapshotsActionsTest-570958061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b97e871-914e-4ee9-97a8-d74db2bd3c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:32:37 devstack sudo[100357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901 1073741824
Jul 30 20:32:37 devstack sudo[100357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:37 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-e9442bbd-bf49-46ec-9176-755538382fce tempest-SnapshotsActionsTest-570958061 None] Volume volume-088699a2-98b7-48e0-986a-b14388fd3b58 (088699a2-98b7-48e0-986a-b14388fd3b58): created successfully
Jul 30 20:32:37 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e9442bbd-bf49-46ec-9176-755538382fce tempest-SnapshotsActionsTest-570958061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b97e871-914e-4ee9-97a8-d74db2bd3c14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:32:37 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e9442bbd-bf49-46ec-9176-755538382fce tempest-SnapshotsActionsTest-570958061 None] Flow 'volume_create_manager' (d5bbd7ab-99b8-440c-a06d-55298e035c96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:32:37 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-e9442bbd-bf49-46ec-9176-755538382fce tempest-SnapshotsActionsTest-570958061 None] Created volume successfully.
Jul 30 20:32:38 devstack sudo[100357]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:38 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-d8e3b736-a988-42d9-a477-ff468112b976 tempest-VolumesSnapshotListTestJSON-2060127140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901 1073741824" returned: 0 in 0.695s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:38 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-d8e3b736-a988-42d9-a477-ff468112b976 tempest-VolumesSnapshotListTestJSON-2060127140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:38 devstack sudo[100368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901
Jul 30 20:32:38 devstack sudo[100368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:38 devstack sudo[100368]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:38 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-d8e3b736-a988-42d9-a477-ff468112b976 tempest-VolumesSnapshotListTestJSON-2060127140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901" returned: 0 in 0.285s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:38 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-d8e3b736-a988-42d9-a477-ff468112b976 tempest-VolumesSnapshotListTestJSON-2060127140 None] <== create_volume: return (1056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:32:38 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-d8e3b736-a988-42d9-a477-ff468112b976 tempest-VolumesSnapshotListTestJSON-2060127140 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.059s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:32:38 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-42cb5821-3f43-480d-ac25-18d7182e5959 tempest-SnapshotsActionsTest-570958061 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:32:38 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-42cb5821-3f43-480d-ac25-18d7182e5959 tempest-SnapshotsActionsTest-570958061 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:32:38 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-d8e3b736-a988-42d9-a477-ff468112b976 tempest-VolumesSnapshotListTestJSON-2060127140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (164474b1-89a8-4e8d-a43e-bc0200dcc4fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:32:38 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-d8e3b736-a988-42d9-a477-ff468112b976 tempest-VolumesSnapshotListTestJSON-2060127140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c11eeef1-ea6b-411b-810f-b9f040a929a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:32:38 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-5906a847-ac9c-47c4-bb8a-1b0d012a4015 tempest-VolumesExtendTest-747499218 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:32:38 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5906a847-ac9c-47c4-bb8a-1b0d012a4015 tempest-VolumesExtendTest-747499218 None] Flow 'volume_create_manager' (6705887e-e7f2-434f-8351-a8e86b41ba09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:32:38 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5906a847-ac9c-47c4-bb8a-1b0d012a4015 tempest-VolumesExtendTest-747499218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (011582b9-5bc8-42e3-b799-c16145161569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:32:38 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-42cb5821-3f43-480d-ac25-18d7182e5959 tempest-SnapshotsActionsTest-570958061 None] Creating offline snapshot d1f2643d-b07c-4a9d-b886-76c6d82a2f7e of volume 088699a2-98b7-48e0-986a-b14388fd3b58 {{(pid=88719) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 30 20:32:38 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-d8e3b736-a988-42d9-a477-ff468112b976 tempest-VolumesSnapshotListTestJSON-2060127140 None] Volume volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901 (2f73ee1f-ae3b-4535-ac0f-7a2205655901): created successfully
Jul 30 20:32:38 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-d8e3b736-a988-42d9-a477-ff468112b976 tempest-VolumesSnapshotListTestJSON-2060127140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c11eeef1-ea6b-411b-810f-b9f040a929a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:32:38 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-d8e3b736-a988-42d9-a477-ff468112b976 tempest-VolumesSnapshotListTestJSON-2060127140 None] Flow 'volume_create_manager' (6c585ea5-a481-4b56-b3a3-6809af627395) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:32:38 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4d1c337-f010-46d8-a6aa-1d50e8a66665]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:32:38 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-42cb5821-3f43-480d-ac25-18d7182e5959 tempest-SnapshotsActionsTest-570958061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:38 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5906a847-ac9c-47c4-bb8a-1b0d012a4015 tempest-VolumesExtendTest-747499218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (011582b9-5bc8-42e3-b799-c16145161569) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:32:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-59643234',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0df567fd-6905-45fa-bbae-1ecb119fc978,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3319e5ade4ff4c1a89995e89fb60888c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:32:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:32:38Z,use_quota=True,user_id='17f7740322ba424b8b8cef8781ca89cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:32:38 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5906a847-ac9c-47c4-bb8a-1b0d012a4015 tempest-VolumesExtendTest-747499218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d35f5fac-531a-499c-ba13-e586ecd41e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:32:38 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5906a847-ac9c-47c4-bb8a-1b0d012a4015 tempest-VolumesExtendTest-747499218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d35f5fac-531a-499c-ba13-e586ecd41e3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:32:38 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5906a847-ac9c-47c4-bb8a-1b0d012a4015 tempest-VolumesExtendTest-747499218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14074899-af81-4d49-8f40-840b69400abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:32:38 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5906a847-ac9c-47c4-bb8a-1b0d012a4015 tempest-VolumesExtendTest-747499218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14074899-af81-4d49-8f40-840b69400abe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0df567fd-6905-45fa-bbae-1ecb119fc978', 'volume_name': 'volume-0df567fd-6905-45fa-bbae-1ecb119fc978', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:32:38 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5906a847-ac9c-47c4-bb8a-1b0d012a4015 tempest-VolumesExtendTest-747499218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26bb8268-4d77-40b6-a902-9825df745cd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:32:38 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5906a847-ac9c-47c4-bb8a-1b0d012a4015 tempest-VolumesExtendTest-747499218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26bb8268-4d77-40b6-a902-9825df745cd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:32:38 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5906a847-ac9c-47c4-bb8a-1b0d012a4015 tempest-VolumesExtendTest-747499218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd0683e6-0b27-40bf-9025-5a3f0faeccdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:32:38 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-5906a847-ac9c-47c4-bb8a-1b0d012a4015 tempest-VolumesExtendTest-747499218 None] Volume 0df567fd-6905-45fa-bbae-1ecb119fc978: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0df567fd-6905-45fa-bbae-1ecb119fc978', 'volume_size': 1}
Jul 30 20:32:38 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-5906a847-ac9c-47c4-bb8a-1b0d012a4015 tempest-VolumesExtendTest-747499218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:32:38 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-d8e3b736-a988-42d9-a477-ff468112b976 tempest-VolumesSnapshotListTestJSON-2060127140 None] Created volume successfully.
Jul 30 20:32:38 devstack sudo[100371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58
Jul 30 20:32:38 devstack sudo[100371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:38 devstack sudo[100371]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:38 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-42cb5821-3f43-480d-ac25-18d7182e5959 tempest-SnapshotsActionsTest-570958061 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58" returned: 0 in 0.399s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:38 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-42cb5821-3f43-480d-ac25-18d7182e5959 tempest-SnapshotsActionsTest-570958061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.d1f2643d-b07c-4a9d-b886-76c6d82a2f7e 1G {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:38 devstack sudo[100376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.d1f2643d-b07c-4a9d-b886-76c6d82a2f7e 1G
Jul 30 20:32:38 devstack sudo[100376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:39 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-f460c7e2-427e-424f-b91a-270a3e7875c4 tempest-VolumesSnapshotListTestJSON-2060127140 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:32:39 devstack sudo[100376]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:39 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-42cb5821-3f43-480d-ac25-18d7182e5959 tempest-SnapshotsActionsTest-570958061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.d1f2643d-b07c-4a9d-b886-76c6d82a2f7e 1G" returned: 0 in 0.566s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:39 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-42cb5821-3f43-480d-ac25-18d7182e5959 tempest-SnapshotsActionsTest-570958061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-088699a2-98b7-48e0-986a-b14388fd3b58 -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.d1f2643d-b07c-4a9d-b886-76c6d82a2f7e {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:39 devstack sudo[100383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-088699a2-98b7-48e0-986a-b14388fd3b58 -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.d1f2643d-b07c-4a9d-b886-76c6d82a2f7e
Jul 30 20:32:39 devstack sudo[100383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:39 devstack sudo[100383]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:39 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-42cb5821-3f43-480d-ac25-18d7182e5959 tempest-SnapshotsActionsTest-570958061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-088699a2-98b7-48e0-986a-b14388fd3b58 -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.d1f2643d-b07c-4a9d-b886-76c6d82a2f7e" returned: 0 in 0.464s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:39 devstack cinder-volume[88719]: WARNING cinder.volume.drivers.remotefs [None req-42cb5821-3f43-480d-ac25-18d7182e5959 tempest-SnapshotsActionsTest-570958061 None] /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.d1f2643d-b07c-4a9d-b886-76c6d82a2f7e is being set with open permissions: ugo+rw
Jul 30 20:32:39 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-42cb5821-3f43-480d-ac25-18d7182e5959 tempest-SnapshotsActionsTest-570958061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.d1f2643d-b07c-4a9d-b886-76c6d82a2f7e {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:40 devstack sudo[100418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.d1f2643d-b07c-4a9d-b886-76c6d82a2f7e
Jul 30 20:32:40 devstack sudo[100418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:40 devstack sudo[100418]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:40 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-42cb5821-3f43-480d-ac25-18d7182e5959 tempest-SnapshotsActionsTest-570958061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.d1f2643d-b07c-4a9d-b886-76c6d82a2f7e" returned: 0 in 0.489s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:40 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-42cb5821-3f43-480d-ac25-18d7182e5959 tempest-SnapshotsActionsTest-570958061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.info {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:40 devstack sudo[100442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.info
Jul 30 20:32:40 devstack sudo[100442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:40 devstack sudo[100442]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:40 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-42cb5821-3f43-480d-ac25-18d7182e5959 tempest-SnapshotsActionsTest-570958061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.info" returned: 0 in 0.340s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:40 devstack cinder-volume[88719]: WARNING cinder.volume.drivers.remotefs [None req-42cb5821-3f43-480d-ac25-18d7182e5959 tempest-SnapshotsActionsTest-570958061 None] /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.info is being set with open permissions: ugo+rw
Jul 30 20:32:40 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-42cb5821-3f43-480d-ac25-18d7182e5959 tempest-SnapshotsActionsTest-570958061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.info {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:40 devstack sudo[100459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.info
Jul 30 20:32:40 devstack sudo[100459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:41 devstack sudo[100459]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:41 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-42cb5821-3f43-480d-ac25-18d7182e5959 tempest-SnapshotsActionsTest-570958061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.info" returned: 0 in 0.261s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:41 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-42cb5821-3f43-480d-ac25-18d7182e5959 tempest-SnapshotsActionsTest-570958061 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.711s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:32:41 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-5906a847-ac9c-47c4-bb8a-1b0d012a4015 tempest-VolumesExtendTest-747499218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.559s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:32:41 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-5906a847-ac9c-47c4-bb8a-1b0d012a4015 tempest-VolumesExtendTest-747499218 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:32:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-59643234',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0df567fd-6905-45fa-bbae-1ecb119fc978,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3319e5ade4ff4c1a89995e89fb60888c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:32:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:32:38Z,use_quota=True,user_id='17f7740322ba424b8b8cef8781ca89cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:32:41 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-5906a847-ac9c-47c4-bb8a-1b0d012a4015 tempest-VolumesExtendTest-747499218 None] Creating volume 0df567fd-6905-45fa-bbae-1ecb119fc978 {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:32:41 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-5906a847-ac9c-47c4-bb8a-1b0d012a4015 tempest-VolumesExtendTest-747499218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:32:41 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-5906a847-ac9c-47c4-bb8a-1b0d012a4015 tempest-VolumesExtendTest-747499218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:32:41 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-5906a847-ac9c-47c4-bb8a-1b0d012a4015 tempest-VolumesExtendTest-747499218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:32:41 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-5906a847-ac9c-47c4-bb8a-1b0d012a4015 tempest-VolumesExtendTest-747499218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:32:41 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-5906a847-ac9c-47c4-bb8a-1b0d012a4015 tempest-VolumesExtendTest-747499218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:32:41 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-5906a847-ac9c-47c4-bb8a-1b0d012a4015 tempest-VolumesExtendTest-747499218 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:32:41 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-5906a847-ac9c-47c4-bb8a-1b0d012a4015 tempest-VolumesExtendTest-747499218 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:32:41 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-5906a847-ac9c-47c4-bb8a-1b0d012a4015 tempest-VolumesExtendTest-747499218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0df567fd-6905-45fa-bbae-1ecb119fc978 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:41 devstack sudo[100473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0df567fd-6905-45fa-bbae-1ecb119fc978 1073741824
Jul 30 20:32:41 devstack sudo[100473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:41 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-42cb5821-3f43-480d-ac25-18d7182e5959 tempest-SnapshotsActionsTest-570958061 None] Create snapshot completed successfully
Jul 30 20:32:41 devstack sudo[100473]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:41 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-5906a847-ac9c-47c4-bb8a-1b0d012a4015 tempest-VolumesExtendTest-747499218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0df567fd-6905-45fa-bbae-1ecb119fc978 1073741824" returned: 0 in 0.503s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:41 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-5906a847-ac9c-47c4-bb8a-1b0d012a4015 tempest-VolumesExtendTest-747499218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0df567fd-6905-45fa-bbae-1ecb119fc978 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:41 devstack sudo[100484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0df567fd-6905-45fa-bbae-1ecb119fc978
Jul 30 20:32:41 devstack sudo[100484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:42 devstack sudo[100484]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:42 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-5906a847-ac9c-47c4-bb8a-1b0d012a4015 tempest-VolumesExtendTest-747499218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0df567fd-6905-45fa-bbae-1ecb119fc978" returned: 0 in 0.361s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:42 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-5906a847-ac9c-47c4-bb8a-1b0d012a4015 tempest-VolumesExtendTest-747499218 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:32:42 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-5906a847-ac9c-47c4-bb8a-1b0d012a4015 tempest-VolumesExtendTest-747499218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:32:42 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-f460c7e2-427e-424f-b91a-270a3e7875c4 tempest-VolumesSnapshotListTestJSON-2060127140 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.644s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:32:42 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5906a847-ac9c-47c4-bb8a-1b0d012a4015 tempest-VolumesExtendTest-747499218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd0683e6-0b27-40bf-9025-5a3f0faeccdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0df567fd-6905-45fa-bbae-1ecb119fc978', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:32:42 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5906a847-ac9c-47c4-bb8a-1b0d012a4015 tempest-VolumesExtendTest-747499218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7233a1a-1a20-4a07-ad09-9658c2e1d629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:32:42 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-f460c7e2-427e-424f-b91a-270a3e7875c4 tempest-VolumesSnapshotListTestJSON-2060127140 None] Creating offline snapshot 4fa1992d-b163-47f8-94c7-e5d218d95851 of volume 2f73ee1f-ae3b-4535-ac0f-7a2205655901 {{(pid=88719) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 30 20:32:42 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-5906a847-ac9c-47c4-bb8a-1b0d012a4015 tempest-VolumesExtendTest-747499218 None] Volume volume-0df567fd-6905-45fa-bbae-1ecb119fc978 (0df567fd-6905-45fa-bbae-1ecb119fc978): created successfully
Jul 30 20:32:42 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5906a847-ac9c-47c4-bb8a-1b0d012a4015 tempest-VolumesExtendTest-747499218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7233a1a-1a20-4a07-ad09-9658c2e1d629) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:32:42 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5906a847-ac9c-47c4-bb8a-1b0d012a4015 tempest-VolumesExtendTest-747499218 None] Flow 'volume_create_manager' (6705887e-e7f2-434f-8351-a8e86b41ba09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:32:42 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[7097e189-4eab-4113-b72b-c08e5e1efb6b]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:32:42 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f460c7e2-427e-424f-b91a-270a3e7875c4 tempest-VolumesSnapshotListTestJSON-2060127140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:42 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-49729d70-5cc9-42c9-9be3-5c1ec773c943 tempest-SnapshotsActionsTest-570958061 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:32:42 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-5906a847-ac9c-47c4-bb8a-1b0d012a4015 tempest-VolumesExtendTest-747499218 None] Created volume successfully.
Jul 30 20:32:42 devstack sudo[100487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901
Jul 30 20:32:42 devstack sudo[100487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:42 devstack sudo[100487]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:42 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f460c7e2-427e-424f-b91a-270a3e7875c4 tempest-VolumesSnapshotListTestJSON-2060127140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901" returned: 0 in 0.513s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:42 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f460c7e2-427e-424f-b91a-270a3e7875c4 tempest-VolumesSnapshotListTestJSON-2060127140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901.4fa1992d-b163-47f8-94c7-e5d218d95851 1G {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:42 devstack sudo[100494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901.4fa1992d-b163-47f8-94c7-e5d218d95851 1G
Jul 30 20:32:42 devstack sudo[100494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:42 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-3acd5124-32f7-4203-ad52-f5a412e4a054 tempest-VolumesExtendTest-747499218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:32:43 devstack sudo[100494]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:43 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f460c7e2-427e-424f-b91a-270a3e7875c4 tempest-VolumesSnapshotListTestJSON-2060127140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901.4fa1992d-b163-47f8-94c7-e5d218d95851 1G" returned: 0 in 0.499s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:43 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f460c7e2-427e-424f-b91a-270a3e7875c4 tempest-VolumesSnapshotListTestJSON-2060127140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901 -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901.4fa1992d-b163-47f8-94c7-e5d218d95851 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:43 devstack sudo[100500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901 -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901.4fa1992d-b163-47f8-94c7-e5d218d95851
Jul 30 20:32:43 devstack sudo[100500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:43 devstack sudo[100500]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:43 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f460c7e2-427e-424f-b91a-270a3e7875c4 tempest-VolumesSnapshotListTestJSON-2060127140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901 -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901.4fa1992d-b163-47f8-94c7-e5d218d95851" returned: 0 in 0.342s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:43 devstack cinder-volume[88719]: WARNING cinder.volume.drivers.remotefs [None req-f460c7e2-427e-424f-b91a-270a3e7875c4 tempest-VolumesSnapshotListTestJSON-2060127140 None] /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901.4fa1992d-b163-47f8-94c7-e5d218d95851 is being set with open permissions: ugo+rw
Jul 30 20:32:43 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f460c7e2-427e-424f-b91a-270a3e7875c4 tempest-VolumesSnapshotListTestJSON-2060127140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901.4fa1992d-b163-47f8-94c7-e5d218d95851 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:43 devstack sudo[100506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901.4fa1992d-b163-47f8-94c7-e5d218d95851
Jul 30 20:32:43 devstack sudo[100506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:43 devstack sudo[100506]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:43 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f460c7e2-427e-424f-b91a-270a3e7875c4 tempest-VolumesSnapshotListTestJSON-2060127140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901.4fa1992d-b163-47f8-94c7-e5d218d95851" returned: 0 in 0.279s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:43 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f460c7e2-427e-424f-b91a-270a3e7875c4 tempest-VolumesSnapshotListTestJSON-2060127140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901.info {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:43 devstack sudo[100509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901.info
Jul 30 20:32:43 devstack sudo[100509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:44 devstack sudo[100509]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:44 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f460c7e2-427e-424f-b91a-270a3e7875c4 tempest-VolumesSnapshotListTestJSON-2060127140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901.info" returned: 0 in 0.297s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:44 devstack cinder-volume[88719]: WARNING cinder.volume.drivers.remotefs [None req-f460c7e2-427e-424f-b91a-270a3e7875c4 tempest-VolumesSnapshotListTestJSON-2060127140 None] /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901.info is being set with open permissions: ugo+rw
Jul 30 20:32:44 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f460c7e2-427e-424f-b91a-270a3e7875c4 tempest-VolumesSnapshotListTestJSON-2060127140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901.info {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:44 devstack sudo[100512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901.info
Jul 30 20:32:44 devstack sudo[100512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:44 devstack sudo[100512]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:44 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f460c7e2-427e-424f-b91a-270a3e7875c4 tempest-VolumesSnapshotListTestJSON-2060127140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901.info" returned: 0 in 0.304s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:44 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-f460c7e2-427e-424f-b91a-270a3e7875c4 tempest-VolumesSnapshotListTestJSON-2060127140 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.411s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:32:44 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-49729d70-5cc9-42c9-9be3-5c1ec773c943 tempest-SnapshotsActionsTest-570958061 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.292s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:32:44 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-49729d70-5cc9-42c9-9be3-5c1ec773c943 tempest-SnapshotsActionsTest-570958061 None] Creating offline snapshot 82a00d36-cd33-411b-a37e-9e5288679ac7 of volume 088699a2-98b7-48e0-986a-b14388fd3b58 {{(pid=88719) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 30 20:32:44 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-f460c7e2-427e-424f-b91a-270a3e7875c4 tempest-VolumesSnapshotListTestJSON-2060127140 None] Create snapshot completed successfully
Jul 30 20:32:44 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[841fc755-90b5-4f6b-9e61-ad9d9ad96838]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:32:44 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-49729d70-5cc9-42c9-9be3-5c1ec773c943 tempest-SnapshotsActionsTest-570958061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.d1f2643d-b07c-4a9d-b886-76c6d82a2f7e {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:44 devstack sudo[100516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.d1f2643d-b07c-4a9d-b886-76c6d82a2f7e
Jul 30 20:32:44 devstack sudo[100516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:45 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-56f91275-209e-447d-a08a-8b966a85d031 tempest-VolumesSnapshotListTestJSON-2060127140 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:32:45 devstack sudo[100516]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:45 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-49729d70-5cc9-42c9-9be3-5c1ec773c943 tempest-SnapshotsActionsTest-570958061 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.d1f2643d-b07c-4a9d-b886-76c6d82a2f7e" returned: 0 in 0.483s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:45 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-49729d70-5cc9-42c9-9be3-5c1ec773c943 tempest-SnapshotsActionsTest-570958061 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-088699a2-98b7-48e0-986a-b14388fd3b58(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88719) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 30 20:32:45 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-49729d70-5cc9-42c9-9be3-5c1ec773c943 tempest-SnapshotsActionsTest-570958061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.d1f2643d-b07c-4a9d-b886-76c6d82a2f7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.82a00d36-cd33-411b-a37e-9e5288679ac7 1G {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:45 devstack sudo[100523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.d1f2643d-b07c-4a9d-b886-76c6d82a2f7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.82a00d36-cd33-411b-a37e-9e5288679ac7 1G
Jul 30 20:32:45 devstack sudo[100523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:45 devstack sudo[100523]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:45 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-49729d70-5cc9-42c9-9be3-5c1ec773c943 tempest-SnapshotsActionsTest-570958061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.d1f2643d-b07c-4a9d-b886-76c6d82a2f7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.82a00d36-cd33-411b-a37e-9e5288679ac7 1G" returned: 0 in 0.462s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:45 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-49729d70-5cc9-42c9-9be3-5c1ec773c943 tempest-SnapshotsActionsTest-570958061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-088699a2-98b7-48e0-986a-b14388fd3b58.d1f2643d-b07c-4a9d-b886-76c6d82a2f7e -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.82a00d36-cd33-411b-a37e-9e5288679ac7 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:45 devstack sudo[100529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-088699a2-98b7-48e0-986a-b14388fd3b58.d1f2643d-b07c-4a9d-b886-76c6d82a2f7e -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.82a00d36-cd33-411b-a37e-9e5288679ac7
Jul 30 20:32:45 devstack sudo[100529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:45 devstack sudo[100529]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:45 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-49729d70-5cc9-42c9-9be3-5c1ec773c943 tempest-SnapshotsActionsTest-570958061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-088699a2-98b7-48e0-986a-b14388fd3b58.d1f2643d-b07c-4a9d-b886-76c6d82a2f7e -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.82a00d36-cd33-411b-a37e-9e5288679ac7" returned: 0 in 0.281s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:45 devstack cinder-volume[88719]: WARNING cinder.volume.drivers.remotefs [None req-49729d70-5cc9-42c9-9be3-5c1ec773c943 tempest-SnapshotsActionsTest-570958061 None] /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.82a00d36-cd33-411b-a37e-9e5288679ac7 is being set with open permissions: ugo+rw
Jul 30 20:32:45 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-49729d70-5cc9-42c9-9be3-5c1ec773c943 tempest-SnapshotsActionsTest-570958061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.82a00d36-cd33-411b-a37e-9e5288679ac7 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:45 devstack sudo[100534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.82a00d36-cd33-411b-a37e-9e5288679ac7
Jul 30 20:32:45 devstack sudo[100534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:46 devstack sudo[100534]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:46 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-49729d70-5cc9-42c9-9be3-5c1ec773c943 tempest-SnapshotsActionsTest-570958061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.82a00d36-cd33-411b-a37e-9e5288679ac7" returned: 0 in 0.272s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:46 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-49729d70-5cc9-42c9-9be3-5c1ec773c943 tempest-SnapshotsActionsTest-570958061 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.628s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:32:46 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-3acd5124-32f7-4203-ad52-f5a412e4a054 tempest-VolumesExtendTest-747499218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.240s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:32:46 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-3acd5124-32f7-4203-ad52-f5a412e4a054 tempest-VolumesExtendTest-747499218 None] Creating offline snapshot 1cb8feca-0c81-4027-a9ab-d2326dad9f2f of volume 0df567fd-6905-45fa-bbae-1ecb119fc978 {{(pid=88719) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 30 20:32:46 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-49729d70-5cc9-42c9-9be3-5c1ec773c943 tempest-SnapshotsActionsTest-570958061 None] Create snapshot completed successfully
Jul 30 20:32:46 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[333e9d48-8438-43fb-a2d9-bda2f4e59ffe]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:32:46 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3acd5124-32f7-4203-ad52-f5a412e4a054 tempest-VolumesExtendTest-747499218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0df567fd-6905-45fa-bbae-1ecb119fc978 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:46 devstack sudo[100537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0df567fd-6905-45fa-bbae-1ecb119fc978
Jul 30 20:32:46 devstack sudo[100537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:46 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-98821836-711b-4187-900a-e2cf530ed680 tempest-SnapshotsActionsTest-1490291241 None] Acquiring lock "cinder-82a00d36-cd33-411b-a37e-9e5288679ac7-delete_snapshot" by "delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:32:46 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-98821836-711b-4187-900a-e2cf530ed680 tempest-SnapshotsActionsTest-1490291241 None] Lock "cinder-82a00d36-cd33-411b-a37e-9e5288679ac7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:32:46 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-98821836-711b-4187-900a-e2cf530ed680 tempest-SnapshotsActionsTest-1490291241 None] Acquiring lock "cinder-quobyte-088699a2-98b7-48e0-986a-b14388fd3b58" by "delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:32:46 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-98821836-711b-4187-900a-e2cf530ed680 tempest-SnapshotsActionsTest-1490291241 None] Lock "cinder-quobyte-088699a2-98b7-48e0-986a-b14388fd3b58" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:32:46 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-98821836-711b-4187-900a-e2cf530ed680 tempest-SnapshotsActionsTest-1490291241 None] Acquiring lock "cinder-quobyte-82a00d36-cd33-411b-a37e-9e5288679ac7" by "_delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:32:46 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-98821836-711b-4187-900a-e2cf530ed680 tempest-SnapshotsActionsTest-1490291241 None] Lock "cinder-quobyte-82a00d36-cd33-411b-a37e-9e5288679ac7" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:32:46 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-98821836-711b-4187-900a-e2cf530ed680 tempest-SnapshotsActionsTest-1490291241 None] Deleting offline snapshot 82a00d36-cd33-411b-a37e-9e5288679ac7 of volume 088699a2-98b7-48e0-986a-b14388fd3b58 {{(pid=88719) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 30 20:32:46 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-98821836-711b-4187-900a-e2cf530ed680 tempest-SnapshotsActionsTest-1490291241 None] snapshot_file for this snap is: volume-088699a2-98b7-48e0-986a-b14388fd3b58.82a00d36-cd33-411b-a37e-9e5288679ac7 {{(pid=88719) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 30 20:32:46 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[92835ead-bcb0-4c65-820f-bf04936ec2cb]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:32:46 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-98821836-711b-4187-900a-e2cf530ed680 tempest-SnapshotsActionsTest-1490291241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.82a00d36-cd33-411b-a37e-9e5288679ac7 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:46 devstack sudo[100537]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:46 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3acd5124-32f7-4203-ad52-f5a412e4a054 tempest-VolumesExtendTest-747499218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0df567fd-6905-45fa-bbae-1ecb119fc978" returned: 0 in 0.423s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:46 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3acd5124-32f7-4203-ad52-f5a412e4a054 tempest-VolumesExtendTest-747499218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0df567fd-6905-45fa-bbae-1ecb119fc978,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0df567fd-6905-45fa-bbae-1ecb119fc978.1cb8feca-0c81-4027-a9ab-d2326dad9f2f 1G {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:46 devstack sudo[100543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0df567fd-6905-45fa-bbae-1ecb119fc978,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0df567fd-6905-45fa-bbae-1ecb119fc978.1cb8feca-0c81-4027-a9ab-d2326dad9f2f 1G
Jul 30 20:32:46 devstack sudo[100543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:46 devstack sudo[100542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.82a00d36-cd33-411b-a37e-9e5288679ac7
Jul 30 20:32:46 devstack sudo[100542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:46 devstack sudo[100542]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:46 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-98821836-711b-4187-900a-e2cf530ed680 tempest-SnapshotsActionsTest-1490291241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.82a00d36-cd33-411b-a37e-9e5288679ac7" returned: 0 in 0.419s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:46 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-98821836-711b-4187-900a-e2cf530ed680 tempest-SnapshotsActionsTest-1490291241 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-088699a2-98b7-48e0-986a-b14388fd3b58(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88719) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 30 20:32:47 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[34ebd769-0ee7-4e15-a6c7-0dea71fe0c10]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:32:47 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-98821836-711b-4187-900a-e2cf530ed680 tempest-SnapshotsActionsTest-1490291241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.d1f2643d-b07c-4a9d-b886-76c6d82a2f7e {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:47 devstack sudo[100543]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:47 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3acd5124-32f7-4203-ad52-f5a412e4a054 tempest-VolumesExtendTest-747499218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0df567fd-6905-45fa-bbae-1ecb119fc978,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0df567fd-6905-45fa-bbae-1ecb119fc978.1cb8feca-0c81-4027-a9ab-d2326dad9f2f 1G" returned: 0 in 0.518s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:47 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3acd5124-32f7-4203-ad52-f5a412e4a054 tempest-VolumesExtendTest-747499218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0df567fd-6905-45fa-bbae-1ecb119fc978 -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0df567fd-6905-45fa-bbae-1ecb119fc978.1cb8feca-0c81-4027-a9ab-d2326dad9f2f {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:47 devstack sudo[100555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0df567fd-6905-45fa-bbae-1ecb119fc978 -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0df567fd-6905-45fa-bbae-1ecb119fc978.1cb8feca-0c81-4027-a9ab-d2326dad9f2f
Jul 30 20:32:47 devstack sudo[100555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:47 devstack sudo[100554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.d1f2643d-b07c-4a9d-b886-76c6d82a2f7e
Jul 30 20:32:47 devstack sudo[100554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:47 devstack sudo[100554]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:47 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-98821836-711b-4187-900a-e2cf530ed680 tempest-SnapshotsActionsTest-1490291241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.d1f2643d-b07c-4a9d-b886-76c6d82a2f7e" returned: 0 in 0.361s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:47 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-98821836-711b-4187-900a-e2cf530ed680 tempest-SnapshotsActionsTest-1490291241 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-088699a2-98b7-48e0-986a-b14388fd3b58(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88719) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 30 20:32:47 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-98821836-711b-4187-900a-e2cf530ed680 tempest-SnapshotsActionsTest-1490291241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.82a00d36-cd33-411b-a37e-9e5288679ac7 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:47 devstack sudo[100555]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:47 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3acd5124-32f7-4203-ad52-f5a412e4a054 tempest-VolumesExtendTest-747499218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0df567fd-6905-45fa-bbae-1ecb119fc978 -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0df567fd-6905-45fa-bbae-1ecb119fc978.1cb8feca-0c81-4027-a9ab-d2326dad9f2f" returned: 0 in 0.308s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:47 devstack cinder-volume[88719]: WARNING cinder.volume.drivers.remotefs [None req-3acd5124-32f7-4203-ad52-f5a412e4a054 tempest-VolumesExtendTest-747499218 None] /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0df567fd-6905-45fa-bbae-1ecb119fc978.1cb8feca-0c81-4027-a9ab-d2326dad9f2f is being set with open permissions: ugo+rw
Jul 30 20:32:47 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3acd5124-32f7-4203-ad52-f5a412e4a054 tempest-VolumesExtendTest-747499218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0df567fd-6905-45fa-bbae-1ecb119fc978.1cb8feca-0c81-4027-a9ab-d2326dad9f2f {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:47 devstack sudo[100567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.82a00d36-cd33-411b-a37e-9e5288679ac7
Jul 30 20:32:47 devstack sudo[100567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:47 devstack sudo[100568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0df567fd-6905-45fa-bbae-1ecb119fc978.1cb8feca-0c81-4027-a9ab-d2326dad9f2f
Jul 30 20:32:47 devstack sudo[100568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:47 devstack sudo[100568]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:47 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3acd5124-32f7-4203-ad52-f5a412e4a054 tempest-VolumesExtendTest-747499218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0df567fd-6905-45fa-bbae-1ecb119fc978.1cb8feca-0c81-4027-a9ab-d2326dad9f2f" returned: 0 in 0.299s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:47 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3acd5124-32f7-4203-ad52-f5a412e4a054 tempest-VolumesExtendTest-747499218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0df567fd-6905-45fa-bbae-1ecb119fc978.info {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:47 devstack sudo[100575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0df567fd-6905-45fa-bbae-1ecb119fc978.info
Jul 30 20:32:47 devstack sudo[100575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:47 devstack sudo[100567]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:47 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-98821836-711b-4187-900a-e2cf530ed680 tempest-SnapshotsActionsTest-1490291241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.82a00d36-cd33-411b-a37e-9e5288679ac7" returned: 0 in 0.421s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:47 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-98821836-711b-4187-900a-e2cf530ed680 tempest-SnapshotsActionsTest-1490291241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.82a00d36-cd33-411b-a37e-9e5288679ac7 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:47 devstack sudo[100577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.82a00d36-cd33-411b-a37e-9e5288679ac7
Jul 30 20:32:47 devstack sudo[100577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:48 devstack sudo[100575]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:48 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3acd5124-32f7-4203-ad52-f5a412e4a054 tempest-VolumesExtendTest-747499218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0df567fd-6905-45fa-bbae-1ecb119fc978.info" returned: 0 in 0.276s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:48 devstack cinder-volume[88719]: WARNING cinder.volume.drivers.remotefs [None req-3acd5124-32f7-4203-ad52-f5a412e4a054 tempest-VolumesExtendTest-747499218 None] /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0df567fd-6905-45fa-bbae-1ecb119fc978.info is being set with open permissions: ugo+rw
Jul 30 20:32:48 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3acd5124-32f7-4203-ad52-f5a412e4a054 tempest-VolumesExtendTest-747499218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0df567fd-6905-45fa-bbae-1ecb119fc978.info {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:48 devstack sudo[100580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0df567fd-6905-45fa-bbae-1ecb119fc978.info
Jul 30 20:32:48 devstack sudo[100580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:48 devstack sudo[100577]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:48 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-98821836-711b-4187-900a-e2cf530ed680 tempest-SnapshotsActionsTest-1490291241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.82a00d36-cd33-411b-a37e-9e5288679ac7" returned: 0 in 0.299s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:48 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-98821836-711b-4187-900a-e2cf530ed680 tempest-SnapshotsActionsTest-1490291241 None] Lock "cinder-quobyte-82a00d36-cd33-411b-a37e-9e5288679ac7" released by "_delete_snapshot" :: held 1.643s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:32:48 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-98821836-711b-4187-900a-e2cf530ed680 tempest-SnapshotsActionsTest-1490291241 None] Lock "cinder-quobyte-088699a2-98b7-48e0-986a-b14388fd3b58" released by "delete_snapshot" :: held 1.674s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:32:48 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-98821836-711b-4187-900a-e2cf530ed680 tempest-SnapshotsActionsTest-1490291241 None] Created reservations ['43d9a199-f6b2-4f76-b656-9b09c04714fd', 'f08ad58f-81ba-47f1-8322-9a133ce50778', 'f90ef3a0-4494-4568-990b-84a41b89d83f', 'cb0ba33f-37da-464d-9a51-12886299fa5a'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:32:48 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-98821836-711b-4187-900a-e2cf530ed680 tempest-SnapshotsActionsTest-1490291241 None] Delete snapshot completed successfully.
Jul 30 20:32:48 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-98821836-711b-4187-900a-e2cf530ed680 tempest-SnapshotsActionsTest-1490291241 None] Lock "cinder-82a00d36-cd33-411b-a37e-9e5288679ac7-delete_snapshot" released by "delete_snapshot" :: held 1.836s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:32:48 devstack sudo[100580]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:48 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3acd5124-32f7-4203-ad52-f5a412e4a054 tempest-VolumesExtendTest-747499218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0df567fd-6905-45fa-bbae-1ecb119fc978.info" returned: 0 in 0.289s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:48 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-3acd5124-32f7-4203-ad52-f5a412e4a054 tempest-VolumesExtendTest-747499218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.226s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:32:48 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-56f91275-209e-447d-a08a-8b966a85d031 tempest-VolumesSnapshotListTestJSON-2060127140 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.324s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:32:48 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-56f91275-209e-447d-a08a-8b966a85d031 tempest-VolumesSnapshotListTestJSON-2060127140 None] Creating offline snapshot 9eb48b82-1f52-4682-bce1-d9dbea67dbf4 of volume 2f73ee1f-ae3b-4535-ac0f-7a2205655901 {{(pid=88719) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 30 20:32:48 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[7332cfeb-440a-4cec-a132-fe523eb80036]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:32:48 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-56f91275-209e-447d-a08a-8b966a85d031 tempest-VolumesSnapshotListTestJSON-2060127140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901.4fa1992d-b163-47f8-94c7-e5d218d95851 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:48 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-3acd5124-32f7-4203-ad52-f5a412e4a054 tempest-VolumesExtendTest-747499218 None] Create snapshot completed successfully
Jul 30 20:32:48 devstack sudo[100584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901.4fa1992d-b163-47f8-94c7-e5d218d95851
Jul 30 20:32:48 devstack sudo[100584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:48 devstack sudo[100584]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:48 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-56f91275-209e-447d-a08a-8b966a85d031 tempest-VolumesSnapshotListTestJSON-2060127140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901.4fa1992d-b163-47f8-94c7-e5d218d95851" returned: 0 in 0.400s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:48 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-56f91275-209e-447d-a08a-8b966a85d031 tempest-VolumesSnapshotListTestJSON-2060127140 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88719) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 30 20:32:48 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-56f91275-209e-447d-a08a-8b966a85d031 tempest-VolumesSnapshotListTestJSON-2060127140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901.4fa1992d-b163-47f8-94c7-e5d218d95851,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901.9eb48b82-1f52-4682-bce1-d9dbea67dbf4 1G {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:48 devstack sudo[100590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901.4fa1992d-b163-47f8-94c7-e5d218d95851,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901.9eb48b82-1f52-4682-bce1-d9dbea67dbf4 1G
Jul 30 20:32:48 devstack sudo[100590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:48 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-3b709306-34f0-40e0-af18-9282e68e8fb4 tempest-SnapshotsActionsTest-570958061 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:32:49 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-781848c1-52b3-4258-a0b3-9a83cbb391fc tempest-VolumesExtendTest-747499218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:32:49 devstack sudo[100590]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:49 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-56f91275-209e-447d-a08a-8b966a85d031 tempest-VolumesSnapshotListTestJSON-2060127140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901.4fa1992d-b163-47f8-94c7-e5d218d95851,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901.9eb48b82-1f52-4682-bce1-d9dbea67dbf4 1G" returned: 0 in 0.532s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:49 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-56f91275-209e-447d-a08a-8b966a85d031 tempest-VolumesSnapshotListTestJSON-2060127140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901.4fa1992d-b163-47f8-94c7-e5d218d95851 -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901.9eb48b82-1f52-4682-bce1-d9dbea67dbf4 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:49 devstack sudo[100597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901.4fa1992d-b163-47f8-94c7-e5d218d95851 -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901.9eb48b82-1f52-4682-bce1-d9dbea67dbf4
Jul 30 20:32:49 devstack sudo[100597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:49 devstack sudo[100597]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:49 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-56f91275-209e-447d-a08a-8b966a85d031 tempest-VolumesSnapshotListTestJSON-2060127140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901.4fa1992d-b163-47f8-94c7-e5d218d95851 -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901.9eb48b82-1f52-4682-bce1-d9dbea67dbf4" returned: 0 in 0.325s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:49 devstack cinder-volume[88719]: WARNING cinder.volume.drivers.remotefs [None req-56f91275-209e-447d-a08a-8b966a85d031 tempest-VolumesSnapshotListTestJSON-2060127140 None] /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901.9eb48b82-1f52-4682-bce1-d9dbea67dbf4 is being set with open permissions: ugo+rw
Jul 30 20:32:49 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-56f91275-209e-447d-a08a-8b966a85d031 tempest-VolumesSnapshotListTestJSON-2060127140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901.9eb48b82-1f52-4682-bce1-d9dbea67dbf4 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:49 devstack sudo[100602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901.9eb48b82-1f52-4682-bce1-d9dbea67dbf4
Jul 30 20:32:49 devstack sudo[100602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:49 devstack sudo[100602]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:49 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-56f91275-209e-447d-a08a-8b966a85d031 tempest-VolumesSnapshotListTestJSON-2060127140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901.9eb48b82-1f52-4682-bce1-d9dbea67dbf4" returned: 0 in 0.246s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:49 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-56f91275-209e-447d-a08a-8b966a85d031 tempest-VolumesSnapshotListTestJSON-2060127140 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.606s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:32:49 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-3b709306-34f0-40e0-af18-9282e68e8fb4 tempest-SnapshotsActionsTest-570958061 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.986s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:32:49 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-3b709306-34f0-40e0-af18-9282e68e8fb4 tempest-SnapshotsActionsTest-570958061 None] Creating offline snapshot 74215591-cbc1-4574-b4e7-1a35bd0bf106 of volume 088699a2-98b7-48e0-986a-b14388fd3b58 {{(pid=88719) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 30 20:32:50 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-56f91275-209e-447d-a08a-8b966a85d031 tempest-VolumesSnapshotListTestJSON-2060127140 None] Create snapshot completed successfully
Jul 30 20:32:50 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4dca28a-68a0-4a9a-ae3d-5d2078f65647]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:32:50 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3b709306-34f0-40e0-af18-9282e68e8fb4 tempest-SnapshotsActionsTest-570958061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.d1f2643d-b07c-4a9d-b886-76c6d82a2f7e {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:50 devstack sudo[100605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.d1f2643d-b07c-4a9d-b886-76c6d82a2f7e
Jul 30 20:32:50 devstack sudo[100605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:50 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-994bf429-3203-455c-bb86-4fe0bf7a5e36 tempest-VolumesSnapshotListTestJSON-2060127140 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:32:50 devstack sudo[100605]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:50 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3b709306-34f0-40e0-af18-9282e68e8fb4 tempest-SnapshotsActionsTest-570958061 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.d1f2643d-b07c-4a9d-b886-76c6d82a2f7e" returned: 0 in 0.447s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:50 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-3b709306-34f0-40e0-af18-9282e68e8fb4 tempest-SnapshotsActionsTest-570958061 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-088699a2-98b7-48e0-986a-b14388fd3b58(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88719) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 30 20:32:50 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3b709306-34f0-40e0-af18-9282e68e8fb4 tempest-SnapshotsActionsTest-570958061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.d1f2643d-b07c-4a9d-b886-76c6d82a2f7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.74215591-cbc1-4574-b4e7-1a35bd0bf106 1G {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:50 devstack sudo[100610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.d1f2643d-b07c-4a9d-b886-76c6d82a2f7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.74215591-cbc1-4574-b4e7-1a35bd0bf106 1G
Jul 30 20:32:50 devstack sudo[100610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:50 devstack sudo[100610]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:50 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3b709306-34f0-40e0-af18-9282e68e8fb4 tempest-SnapshotsActionsTest-570958061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.d1f2643d-b07c-4a9d-b886-76c6d82a2f7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.74215591-cbc1-4574-b4e7-1a35bd0bf106 1G" returned: 0 in 0.424s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:50 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3b709306-34f0-40e0-af18-9282e68e8fb4 tempest-SnapshotsActionsTest-570958061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-088699a2-98b7-48e0-986a-b14388fd3b58.d1f2643d-b07c-4a9d-b886-76c6d82a2f7e -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.74215591-cbc1-4574-b4e7-1a35bd0bf106 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:50 devstack sudo[100615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-088699a2-98b7-48e0-986a-b14388fd3b58.d1f2643d-b07c-4a9d-b886-76c6d82a2f7e -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.74215591-cbc1-4574-b4e7-1a35bd0bf106
Jul 30 20:32:50 devstack sudo[100615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:51 devstack sudo[100615]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:51 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3b709306-34f0-40e0-af18-9282e68e8fb4 tempest-SnapshotsActionsTest-570958061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-088699a2-98b7-48e0-986a-b14388fd3b58.d1f2643d-b07c-4a9d-b886-76c6d82a2f7e -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.74215591-cbc1-4574-b4e7-1a35bd0bf106" returned: 0 in 0.305s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:51 devstack cinder-volume[88719]: WARNING cinder.volume.drivers.remotefs [None req-3b709306-34f0-40e0-af18-9282e68e8fb4 tempest-SnapshotsActionsTest-570958061 None] /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.74215591-cbc1-4574-b4e7-1a35bd0bf106 is being set with open permissions: ugo+rw
Jul 30 20:32:51 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3b709306-34f0-40e0-af18-9282e68e8fb4 tempest-SnapshotsActionsTest-570958061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.74215591-cbc1-4574-b4e7-1a35bd0bf106 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:51 devstack sudo[100620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.74215591-cbc1-4574-b4e7-1a35bd0bf106
Jul 30 20:32:51 devstack sudo[100620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:51 devstack sudo[100620]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:51 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3b709306-34f0-40e0-af18-9282e68e8fb4 tempest-SnapshotsActionsTest-570958061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.74215591-cbc1-4574-b4e7-1a35bd0bf106" returned: 0 in 0.253s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:51 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-3b709306-34f0-40e0-af18-9282e68e8fb4 tempest-SnapshotsActionsTest-570958061 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.557s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:32:51 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-781848c1-52b3-4258-a0b3-9a83cbb391fc tempest-VolumesExtendTest-747499218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 2.203s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:32:51 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfed248d-27e2-461c-91f5-cd58ce68d548]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:32:51 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-781848c1-52b3-4258-a0b3-9a83cbb391fc tempest-VolumesExtendTest-747499218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0df567fd-6905-45fa-bbae-1ecb119fc978 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:51 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-3b709306-34f0-40e0-af18-9282e68e8fb4 tempest-SnapshotsActionsTest-570958061 None] Create snapshot completed successfully
Jul 30 20:32:51 devstack sudo[100623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0df567fd-6905-45fa-bbae-1ecb119fc978
Jul 30 20:32:51 devstack sudo[100623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:51 devstack sudo[100623]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:51 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-781848c1-52b3-4258-a0b3-9a83cbb391fc tempest-VolumesExtendTest-747499218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0df567fd-6905-45fa-bbae-1ecb119fc978" returned: 0 in 0.386s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:51 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-781848c1-52b3-4258-a0b3-9a83cbb391fc tempest-VolumesExtendTest-747499218 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0df567fd-6905-45fa-bbae-1ecb119fc978.1cb8feca-0c81-4027-a9ab-d2326dad9f2f 2G {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:52 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-781848c1-52b3-4258-a0b3-9a83cbb391fc tempest-VolumesExtendTest-747499218 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0df567fd-6905-45fa-bbae-1ecb119fc978.1cb8feca-0c81-4027-a9ab-d2326dad9f2f 2G" returned: 0 in 0.139s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:52 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-781848c1-52b3-4258-a0b3-9a83cbb391fc tempest-VolumesExtendTest-747499218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.565s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:32:52 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-994bf429-3203-455c-bb86-4fe0bf7a5e36 tempest-VolumesSnapshotListTestJSON-2060127140 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.611s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:32:52 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-994bf429-3203-455c-bb86-4fe0bf7a5e36 tempest-VolumesSnapshotListTestJSON-2060127140 None] Creating offline snapshot d6c44c84-44cf-4293-9648-2523282fa185 of volume 2f73ee1f-ae3b-4535-ac0f-7a2205655901 {{(pid=88719) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 30 20:32:52 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe85d6a0-0abc-49de-ab6e-f30a53c385c8]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:32:52 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-994bf429-3203-455c-bb86-4fe0bf7a5e36 tempest-VolumesSnapshotListTestJSON-2060127140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901.9eb48b82-1f52-4682-bce1-d9dbea67dbf4 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:52 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-781848c1-52b3-4258-a0b3-9a83cbb391fc tempest-VolumesExtendTest-747499218 None] Extend volume completed successfully.
Jul 30 20:32:52 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-b6f3d204-d6ec-4007-8753-32202ff4562e tempest-SnapshotsActionsTest-1490291241 None] Acquiring lock "cinder-74215591-cbc1-4574-b4e7-1a35bd0bf106-delete_snapshot" by "delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:32:52 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-b6f3d204-d6ec-4007-8753-32202ff4562e tempest-SnapshotsActionsTest-1490291241 None] Lock "cinder-74215591-cbc1-4574-b4e7-1a35bd0bf106-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:32:52 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-b6f3d204-d6ec-4007-8753-32202ff4562e tempest-SnapshotsActionsTest-1490291241 None] Acquiring lock "cinder-quobyte-088699a2-98b7-48e0-986a-b14388fd3b58" by "delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:32:52 devstack sudo[100631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901.9eb48b82-1f52-4682-bce1-d9dbea67dbf4
Jul 30 20:32:52 devstack sudo[100631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:52 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-b6f3d204-d6ec-4007-8753-32202ff4562e tempest-SnapshotsActionsTest-1490291241 None] Lock "cinder-quobyte-088699a2-98b7-48e0-986a-b14388fd3b58" acquired by "delete_snapshot" :: waited 0.037s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:32:52 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-b6f3d204-d6ec-4007-8753-32202ff4562e tempest-SnapshotsActionsTest-1490291241 None] Acquiring lock "cinder-quobyte-74215591-cbc1-4574-b4e7-1a35bd0bf106" by "_delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:32:52 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-b6f3d204-d6ec-4007-8753-32202ff4562e tempest-SnapshotsActionsTest-1490291241 None] Lock "cinder-quobyte-74215591-cbc1-4574-b4e7-1a35bd0bf106" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:32:52 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-b6f3d204-d6ec-4007-8753-32202ff4562e tempest-SnapshotsActionsTest-1490291241 None] Deleting offline snapshot 74215591-cbc1-4574-b4e7-1a35bd0bf106 of volume 088699a2-98b7-48e0-986a-b14388fd3b58 {{(pid=88719) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 30 20:32:52 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-b6f3d204-d6ec-4007-8753-32202ff4562e tempest-SnapshotsActionsTest-1490291241 None] snapshot_file for this snap is: volume-088699a2-98b7-48e0-986a-b14388fd3b58.74215591-cbc1-4574-b4e7-1a35bd0bf106 {{(pid=88719) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 30 20:32:52 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[f417eeb8-3121-4dcb-a095-b7839aed091c]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:32:52 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-b6f3d204-d6ec-4007-8753-32202ff4562e tempest-SnapshotsActionsTest-1490291241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.74215591-cbc1-4574-b4e7-1a35bd0bf106 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:52 devstack sudo[100633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.74215591-cbc1-4574-b4e7-1a35bd0bf106
Jul 30 20:32:52 devstack sudo[100633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:52 devstack sudo[100631]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:52 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-994bf429-3203-455c-bb86-4fe0bf7a5e36 tempest-VolumesSnapshotListTestJSON-2060127140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901.9eb48b82-1f52-4682-bce1-d9dbea67dbf4" returned: 0 in 0.421s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:52 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-994bf429-3203-455c-bb86-4fe0bf7a5e36 tempest-VolumesSnapshotListTestJSON-2060127140 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88719) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 30 20:32:52 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-994bf429-3203-455c-bb86-4fe0bf7a5e36 tempest-VolumesSnapshotListTestJSON-2060127140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901.9eb48b82-1f52-4682-bce1-d9dbea67dbf4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901.d6c44c84-44cf-4293-9648-2523282fa185 1G {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:52 devstack sudo[100638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901.9eb48b82-1f52-4682-bce1-d9dbea67dbf4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901.d6c44c84-44cf-4293-9648-2523282fa185 1G
Jul 30 20:32:52 devstack sudo[100638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:52 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-b3063f96-d890-4820-8246-348fe3ce9319 tempest-VolumesExtendTest-747499218 None] Acquiring lock "cinder-1cb8feca-0c81-4027-a9ab-d2326dad9f2f-delete_snapshot" by "delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:32:52 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-b3063f96-d890-4820-8246-348fe3ce9319 tempest-VolumesExtendTest-747499218 None] Lock "cinder-1cb8feca-0c81-4027-a9ab-d2326dad9f2f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:32:52 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-b3063f96-d890-4820-8246-348fe3ce9319 tempest-VolumesExtendTest-747499218 None] Acquiring lock "cinder-quobyte-0df567fd-6905-45fa-bbae-1ecb119fc978" by "delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:32:52 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-b3063f96-d890-4820-8246-348fe3ce9319 tempest-VolumesExtendTest-747499218 None] Lock "cinder-quobyte-0df567fd-6905-45fa-bbae-1ecb119fc978" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:32:52 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-b3063f96-d890-4820-8246-348fe3ce9319 tempest-VolumesExtendTest-747499218 None] Acquiring lock "cinder-quobyte-1cb8feca-0c81-4027-a9ab-d2326dad9f2f" by "_delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:32:52 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-b3063f96-d890-4820-8246-348fe3ce9319 tempest-VolumesExtendTest-747499218 None] Lock "cinder-quobyte-1cb8feca-0c81-4027-a9ab-d2326dad9f2f" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:32:52 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-b3063f96-d890-4820-8246-348fe3ce9319 tempest-VolumesExtendTest-747499218 None] Deleting offline snapshot 1cb8feca-0c81-4027-a9ab-d2326dad9f2f of volume 0df567fd-6905-45fa-bbae-1ecb119fc978 {{(pid=88719) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 30 20:32:52 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-b3063f96-d890-4820-8246-348fe3ce9319 tempest-VolumesExtendTest-747499218 None] snapshot_file for this snap is: volume-0df567fd-6905-45fa-bbae-1ecb119fc978.1cb8feca-0c81-4027-a9ab-d2326dad9f2f {{(pid=88719) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 30 20:32:52 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a3b41d9-d05f-4245-bfbb-fe9994757abe]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:32:52 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-b3063f96-d890-4820-8246-348fe3ce9319 tempest-VolumesExtendTest-747499218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0df567fd-6905-45fa-bbae-1ecb119fc978.1cb8feca-0c81-4027-a9ab-d2326dad9f2f {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:52 devstack sudo[100633]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:52 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-b6f3d204-d6ec-4007-8753-32202ff4562e tempest-SnapshotsActionsTest-1490291241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.74215591-cbc1-4574-b4e7-1a35bd0bf106" returned: 0 in 0.508s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:52 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-b6f3d204-d6ec-4007-8753-32202ff4562e tempest-SnapshotsActionsTest-1490291241 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-088699a2-98b7-48e0-986a-b14388fd3b58(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88719) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 30 20:32:52 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[abb98114-f619-437e-96a9-1c5dd8e7a685]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:32:52 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-b6f3d204-d6ec-4007-8753-32202ff4562e tempest-SnapshotsActionsTest-1490291241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.d1f2643d-b07c-4a9d-b886-76c6d82a2f7e {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:52 devstack sudo[100643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0df567fd-6905-45fa-bbae-1ecb119fc978.1cb8feca-0c81-4027-a9ab-d2326dad9f2f
Jul 30 20:32:52 devstack sudo[100643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:53 devstack sudo[100645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.d1f2643d-b07c-4a9d-b886-76c6d82a2f7e
Jul 30 20:32:53 devstack sudo[100645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:53 devstack sudo[100638]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:53 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-994bf429-3203-455c-bb86-4fe0bf7a5e36 tempest-VolumesSnapshotListTestJSON-2060127140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901.9eb48b82-1f52-4682-bce1-d9dbea67dbf4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901.d6c44c84-44cf-4293-9648-2523282fa185 1G" returned: 0 in 0.633s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:53 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-994bf429-3203-455c-bb86-4fe0bf7a5e36 tempest-VolumesSnapshotListTestJSON-2060127140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901.9eb48b82-1f52-4682-bce1-d9dbea67dbf4 -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901.d6c44c84-44cf-4293-9648-2523282fa185 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:53 devstack sudo[100654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901.9eb48b82-1f52-4682-bce1-d9dbea67dbf4 -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901.d6c44c84-44cf-4293-9648-2523282fa185
Jul 30 20:32:53 devstack sudo[100654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:53 devstack sudo[100643]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:53 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-b3063f96-d890-4820-8246-348fe3ce9319 tempest-VolumesExtendTest-747499218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0df567fd-6905-45fa-bbae-1ecb119fc978.1cb8feca-0c81-4027-a9ab-d2326dad9f2f" returned: 0 in 0.436s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:53 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-b3063f96-d890-4820-8246-348fe3ce9319 tempest-VolumesExtendTest-747499218 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0df567fd-6905-45fa-bbae-1ecb119fc978(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88719) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 30 20:32:53 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[a30a4069-c5f1-4879-ab9a-4f4e26da21fc]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:32:53 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-b3063f96-d890-4820-8246-348fe3ce9319 tempest-VolumesExtendTest-747499218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0df567fd-6905-45fa-bbae-1ecb119fc978 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:53 devstack sudo[100645]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:53 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-b6f3d204-d6ec-4007-8753-32202ff4562e tempest-SnapshotsActionsTest-1490291241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.d1f2643d-b07c-4a9d-b886-76c6d82a2f7e" returned: 0 in 0.438s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:53 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-b6f3d204-d6ec-4007-8753-32202ff4562e tempest-SnapshotsActionsTest-1490291241 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-088699a2-98b7-48e0-986a-b14388fd3b58(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88719) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 30 20:32:53 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-b6f3d204-d6ec-4007-8753-32202ff4562e tempest-SnapshotsActionsTest-1490291241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.74215591-cbc1-4574-b4e7-1a35bd0bf106 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:53 devstack sudo[100663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.74215591-cbc1-4574-b4e7-1a35bd0bf106
Jul 30 20:32:53 devstack sudo[100663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:53 devstack sudo[100662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0df567fd-6905-45fa-bbae-1ecb119fc978
Jul 30 20:32:53 devstack sudo[100662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:53 devstack sudo[100654]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:53 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-994bf429-3203-455c-bb86-4fe0bf7a5e36 tempest-VolumesSnapshotListTestJSON-2060127140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901.9eb48b82-1f52-4682-bce1-d9dbea67dbf4 -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901.d6c44c84-44cf-4293-9648-2523282fa185" returned: 0 in 0.426s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:53 devstack cinder-volume[88719]: WARNING cinder.volume.drivers.remotefs [None req-994bf429-3203-455c-bb86-4fe0bf7a5e36 tempest-VolumesSnapshotListTestJSON-2060127140 None] /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901.d6c44c84-44cf-4293-9648-2523282fa185 is being set with open permissions: ugo+rw
Jul 30 20:32:53 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-994bf429-3203-455c-bb86-4fe0bf7a5e36 tempest-VolumesSnapshotListTestJSON-2060127140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901.d6c44c84-44cf-4293-9648-2523282fa185 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:53 devstack sudo[100672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901.d6c44c84-44cf-4293-9648-2523282fa185
Jul 30 20:32:53 devstack sudo[100672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:53 devstack sudo[100662]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:53 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-b3063f96-d890-4820-8246-348fe3ce9319 tempest-VolumesExtendTest-747499218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0df567fd-6905-45fa-bbae-1ecb119fc978" returned: 0 in 0.469s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:53 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-b3063f96-d890-4820-8246-348fe3ce9319 tempest-VolumesExtendTest-747499218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0df567fd-6905-45fa-bbae-1ecb119fc978.1cb8feca-0c81-4027-a9ab-d2326dad9f2f {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:53 devstack sudo[100695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0df567fd-6905-45fa-bbae-1ecb119fc978.1cb8feca-0c81-4027-a9ab-d2326dad9f2f
Jul 30 20:32:53 devstack sudo[100695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:53 devstack sudo[100663]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:53 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-b6f3d204-d6ec-4007-8753-32202ff4562e tempest-SnapshotsActionsTest-1490291241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.74215591-cbc1-4574-b4e7-1a35bd0bf106" returned: 0 in 0.565s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:53 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-b6f3d204-d6ec-4007-8753-32202ff4562e tempest-SnapshotsActionsTest-1490291241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.74215591-cbc1-4574-b4e7-1a35bd0bf106 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:53 devstack sudo[100698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.74215591-cbc1-4574-b4e7-1a35bd0bf106
Jul 30 20:32:53 devstack sudo[100698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:53 devstack sudo[100672]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:53 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-994bf429-3203-455c-bb86-4fe0bf7a5e36 tempest-VolumesSnapshotListTestJSON-2060127140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901.d6c44c84-44cf-4293-9648-2523282fa185" returned: 0 in 0.341s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:54 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-994bf429-3203-455c-bb86-4fe0bf7a5e36 tempest-VolumesSnapshotListTestJSON-2060127140 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.956s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:32:54 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-994bf429-3203-455c-bb86-4fe0bf7a5e36 tempest-VolumesSnapshotListTestJSON-2060127140 None] Create snapshot completed successfully
Jul 30 20:32:54 devstack sudo[100698]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:54 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-b6f3d204-d6ec-4007-8753-32202ff4562e tempest-SnapshotsActionsTest-1490291241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.74215591-cbc1-4574-b4e7-1a35bd0bf106" returned: 0 in 0.288s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:54 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-b6f3d204-d6ec-4007-8753-32202ff4562e tempest-SnapshotsActionsTest-1490291241 None] Lock "cinder-quobyte-74215591-cbc1-4574-b4e7-1a35bd0bf106" released by "_delete_snapshot" :: held 1.909s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:32:54 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-b6f3d204-d6ec-4007-8753-32202ff4562e tempest-SnapshotsActionsTest-1490291241 None] Lock "cinder-quobyte-088699a2-98b7-48e0-986a-b14388fd3b58" released by "delete_snapshot" :: held 1.935s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:32:54 devstack sudo[100695]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:54 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-b3063f96-d890-4820-8246-348fe3ce9319 tempest-VolumesExtendTest-747499218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0df567fd-6905-45fa-bbae-1ecb119fc978.1cb8feca-0c81-4027-a9ab-d2326dad9f2f" returned: 0 in 0.458s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:54 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-b3063f96-d890-4820-8246-348fe3ce9319 tempest-VolumesExtendTest-747499218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0df567fd-6905-45fa-bbae-1ecb119fc978.1cb8feca-0c81-4027-a9ab-d2326dad9f2f {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:54 devstack sudo[100704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0df567fd-6905-45fa-bbae-1ecb119fc978.1cb8feca-0c81-4027-a9ab-d2326dad9f2f
Jul 30 20:32:54 devstack sudo[100704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:54 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-b6f3d204-d6ec-4007-8753-32202ff4562e tempest-SnapshotsActionsTest-1490291241 None] Created reservations ['b6bac683-7783-4ab0-b988-1745db46bce3', '4cac49fb-bdea-4c15-9ce7-9ced4c729b8d', '448c7b0d-219f-4900-a635-707850b0be74', 'deb15d42-4ed7-4600-89ae-a97e9396d8e7'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:32:54 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-b6f3d204-d6ec-4007-8753-32202ff4562e tempest-SnapshotsActionsTest-1490291241 None] Delete snapshot completed successfully.
Jul 30 20:32:54 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-b6f3d204-d6ec-4007-8753-32202ff4562e tempest-SnapshotsActionsTest-1490291241 None] Lock "cinder-74215591-cbc1-4574-b4e7-1a35bd0bf106-delete_snapshot" released by "delete_snapshot" :: held 2.109s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:32:54 devstack sudo[100704]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:54 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-b3063f96-d890-4820-8246-348fe3ce9319 tempest-VolumesExtendTest-747499218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0df567fd-6905-45fa-bbae-1ecb119fc978.1cb8feca-0c81-4027-a9ab-d2326dad9f2f" returned: 0 in 0.278s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:54 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-b3063f96-d890-4820-8246-348fe3ce9319 tempest-VolumesExtendTest-747499218 None] Lock "cinder-quobyte-1cb8feca-0c81-4027-a9ab-d2326dad9f2f" released by "_delete_snapshot" :: held 1.772s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:32:54 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-b3063f96-d890-4820-8246-348fe3ce9319 tempest-VolumesExtendTest-747499218 None] Lock "cinder-quobyte-0df567fd-6905-45fa-bbae-1ecb119fc978" released by "delete_snapshot" :: held 1.802s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:32:54 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-b3063f96-d890-4820-8246-348fe3ce9319 tempest-VolumesExtendTest-747499218 None] Created reservations ['cfaec260-316d-42e7-9253-9682bc15580f', '5b2a9909-e906-4b76-8834-faae2751e857', 'fa916d42-ffcf-483b-80ce-fb0a052495f1', '837ef267-6ebb-49a9-99f4-4af82edc1a38'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:32:54 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-b3063f96-d890-4820-8246-348fe3ce9319 tempest-VolumesExtendTest-747499218 None] Delete snapshot completed successfully.
Jul 30 20:32:54 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-b3063f96-d890-4820-8246-348fe3ce9319 tempest-VolumesExtendTest-747499218 None] Lock "cinder-1cb8feca-0c81-4027-a9ab-d2326dad9f2f-delete_snapshot" released by "delete_snapshot" :: held 2.039s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:32:54 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-e02a31cd-bb4d-4c20-b228-302f61c660c4 tempest-SnapshotsActionsTest-570958061 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:32:54 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-e02a31cd-bb4d-4c20-b228-302f61c660c4 tempest-SnapshotsActionsTest-570958061 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:32:54 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-e02a31cd-bb4d-4c20-b228-302f61c660c4 tempest-SnapshotsActionsTest-570958061 None] Creating offline snapshot dff15be7-5e95-49cf-83a7-84fc966e44ba of volume 088699a2-98b7-48e0-986a-b14388fd3b58 {{(pid=88719) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 30 20:32:54 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8fd5035-3291-4ff4-847f-a046938c8138]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:32:55 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-e02a31cd-bb4d-4c20-b228-302f61c660c4 tempest-SnapshotsActionsTest-570958061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.d1f2643d-b07c-4a9d-b886-76c6d82a2f7e {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:55 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-7ae3e6f5-4723-491b-80e6-411fceacfd9f tempest-VolumesExtendTest-747499218 None] Acquiring lock "cinder-0df567fd-6905-45fa-bbae-1ecb119fc978-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:32:55 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-7ae3e6f5-4723-491b-80e6-411fceacfd9f tempest-VolumesExtendTest-747499218 None] Lock "cinder-0df567fd-6905-45fa-bbae-1ecb119fc978-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:32:55 devstack sudo[100708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.d1f2643d-b07c-4a9d-b886-76c6d82a2f7e
Jul 30 20:32:55 devstack sudo[100708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:55 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-7ae3e6f5-4723-491b-80e6-411fceacfd9f tempest-VolumesExtendTest-747499218 None] Acquiring lock "cinder-quobyte-0df567fd-6905-45fa-bbae-1ecb119fc978" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:32:55 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-7ae3e6f5-4723-491b-80e6-411fceacfd9f tempest-VolumesExtendTest-747499218 None] Lock "cinder-quobyte-0df567fd-6905-45fa-bbae-1ecb119fc978" acquired by "delete_volume" :: waited 0.018s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:32:55 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[116d08ed-6ffd-4602-8a2b-5608389a65d8]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:32:55 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-7ae3e6f5-4723-491b-80e6-411fceacfd9f tempest-VolumesExtendTest-747499218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0df567fd-6905-45fa-bbae-1ecb119fc978 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:55 devstack sudo[100710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0df567fd-6905-45fa-bbae-1ecb119fc978
Jul 30 20:32:55 devstack sudo[100710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:55 devstack sudo[100708]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:55 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-e02a31cd-bb4d-4c20-b228-302f61c660c4 tempest-SnapshotsActionsTest-570958061 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.d1f2643d-b07c-4a9d-b886-76c6d82a2f7e" returned: 0 in 0.448s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:55 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-e02a31cd-bb4d-4c20-b228-302f61c660c4 tempest-SnapshotsActionsTest-570958061 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-088699a2-98b7-48e0-986a-b14388fd3b58(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88719) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 30 20:32:55 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-e02a31cd-bb4d-4c20-b228-302f61c660c4 tempest-SnapshotsActionsTest-570958061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.d1f2643d-b07c-4a9d-b886-76c6d82a2f7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.dff15be7-5e95-49cf-83a7-84fc966e44ba 1G {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:55 devstack sudo[100715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.d1f2643d-b07c-4a9d-b886-76c6d82a2f7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.dff15be7-5e95-49cf-83a7-84fc966e44ba 1G
Jul 30 20:32:55 devstack sudo[100715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:55 devstack sudo[100710]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:55 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-7ae3e6f5-4723-491b-80e6-411fceacfd9f tempest-VolumesExtendTest-747499218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0df567fd-6905-45fa-bbae-1ecb119fc978" returned: 0 in 0.413s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:55 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-7ae3e6f5-4723-491b-80e6-411fceacfd9f tempest-VolumesExtendTest-747499218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0df567fd-6905-45fa-bbae-1ecb119fc978 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:55 devstack sudo[100720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0df567fd-6905-45fa-bbae-1ecb119fc978
Jul 30 20:32:55 devstack sudo[100720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:55 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-210a8222-9357-41dd-b10d-87981f8fa1a3 tempest-VolumesSnapshotListTestJSON-2060127140 None] Acquiring lock "cinder-d6c44c84-44cf-4293-9648-2523282fa185-delete_snapshot" by "delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:32:55 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-210a8222-9357-41dd-b10d-87981f8fa1a3 tempest-VolumesSnapshotListTestJSON-2060127140 None] Lock "cinder-d6c44c84-44cf-4293-9648-2523282fa185-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:32:55 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-210a8222-9357-41dd-b10d-87981f8fa1a3 tempest-VolumesSnapshotListTestJSON-2060127140 None] Acquiring lock "cinder-quobyte-2f73ee1f-ae3b-4535-ac0f-7a2205655901" by "delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:32:55 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-210a8222-9357-41dd-b10d-87981f8fa1a3 tempest-VolumesSnapshotListTestJSON-2060127140 None] Lock "cinder-quobyte-2f73ee1f-ae3b-4535-ac0f-7a2205655901" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:32:55 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-210a8222-9357-41dd-b10d-87981f8fa1a3 tempest-VolumesSnapshotListTestJSON-2060127140 None] Acquiring lock "cinder-quobyte-d6c44c84-44cf-4293-9648-2523282fa185" by "_delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:32:55 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-210a8222-9357-41dd-b10d-87981f8fa1a3 tempest-VolumesSnapshotListTestJSON-2060127140 None] Lock "cinder-quobyte-d6c44c84-44cf-4293-9648-2523282fa185" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:32:55 devstack sudo[100720]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:55 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-210a8222-9357-41dd-b10d-87981f8fa1a3 tempest-VolumesSnapshotListTestJSON-2060127140 None] Deleting offline snapshot d6c44c84-44cf-4293-9648-2523282fa185 of volume 2f73ee1f-ae3b-4535-ac0f-7a2205655901 {{(pid=88719) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 30 20:32:55 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-210a8222-9357-41dd-b10d-87981f8fa1a3 tempest-VolumesSnapshotListTestJSON-2060127140 None] snapshot_file for this snap is: volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901.d6c44c84-44cf-4293-9648-2523282fa185 {{(pid=88719) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 30 20:32:55 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-7ae3e6f5-4723-491b-80e6-411fceacfd9f tempest-VolumesExtendTest-747499218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0df567fd-6905-45fa-bbae-1ecb119fc978" returned: 0 in 0.300s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:55 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8eebf8b-ac83-4852-a1e0-36b50d77ed5e]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:32:55 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-210a8222-9357-41dd-b10d-87981f8fa1a3 tempest-VolumesSnapshotListTestJSON-2060127140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901.d6c44c84-44cf-4293-9648-2523282fa185 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:55 devstack sudo[100715]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:55 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-7ae3e6f5-4723-491b-80e6-411fceacfd9f tempest-VolumesExtendTest-747499218 None] Lock "cinder-quobyte-0df567fd-6905-45fa-bbae-1ecb119fc978" released by "delete_volume" :: held 0.800s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:32:55 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-e02a31cd-bb4d-4c20-b228-302f61c660c4 tempest-SnapshotsActionsTest-570958061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.d1f2643d-b07c-4a9d-b886-76c6d82a2f7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.dff15be7-5e95-49cf-83a7-84fc966e44ba 1G" returned: 0 in 0.518s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:55 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-e02a31cd-bb4d-4c20-b228-302f61c660c4 tempest-SnapshotsActionsTest-570958061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-088699a2-98b7-48e0-986a-b14388fd3b58.d1f2643d-b07c-4a9d-b886-76c6d82a2f7e -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.dff15be7-5e95-49cf-83a7-84fc966e44ba {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:55 devstack sudo[100728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-088699a2-98b7-48e0-986a-b14388fd3b58.d1f2643d-b07c-4a9d-b886-76c6d82a2f7e -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.dff15be7-5e95-49cf-83a7-84fc966e44ba
Jul 30 20:32:55 devstack sudo[100728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:56 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-7ae3e6f5-4723-491b-80e6-411fceacfd9f tempest-VolumesExtendTest-747499218 None] Created reservations ['01ff68e8-e763-4eac-af76-56f2e9198538', 'bc0c6f59-ebb8-42ad-99bf-d2e4624bde7a', '52502e1e-5fe5-4cb3-8ac2-ac88d62f6084', 'f954dedc-e0d3-4442-a19f-be6e17d7a66a'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:32:56 devstack sudo[100727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901.d6c44c84-44cf-4293-9648-2523282fa185
Jul 30 20:32:56 devstack sudo[100727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:56 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-7ae3e6f5-4723-491b-80e6-411fceacfd9f tempest-VolumesExtendTest-747499218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:32:56 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-7ae3e6f5-4723-491b-80e6-411fceacfd9f tempest-VolumesExtendTest-747499218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:32:56 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-7ae3e6f5-4723-491b-80e6-411fceacfd9f tempest-VolumesExtendTest-747499218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:32:56 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-7ae3e6f5-4723-491b-80e6-411fceacfd9f tempest-VolumesExtendTest-747499218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:32:56 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-7ae3e6f5-4723-491b-80e6-411fceacfd9f tempest-VolumesExtendTest-747499218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:32:56 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-7ae3e6f5-4723-491b-80e6-411fceacfd9f tempest-VolumesExtendTest-747499218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:56 devstack sudo[100731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:32:56 devstack sudo[100731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:56 devstack sudo[100728]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:56 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-e02a31cd-bb4d-4c20-b228-302f61c660c4 tempest-SnapshotsActionsTest-570958061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-088699a2-98b7-48e0-986a-b14388fd3b58.d1f2643d-b07c-4a9d-b886-76c6d82a2f7e -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.dff15be7-5e95-49cf-83a7-84fc966e44ba" returned: 0 in 0.334s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:56 devstack cinder-volume[88719]: WARNING cinder.volume.drivers.remotefs [None req-e02a31cd-bb4d-4c20-b228-302f61c660c4 tempest-SnapshotsActionsTest-570958061 None] /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.dff15be7-5e95-49cf-83a7-84fc966e44ba is being set with open permissions: ugo+rw
Jul 30 20:32:56 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-e02a31cd-bb4d-4c20-b228-302f61c660c4 tempest-SnapshotsActionsTest-570958061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.dff15be7-5e95-49cf-83a7-84fc966e44ba {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:56 devstack sudo[100737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.dff15be7-5e95-49cf-83a7-84fc966e44ba
Jul 30 20:32:56 devstack sudo[100737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:56 devstack sudo[100727]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:56 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-210a8222-9357-41dd-b10d-87981f8fa1a3 tempest-VolumesSnapshotListTestJSON-2060127140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901.d6c44c84-44cf-4293-9648-2523282fa185" returned: 0 in 0.476s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:56 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-210a8222-9357-41dd-b10d-87981f8fa1a3 tempest-VolumesSnapshotListTestJSON-2060127140 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88719) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 30 20:32:56 devstack sudo[100731]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:56 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-7ae3e6f5-4723-491b-80e6-411fceacfd9f tempest-VolumesExtendTest-747499218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.329s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:56 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-7ae3e6f5-4723-491b-80e6-411fceacfd9f tempest-VolumesExtendTest-747499218 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:32:56 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-7ae3e6f5-4723-491b-80e6-411fceacfd9f tempest-VolumesExtendTest-747499218 None] Deleted volume successfully.
Jul 30 20:32:56 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[40be4d98-0e88-411d-b06b-a368ec63cf00]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:32:56 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-210a8222-9357-41dd-b10d-87981f8fa1a3 tempest-VolumesSnapshotListTestJSON-2060127140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901.9eb48b82-1f52-4682-bce1-d9dbea67dbf4 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:56 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-7ae3e6f5-4723-491b-80e6-411fceacfd9f tempest-VolumesExtendTest-747499218 None] Lock "cinder-0df567fd-6905-45fa-bbae-1ecb119fc978-delete_volume" released by "delete_volume" :: held 1.408s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:32:56 devstack sudo[100742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901.9eb48b82-1f52-4682-bce1-d9dbea67dbf4
Jul 30 20:32:56 devstack sudo[100742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:56 devstack sudo[100737]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:56 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-e02a31cd-bb4d-4c20-b228-302f61c660c4 tempest-SnapshotsActionsTest-570958061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.dff15be7-5e95-49cf-83a7-84fc966e44ba" returned: 0 in 0.309s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:56 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-e02a31cd-bb4d-4c20-b228-302f61c660c4 tempest-SnapshotsActionsTest-570958061 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.733s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:32:56 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-e02a31cd-bb4d-4c20-b228-302f61c660c4 tempest-SnapshotsActionsTest-570958061 None] Create snapshot completed successfully
Jul 30 20:32:56 devstack sudo[100742]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:56 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-210a8222-9357-41dd-b10d-87981f8fa1a3 tempest-VolumesSnapshotListTestJSON-2060127140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901.9eb48b82-1f52-4682-bce1-d9dbea67dbf4" returned: 0 in 0.405s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:56 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-210a8222-9357-41dd-b10d-87981f8fa1a3 tempest-VolumesSnapshotListTestJSON-2060127140 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88719) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 30 20:32:56 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-210a8222-9357-41dd-b10d-87981f8fa1a3 tempest-VolumesSnapshotListTestJSON-2060127140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901.d6c44c84-44cf-4293-9648-2523282fa185 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:56 devstack sudo[100748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901.d6c44c84-44cf-4293-9648-2523282fa185
Jul 30 20:32:56 devstack sudo[100748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:57 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-073382fa-7702-4650-904a-8d511f3e8517 tempest-SnapshotsActionsTest-1490291241 None] Acquiring lock "cinder-dff15be7-5e95-49cf-83a7-84fc966e44ba-delete_snapshot" by "delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:32:57 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-073382fa-7702-4650-904a-8d511f3e8517 tempest-SnapshotsActionsTest-1490291241 None] Lock "cinder-dff15be7-5e95-49cf-83a7-84fc966e44ba-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:32:57 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-073382fa-7702-4650-904a-8d511f3e8517 tempest-SnapshotsActionsTest-1490291241 None] Acquiring lock "cinder-quobyte-088699a2-98b7-48e0-986a-b14388fd3b58" by "delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:32:57 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-073382fa-7702-4650-904a-8d511f3e8517 tempest-SnapshotsActionsTest-1490291241 None] Lock "cinder-quobyte-088699a2-98b7-48e0-986a-b14388fd3b58" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:32:57 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-073382fa-7702-4650-904a-8d511f3e8517 tempest-SnapshotsActionsTest-1490291241 None] Acquiring lock "cinder-quobyte-dff15be7-5e95-49cf-83a7-84fc966e44ba" by "_delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:32:57 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-073382fa-7702-4650-904a-8d511f3e8517 tempest-SnapshotsActionsTest-1490291241 None] Lock "cinder-quobyte-dff15be7-5e95-49cf-83a7-84fc966e44ba" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:32:57 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-073382fa-7702-4650-904a-8d511f3e8517 tempest-SnapshotsActionsTest-1490291241 None] Deleting offline snapshot dff15be7-5e95-49cf-83a7-84fc966e44ba of volume 088699a2-98b7-48e0-986a-b14388fd3b58 {{(pid=88719) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 30 20:32:57 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-073382fa-7702-4650-904a-8d511f3e8517 tempest-SnapshotsActionsTest-1490291241 None] snapshot_file for this snap is: volume-088699a2-98b7-48e0-986a-b14388fd3b58.dff15be7-5e95-49cf-83a7-84fc966e44ba {{(pid=88719) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 30 20:32:57 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[a50ecf18-b07b-4e93-a48f-4b72e476c6f6]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:32:57 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-073382fa-7702-4650-904a-8d511f3e8517 tempest-SnapshotsActionsTest-1490291241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.dff15be7-5e95-49cf-83a7-84fc966e44ba {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:57 devstack sudo[100754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.dff15be7-5e95-49cf-83a7-84fc966e44ba
Jul 30 20:32:57 devstack sudo[100754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:57 devstack sudo[100748]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:57 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-210a8222-9357-41dd-b10d-87981f8fa1a3 tempest-VolumesSnapshotListTestJSON-2060127140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901.d6c44c84-44cf-4293-9648-2523282fa185" returned: 0 in 0.556s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:57 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-210a8222-9357-41dd-b10d-87981f8fa1a3 tempest-VolumesSnapshotListTestJSON-2060127140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901.d6c44c84-44cf-4293-9648-2523282fa185 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:57 devstack sudo[100757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901.d6c44c84-44cf-4293-9648-2523282fa185
Jul 30 20:32:57 devstack sudo[100757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:57 devstack sudo[100757]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:57 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-210a8222-9357-41dd-b10d-87981f8fa1a3 tempest-VolumesSnapshotListTestJSON-2060127140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901.d6c44c84-44cf-4293-9648-2523282fa185" returned: 0 in 0.263s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:57 devstack sudo[100754]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:57 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-073382fa-7702-4650-904a-8d511f3e8517 tempest-SnapshotsActionsTest-1490291241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.dff15be7-5e95-49cf-83a7-84fc966e44ba" returned: 0 in 0.462s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:57 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-073382fa-7702-4650-904a-8d511f3e8517 tempest-SnapshotsActionsTest-1490291241 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-088699a2-98b7-48e0-986a-b14388fd3b58(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88719) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 30 20:32:57 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-210a8222-9357-41dd-b10d-87981f8fa1a3 tempest-VolumesSnapshotListTestJSON-2060127140 None] Lock "cinder-quobyte-d6c44c84-44cf-4293-9648-2523282fa185" released by "_delete_snapshot" :: held 1.850s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:32:57 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-210a8222-9357-41dd-b10d-87981f8fa1a3 tempest-VolumesSnapshotListTestJSON-2060127140 None] Lock "cinder-quobyte-2f73ee1f-ae3b-4535-ac0f-7a2205655901" released by "delete_snapshot" :: held 1.885s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:32:57 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e865e1b-8de5-4733-ae07-f7e4e8d24f42]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:32:57 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-073382fa-7702-4650-904a-8d511f3e8517 tempest-SnapshotsActionsTest-1490291241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.d1f2643d-b07c-4a9d-b886-76c6d82a2f7e {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:57 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-210a8222-9357-41dd-b10d-87981f8fa1a3 tempest-VolumesSnapshotListTestJSON-2060127140 None] Created reservations ['c86b2e2e-06db-4a1b-9678-5275736a2638', '7cd0aa22-fd92-4303-8db2-f0fc7e4e0f2c', '3921c7d6-ac41-40c0-afee-ba7e766e4738', 'bea56540-7902-44e1-b4e6-aca7f5295aff'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:32:57 devstack sudo[100764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.d1f2643d-b07c-4a9d-b886-76c6d82a2f7e
Jul 30 20:32:57 devstack sudo[100764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:57 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-210a8222-9357-41dd-b10d-87981f8fa1a3 tempest-VolumesSnapshotListTestJSON-2060127140 None] Delete snapshot completed successfully.
Jul 30 20:32:57 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-210a8222-9357-41dd-b10d-87981f8fa1a3 tempest-VolumesSnapshotListTestJSON-2060127140 None] Lock "cinder-d6c44c84-44cf-4293-9648-2523282fa185-delete_snapshot" released by "delete_snapshot" :: held 2.081s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:32:58 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-ebddc48c-5eee-4e99-b4cc-f86868f3b562 tempest-VolumesSnapshotListTestJSON-2060127140 None] Acquiring lock "cinder-9eb48b82-1f52-4682-bce1-d9dbea67dbf4-delete_snapshot" by "delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:32:58 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-ebddc48c-5eee-4e99-b4cc-f86868f3b562 tempest-VolumesSnapshotListTestJSON-2060127140 None] Lock "cinder-9eb48b82-1f52-4682-bce1-d9dbea67dbf4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:32:58 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-ebddc48c-5eee-4e99-b4cc-f86868f3b562 tempest-VolumesSnapshotListTestJSON-2060127140 None] Acquiring lock "cinder-quobyte-2f73ee1f-ae3b-4535-ac0f-7a2205655901" by "delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:32:58 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-ebddc48c-5eee-4e99-b4cc-f86868f3b562 tempest-VolumesSnapshotListTestJSON-2060127140 None] Lock "cinder-quobyte-2f73ee1f-ae3b-4535-ac0f-7a2205655901" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:32:58 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-ebddc48c-5eee-4e99-b4cc-f86868f3b562 tempest-VolumesSnapshotListTestJSON-2060127140 None] Acquiring lock "cinder-quobyte-9eb48b82-1f52-4682-bce1-d9dbea67dbf4" by "_delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:32:58 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-ebddc48c-5eee-4e99-b4cc-f86868f3b562 tempest-VolumesSnapshotListTestJSON-2060127140 None] Lock "cinder-quobyte-9eb48b82-1f52-4682-bce1-d9dbea67dbf4" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:32:58 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-ebddc48c-5eee-4e99-b4cc-f86868f3b562 tempest-VolumesSnapshotListTestJSON-2060127140 None] Deleting offline snapshot 9eb48b82-1f52-4682-bce1-d9dbea67dbf4 of volume 2f73ee1f-ae3b-4535-ac0f-7a2205655901 {{(pid=88719) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 30 20:32:58 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-ebddc48c-5eee-4e99-b4cc-f86868f3b562 tempest-VolumesSnapshotListTestJSON-2060127140 None] snapshot_file for this snap is: volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901.9eb48b82-1f52-4682-bce1-d9dbea67dbf4 {{(pid=88719) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 30 20:32:58 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef887f25-0d8d-4c49-939e-379c77b26b84]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:32:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-ebddc48c-5eee-4e99-b4cc-f86868f3b562 tempest-VolumesSnapshotListTestJSON-2060127140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901.9eb48b82-1f52-4682-bce1-d9dbea67dbf4 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:58 devstack sudo[100764]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-073382fa-7702-4650-904a-8d511f3e8517 tempest-SnapshotsActionsTest-1490291241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.d1f2643d-b07c-4a9d-b886-76c6d82a2f7e" returned: 0 in 0.433s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:58 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-073382fa-7702-4650-904a-8d511f3e8517 tempest-SnapshotsActionsTest-1490291241 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-088699a2-98b7-48e0-986a-b14388fd3b58(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88719) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 30 20:32:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-073382fa-7702-4650-904a-8d511f3e8517 tempest-SnapshotsActionsTest-1490291241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.dff15be7-5e95-49cf-83a7-84fc966e44ba {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:58 devstack sudo[100766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901.9eb48b82-1f52-4682-bce1-d9dbea67dbf4
Jul 30 20:32:58 devstack sudo[100766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:58 devstack sudo[100770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.dff15be7-5e95-49cf-83a7-84fc966e44ba
Jul 30 20:32:58 devstack sudo[100770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:58 devstack sudo[100766]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-ebddc48c-5eee-4e99-b4cc-f86868f3b562 tempest-VolumesSnapshotListTestJSON-2060127140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901.9eb48b82-1f52-4682-bce1-d9dbea67dbf4" returned: 0 in 0.406s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:58 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-ebddc48c-5eee-4e99-b4cc-f86868f3b562 tempest-VolumesSnapshotListTestJSON-2060127140 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88719) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 30 20:32:58 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[3096fba2-1ddc-4849-913c-d922477fe6a3]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:32:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-ebddc48c-5eee-4e99-b4cc-f86868f3b562 tempest-VolumesSnapshotListTestJSON-2060127140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901.4fa1992d-b163-47f8-94c7-e5d218d95851 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:58 devstack sudo[100770]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-073382fa-7702-4650-904a-8d511f3e8517 tempest-SnapshotsActionsTest-1490291241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.dff15be7-5e95-49cf-83a7-84fc966e44ba" returned: 0 in 0.415s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-073382fa-7702-4650-904a-8d511f3e8517 tempest-SnapshotsActionsTest-1490291241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.dff15be7-5e95-49cf-83a7-84fc966e44ba {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:58 devstack sudo[100780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.dff15be7-5e95-49cf-83a7-84fc966e44ba
Jul 30 20:32:58 devstack sudo[100780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:58 devstack sudo[100779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901.4fa1992d-b163-47f8-94c7-e5d218d95851
Jul 30 20:32:58 devstack sudo[100779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:58 devstack sudo[100780]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-073382fa-7702-4650-904a-8d511f3e8517 tempest-SnapshotsActionsTest-1490291241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.dff15be7-5e95-49cf-83a7-84fc966e44ba" returned: 0 in 0.304s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:58 devstack sudo[100779]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-ebddc48c-5eee-4e99-b4cc-f86868f3b562 tempest-VolumesSnapshotListTestJSON-2060127140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901.4fa1992d-b163-47f8-94c7-e5d218d95851" returned: 0 in 0.422s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:58 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-ebddc48c-5eee-4e99-b4cc-f86868f3b562 tempest-VolumesSnapshotListTestJSON-2060127140 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88719) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 30 20:32:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-ebddc48c-5eee-4e99-b4cc-f86868f3b562 tempest-VolumesSnapshotListTestJSON-2060127140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901.9eb48b82-1f52-4682-bce1-d9dbea67dbf4 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:58 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-073382fa-7702-4650-904a-8d511f3e8517 tempest-SnapshotsActionsTest-1490291241 None] Lock "cinder-quobyte-dff15be7-5e95-49cf-83a7-84fc966e44ba" released by "_delete_snapshot" :: held 1.760s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:32:59 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-073382fa-7702-4650-904a-8d511f3e8517 tempest-SnapshotsActionsTest-1490291241 None] Lock "cinder-quobyte-088699a2-98b7-48e0-986a-b14388fd3b58" released by "delete_snapshot" :: held 1.789s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:32:59 devstack sudo[100789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901.9eb48b82-1f52-4682-bce1-d9dbea67dbf4
Jul 30 20:32:59 devstack sudo[100789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:59 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-073382fa-7702-4650-904a-8d511f3e8517 tempest-SnapshotsActionsTest-1490291241 None] Created reservations ['8dd1c830-8ec1-4465-9baa-52042fb81edd', '2fbe3c0c-9e94-4962-a188-4dac855acc31', '02675629-b571-415f-baca-7c609c96078c', '9c960778-bb93-4a73-aa50-6b53ca7dfdee'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:32:59 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-073382fa-7702-4650-904a-8d511f3e8517 tempest-SnapshotsActionsTest-1490291241 None] Delete snapshot completed successfully.
Jul 30 20:32:59 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-073382fa-7702-4650-904a-8d511f3e8517 tempest-SnapshotsActionsTest-1490291241 None] Lock "cinder-dff15be7-5e95-49cf-83a7-84fc966e44ba-delete_snapshot" released by "delete_snapshot" :: held 2.012s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:32:59 devstack sudo[100789]: pam_unix(sudo:session): session closed for user root
Jul 30 20:32:59 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-ebddc48c-5eee-4e99-b4cc-f86868f3b562 tempest-VolumesSnapshotListTestJSON-2060127140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901.9eb48b82-1f52-4682-bce1-d9dbea67dbf4" returned: 0 in 0.729s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:32:59 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-ebddc48c-5eee-4e99-b4cc-f86868f3b562 tempest-VolumesSnapshotListTestJSON-2060127140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901.9eb48b82-1f52-4682-bce1-d9dbea67dbf4 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:32:59 devstack sudo[100834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901.9eb48b82-1f52-4682-bce1-d9dbea67dbf4
Jul 30 20:32:59 devstack sudo[100834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:32:59 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-2cd9c114-774f-43a2-8157-ebb5f806268b tempest-SnapshotsActionsTest-570958061 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:32:59 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-2cd9c114-774f-43a2-8157-ebb5f806268b tempest-SnapshotsActionsTest-570958061 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:32:59 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-2cd9c114-774f-43a2-8157-ebb5f806268b tempest-SnapshotsActionsTest-570958061 None] Creating offline snapshot 08588e97-4c76-405a-a15e-78dc1ac31d9c of volume 088699a2-98b7-48e0-986a-b14388fd3b58 {{(pid=88719) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 30 20:32:59 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e945454-f2f5-40b4-bfe7-9b16d476c0f5]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:32:59 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2cd9c114-774f-43a2-8157-ebb5f806268b tempest-SnapshotsActionsTest-570958061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.d1f2643d-b07c-4a9d-b886-76c6d82a2f7e {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:33:00 devstack sudo[100834]: pam_unix(sudo:session): session closed for user root
Jul 30 20:33:00 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-ebddc48c-5eee-4e99-b4cc-f86868f3b562 tempest-VolumesSnapshotListTestJSON-2060127140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901.9eb48b82-1f52-4682-bce1-d9dbea67dbf4" returned: 0 in 0.355s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:33:00 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-ebddc48c-5eee-4e99-b4cc-f86868f3b562 tempest-VolumesSnapshotListTestJSON-2060127140 None] Lock "cinder-quobyte-9eb48b82-1f52-4682-bce1-d9dbea67dbf4" released by "_delete_snapshot" :: held 2.017s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:33:00 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-ebddc48c-5eee-4e99-b4cc-f86868f3b562 tempest-VolumesSnapshotListTestJSON-2060127140 None] Lock "cinder-quobyte-2f73ee1f-ae3b-4535-ac0f-7a2205655901" released by "delete_snapshot" :: held 2.046s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:33:00 devstack sudo[100838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.d1f2643d-b07c-4a9d-b886-76c6d82a2f7e
Jul 30 20:33:00 devstack sudo[100838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:33:00 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-ebddc48c-5eee-4e99-b4cc-f86868f3b562 tempest-VolumesSnapshotListTestJSON-2060127140 None] Created reservations ['27d2441d-0526-4cde-b40b-2a827525f7b0', '46d3bbdc-07fd-4780-b6c1-e74e8e3e6a43', '534ccb29-bc02-4f50-87aa-e20059739904', '3c422401-3c58-4fad-9f25-a6c1ea5eeef7'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:33:00 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-ebddc48c-5eee-4e99-b4cc-f86868f3b562 tempest-VolumesSnapshotListTestJSON-2060127140 None] Delete snapshot completed successfully.
Jul 30 20:33:00 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-ebddc48c-5eee-4e99-b4cc-f86868f3b562 tempest-VolumesSnapshotListTestJSON-2060127140 None] Lock "cinder-9eb48b82-1f52-4682-bce1-d9dbea67dbf4-delete_snapshot" released by "delete_snapshot" :: held 2.211s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:33:00 devstack sudo[100838]: pam_unix(sudo:session): session closed for user root
Jul 30 20:33:00 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2cd9c114-774f-43a2-8157-ebb5f806268b tempest-SnapshotsActionsTest-570958061 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.d1f2643d-b07c-4a9d-b886-76c6d82a2f7e" returned: 0 in 0.441s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:33:00 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-2cd9c114-774f-43a2-8157-ebb5f806268b tempest-SnapshotsActionsTest-570958061 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-088699a2-98b7-48e0-986a-b14388fd3b58(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88719) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 30 20:33:00 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2cd9c114-774f-43a2-8157-ebb5f806268b tempest-SnapshotsActionsTest-570958061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.d1f2643d-b07c-4a9d-b886-76c6d82a2f7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.08588e97-4c76-405a-a15e-78dc1ac31d9c 1G {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:33:00 devstack sudo[100845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.d1f2643d-b07c-4a9d-b886-76c6d82a2f7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.08588e97-4c76-405a-a15e-78dc1ac31d9c 1G
Jul 30 20:33:00 devstack sudo[100845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:33:00 devstack sudo[100845]: pam_unix(sudo:session): session closed for user root
Jul 30 20:33:00 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2cd9c114-774f-43a2-8157-ebb5f806268b tempest-SnapshotsActionsTest-570958061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.d1f2643d-b07c-4a9d-b886-76c6d82a2f7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.08588e97-4c76-405a-a15e-78dc1ac31d9c 1G" returned: 0 in 0.533s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:33:00 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2cd9c114-774f-43a2-8157-ebb5f806268b tempest-SnapshotsActionsTest-570958061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-088699a2-98b7-48e0-986a-b14388fd3b58.d1f2643d-b07c-4a9d-b886-76c6d82a2f7e -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.08588e97-4c76-405a-a15e-78dc1ac31d9c {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:33:00 devstack sudo[100851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-088699a2-98b7-48e0-986a-b14388fd3b58.d1f2643d-b07c-4a9d-b886-76c6d82a2f7e -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.08588e97-4c76-405a-a15e-78dc1ac31d9c
Jul 30 20:33:00 devstack sudo[100851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:33:01 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-bc782a8a-6f26-4778-bf70-050fc008796e tempest-VolumesSnapshotListTestJSON-2060127140 None] Acquiring lock "cinder-4fa1992d-b163-47f8-94c7-e5d218d95851-delete_snapshot" by "delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:33:01 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-bc782a8a-6f26-4778-bf70-050fc008796e tempest-VolumesSnapshotListTestJSON-2060127140 None] Lock "cinder-4fa1992d-b163-47f8-94c7-e5d218d95851-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:33:01 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-bc782a8a-6f26-4778-bf70-050fc008796e tempest-VolumesSnapshotListTestJSON-2060127140 None] Acquiring lock "cinder-quobyte-2f73ee1f-ae3b-4535-ac0f-7a2205655901" by "delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:33:01 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-bc782a8a-6f26-4778-bf70-050fc008796e tempest-VolumesSnapshotListTestJSON-2060127140 None] Lock "cinder-quobyte-2f73ee1f-ae3b-4535-ac0f-7a2205655901" acquired by "delete_snapshot" :: waited 0.033s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:33:01 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-bc782a8a-6f26-4778-bf70-050fc008796e tempest-VolumesSnapshotListTestJSON-2060127140 None] Acquiring lock "cinder-quobyte-4fa1992d-b163-47f8-94c7-e5d218d95851" by "_delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:33:01 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-bc782a8a-6f26-4778-bf70-050fc008796e tempest-VolumesSnapshotListTestJSON-2060127140 None] Lock "cinder-quobyte-4fa1992d-b163-47f8-94c7-e5d218d95851" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:33:01 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-bc782a8a-6f26-4778-bf70-050fc008796e tempest-VolumesSnapshotListTestJSON-2060127140 None] Deleting offline snapshot 4fa1992d-b163-47f8-94c7-e5d218d95851 of volume 2f73ee1f-ae3b-4535-ac0f-7a2205655901 {{(pid=88719) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 30 20:33:01 devstack sudo[100851]: pam_unix(sudo:session): session closed for user root
Jul 30 20:33:01 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-bc782a8a-6f26-4778-bf70-050fc008796e tempest-VolumesSnapshotListTestJSON-2060127140 None] snapshot_file for this snap is: volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901.4fa1992d-b163-47f8-94c7-e5d218d95851 {{(pid=88719) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 30 20:33:01 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2cd9c114-774f-43a2-8157-ebb5f806268b tempest-SnapshotsActionsTest-570958061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-088699a2-98b7-48e0-986a-b14388fd3b58.d1f2643d-b07c-4a9d-b886-76c6d82a2f7e -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.08588e97-4c76-405a-a15e-78dc1ac31d9c" returned: 0 in 0.428s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:33:01 devstack cinder-volume[88719]: WARNING cinder.volume.drivers.remotefs [None req-2cd9c114-774f-43a2-8157-ebb5f806268b tempest-SnapshotsActionsTest-570958061 None] /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.08588e97-4c76-405a-a15e-78dc1ac31d9c is being set with open permissions: ugo+rw
Jul 30 20:33:01 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2cd9c114-774f-43a2-8157-ebb5f806268b tempest-SnapshotsActionsTest-570958061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.08588e97-4c76-405a-a15e-78dc1ac31d9c {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:33:01 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[06f99abe-05d2-4ea0-98e0-233285b7e88f]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:33:01 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-bc782a8a-6f26-4778-bf70-050fc008796e tempest-VolumesSnapshotListTestJSON-2060127140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901.4fa1992d-b163-47f8-94c7-e5d218d95851 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:33:01 devstack sudo[100856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.08588e97-4c76-405a-a15e-78dc1ac31d9c
Jul 30 20:33:01 devstack sudo[100856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:33:01 devstack sudo[100857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901.4fa1992d-b163-47f8-94c7-e5d218d95851
Jul 30 20:33:01 devstack sudo[100857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:33:01 devstack sudo[100856]: pam_unix(sudo:session): session closed for user root
Jul 30 20:33:01 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2cd9c114-774f-43a2-8157-ebb5f806268b tempest-SnapshotsActionsTest-570958061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.08588e97-4c76-405a-a15e-78dc1ac31d9c" returned: 0 in 0.370s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:33:01 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-2cd9c114-774f-43a2-8157-ebb5f806268b tempest-SnapshotsActionsTest-570958061 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.937s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:33:01 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-2cd9c114-774f-43a2-8157-ebb5f806268b tempest-SnapshotsActionsTest-570958061 None] Create snapshot completed successfully
Jul 30 20:33:01 devstack sudo[100857]: pam_unix(sudo:session): session closed for user root
Jul 30 20:33:01 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-bc782a8a-6f26-4778-bf70-050fc008796e tempest-VolumesSnapshotListTestJSON-2060127140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901.4fa1992d-b163-47f8-94c7-e5d218d95851" returned: 0 in 0.472s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:33:01 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-bc782a8a-6f26-4778-bf70-050fc008796e tempest-VolumesSnapshotListTestJSON-2060127140 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88719) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 30 20:33:01 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[4105d4ad-3066-42b1-a907-6326609bdbde]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:33:01 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-bc782a8a-6f26-4778-bf70-050fc008796e tempest-VolumesSnapshotListTestJSON-2060127140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:33:02 devstack sudo[100865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901
Jul 30 20:33:02 devstack sudo[100865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:33:02 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-3f610df4-873e-4d91-a0aa-77f4d3b4c5a0 tempest-SnapshotsActionsTest-1490291241 None] Acquiring lock "cinder-08588e97-4c76-405a-a15e-78dc1ac31d9c-delete_snapshot" by "delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:33:02 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-3f610df4-873e-4d91-a0aa-77f4d3b4c5a0 tempest-SnapshotsActionsTest-1490291241 None] Lock "cinder-08588e97-4c76-405a-a15e-78dc1ac31d9c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:33:02 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-3f610df4-873e-4d91-a0aa-77f4d3b4c5a0 tempest-SnapshotsActionsTest-1490291241 None] Acquiring lock "cinder-quobyte-088699a2-98b7-48e0-986a-b14388fd3b58" by "delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:33:02 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-3f610df4-873e-4d91-a0aa-77f4d3b4c5a0 tempest-SnapshotsActionsTest-1490291241 None] Lock "cinder-quobyte-088699a2-98b7-48e0-986a-b14388fd3b58" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:33:02 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-3f610df4-873e-4d91-a0aa-77f4d3b4c5a0 tempest-SnapshotsActionsTest-1490291241 None] Acquiring lock "cinder-quobyte-08588e97-4c76-405a-a15e-78dc1ac31d9c" by "_delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:33:02 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-3f610df4-873e-4d91-a0aa-77f4d3b4c5a0 tempest-SnapshotsActionsTest-1490291241 None] Lock "cinder-quobyte-08588e97-4c76-405a-a15e-78dc1ac31d9c" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:33:02 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-3f610df4-873e-4d91-a0aa-77f4d3b4c5a0 tempest-SnapshotsActionsTest-1490291241 None] Deleting offline snapshot 08588e97-4c76-405a-a15e-78dc1ac31d9c of volume 088699a2-98b7-48e0-986a-b14388fd3b58 {{(pid=88719) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 30 20:33:02 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-3f610df4-873e-4d91-a0aa-77f4d3b4c5a0 tempest-SnapshotsActionsTest-1490291241 None] snapshot_file for this snap is: volume-088699a2-98b7-48e0-986a-b14388fd3b58.08588e97-4c76-405a-a15e-78dc1ac31d9c {{(pid=88719) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 30 20:33:02 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[edd920fc-7e2d-4c45-85e3-25c21297e092]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:33:02 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3f610df4-873e-4d91-a0aa-77f4d3b4c5a0 tempest-SnapshotsActionsTest-1490291241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.08588e97-4c76-405a-a15e-78dc1ac31d9c {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:33:02 devstack sudo[100865]: pam_unix(sudo:session): session closed for user root
Jul 30 20:33:02 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-bc782a8a-6f26-4778-bf70-050fc008796e tempest-VolumesSnapshotListTestJSON-2060127140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901" returned: 0 in 0.452s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:33:02 devstack sudo[100867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.08588e97-4c76-405a-a15e-78dc1ac31d9c
Jul 30 20:33:02 devstack sudo[100867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:33:02 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-bc782a8a-6f26-4778-bf70-050fc008796e tempest-VolumesSnapshotListTestJSON-2060127140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901.4fa1992d-b163-47f8-94c7-e5d218d95851 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:33:02 devstack sudo[100873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901.4fa1992d-b163-47f8-94c7-e5d218d95851
Jul 30 20:33:02 devstack sudo[100873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:33:02 devstack sudo[100867]: pam_unix(sudo:session): session closed for user root
Jul 30 20:33:02 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3f610df4-873e-4d91-a0aa-77f4d3b4c5a0 tempest-SnapshotsActionsTest-1490291241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.08588e97-4c76-405a-a15e-78dc1ac31d9c" returned: 0 in 0.514s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:33:02 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-3f610df4-873e-4d91-a0aa-77f4d3b4c5a0 tempest-SnapshotsActionsTest-1490291241 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-088699a2-98b7-48e0-986a-b14388fd3b58(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88719) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 30 20:33:02 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbb9992a-2f56-4183-874d-8ce4c87e957e]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:33:02 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3f610df4-873e-4d91-a0aa-77f4d3b4c5a0 tempest-SnapshotsActionsTest-1490291241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.d1f2643d-b07c-4a9d-b886-76c6d82a2f7e {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:33:02 devstack sudo[100873]: pam_unix(sudo:session): session closed for user root
Jul 30 20:33:02 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-bc782a8a-6f26-4778-bf70-050fc008796e tempest-VolumesSnapshotListTestJSON-2060127140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901.4fa1992d-b163-47f8-94c7-e5d218d95851" returned: 0 in 0.423s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:33:02 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-bc782a8a-6f26-4778-bf70-050fc008796e tempest-VolumesSnapshotListTestJSON-2060127140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901.4fa1992d-b163-47f8-94c7-e5d218d95851 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:33:02 devstack sudo[100882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901.4fa1992d-b163-47f8-94c7-e5d218d95851
Jul 30 20:33:02 devstack sudo[100882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:33:02 devstack sudo[100881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.d1f2643d-b07c-4a9d-b886-76c6d82a2f7e
Jul 30 20:33:02 devstack sudo[100881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:33:03 devstack sudo[100882]: pam_unix(sudo:session): session closed for user root
Jul 30 20:33:03 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-bc782a8a-6f26-4778-bf70-050fc008796e tempest-VolumesSnapshotListTestJSON-2060127140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901.4fa1992d-b163-47f8-94c7-e5d218d95851" returned: 0 in 0.250s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:33:03 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-bc782a8a-6f26-4778-bf70-050fc008796e tempest-VolumesSnapshotListTestJSON-2060127140 None] Lock "cinder-quobyte-4fa1992d-b163-47f8-94c7-e5d218d95851" released by "_delete_snapshot" :: held 1.760s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:33:03 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-bc782a8a-6f26-4778-bf70-050fc008796e tempest-VolumesSnapshotListTestJSON-2060127140 None] Lock "cinder-quobyte-2f73ee1f-ae3b-4535-ac0f-7a2205655901" released by "delete_snapshot" :: held 1.792s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:33:03 devstack sudo[100881]: pam_unix(sudo:session): session closed for user root
Jul 30 20:33:03 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3f610df4-873e-4d91-a0aa-77f4d3b4c5a0 tempest-SnapshotsActionsTest-1490291241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.d1f2643d-b07c-4a9d-b886-76c6d82a2f7e" returned: 0 in 0.398s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:33:03 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-3f610df4-873e-4d91-a0aa-77f4d3b4c5a0 tempest-SnapshotsActionsTest-1490291241 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-088699a2-98b7-48e0-986a-b14388fd3b58(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88719) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 30 20:33:03 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3f610df4-873e-4d91-a0aa-77f4d3b4c5a0 tempest-SnapshotsActionsTest-1490291241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.08588e97-4c76-405a-a15e-78dc1ac31d9c {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:33:03 devstack sudo[100889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.08588e97-4c76-405a-a15e-78dc1ac31d9c
Jul 30 20:33:03 devstack sudo[100889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:33:03 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-bc782a8a-6f26-4778-bf70-050fc008796e tempest-VolumesSnapshotListTestJSON-2060127140 None] Created reservations ['85dfaee9-1680-4c2c-8124-ea444bc27edd', 'bde84cfe-c381-44db-9088-1023dfe2705a', 'a3e20155-b95c-45ad-84d0-64f5d8402955', '9949b599-1141-4fea-886c-9153ce70eb21'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:33:03 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-bc782a8a-6f26-4778-bf70-050fc008796e tempest-VolumesSnapshotListTestJSON-2060127140 None] Delete snapshot completed successfully.
Jul 30 20:33:03 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-bc782a8a-6f26-4778-bf70-050fc008796e tempest-VolumesSnapshotListTestJSON-2060127140 None] Lock "cinder-4fa1992d-b163-47f8-94c7-e5d218d95851-delete_snapshot" released by "delete_snapshot" :: held 1.991s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:33:03 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-3436a9d0-d46c-4868-b0d7-261daf7dabad tempest-VolumesSnapshotListTestJSON-2060127140 None] Acquiring lock "cinder-2f73ee1f-ae3b-4535-ac0f-7a2205655901-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:33:03 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-3436a9d0-d46c-4868-b0d7-261daf7dabad tempest-VolumesSnapshotListTestJSON-2060127140 None] Lock "cinder-2f73ee1f-ae3b-4535-ac0f-7a2205655901-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:33:03 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-3436a9d0-d46c-4868-b0d7-261daf7dabad tempest-VolumesSnapshotListTestJSON-2060127140 None] Acquiring lock "cinder-quobyte-2f73ee1f-ae3b-4535-ac0f-7a2205655901" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:33:03 devstack sudo[100889]: pam_unix(sudo:session): session closed for user root
Jul 30 20:33:03 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3f610df4-873e-4d91-a0aa-77f4d3b4c5a0 tempest-SnapshotsActionsTest-1490291241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.08588e97-4c76-405a-a15e-78dc1ac31d9c" returned: 0 in 0.465s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:33:03 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3f610df4-873e-4d91-a0aa-77f4d3b4c5a0 tempest-SnapshotsActionsTest-1490291241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.08588e97-4c76-405a-a15e-78dc1ac31d9c {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:33:03 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-3436a9d0-d46c-4868-b0d7-261daf7dabad tempest-VolumesSnapshotListTestJSON-2060127140 None] Lock "cinder-quobyte-2f73ee1f-ae3b-4535-ac0f-7a2205655901" acquired by "delete_volume" :: waited 0.047s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:33:03 devstack sudo[100895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.08588e97-4c76-405a-a15e-78dc1ac31d9c
Jul 30 20:33:03 devstack sudo[100895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:33:03 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad6ab31d-f8ea-40d6-8bca-2d9b95cc8f24]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:33:03 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3436a9d0-d46c-4868-b0d7-261daf7dabad tempest-VolumesSnapshotListTestJSON-2060127140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:33:03 devstack sudo[100897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901
Jul 30 20:33:03 devstack sudo[100897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:33:03 devstack sudo[100895]: pam_unix(sudo:session): session closed for user root
Jul 30 20:33:03 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3f610df4-873e-4d91-a0aa-77f4d3b4c5a0 tempest-SnapshotsActionsTest-1490291241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.08588e97-4c76-405a-a15e-78dc1ac31d9c" returned: 0 in 0.311s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:33:03 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-3f610df4-873e-4d91-a0aa-77f4d3b4c5a0 tempest-SnapshotsActionsTest-1490291241 None] Lock "cinder-quobyte-08588e97-4c76-405a-a15e-78dc1ac31d9c" released by "_delete_snapshot" :: held 1.834s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:33:03 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-3f610df4-873e-4d91-a0aa-77f4d3b4c5a0 tempest-SnapshotsActionsTest-1490291241 None] Lock "cinder-quobyte-088699a2-98b7-48e0-986a-b14388fd3b58" released by "delete_snapshot" :: held 1.864s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:33:04 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-3f610df4-873e-4d91-a0aa-77f4d3b4c5a0 tempest-SnapshotsActionsTest-1490291241 None] Created reservations ['88253b5f-44fc-4122-b5f6-e0808fe09cb0', '260e795f-4f6f-462b-a624-89ff752468d0', '7ff6c75a-969a-43d6-aad7-9d3811e536f7', '32b2d6ca-29c3-4f24-97a1-3c5146cdb21f'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:33:04 devstack sudo[100897]: pam_unix(sudo:session): session closed for user root
Jul 30 20:33:04 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-3f610df4-873e-4d91-a0aa-77f4d3b4c5a0 tempest-SnapshotsActionsTest-1490291241 None] Delete snapshot completed successfully.
Jul 30 20:33:04 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3436a9d0-d46c-4868-b0d7-261daf7dabad tempest-VolumesSnapshotListTestJSON-2060127140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901" returned: 0 in 0.404s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:33:04 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3436a9d0-d46c-4868-b0d7-261daf7dabad tempest-VolumesSnapshotListTestJSON-2060127140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:33:04 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-3f610df4-873e-4d91-a0aa-77f4d3b4c5a0 tempest-SnapshotsActionsTest-1490291241 None] Lock "cinder-08588e97-4c76-405a-a15e-78dc1ac31d9c-delete_snapshot" released by "delete_snapshot" :: held 2.031s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:33:04 devstack sudo[100903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901
Jul 30 20:33:04 devstack sudo[100903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:33:04 devstack sudo[100903]: pam_unix(sudo:session): session closed for user root
Jul 30 20:33:04 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3436a9d0-d46c-4868-b0d7-261daf7dabad tempest-VolumesSnapshotListTestJSON-2060127140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2f73ee1f-ae3b-4535-ac0f-7a2205655901" returned: 0 in 0.287s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:33:04 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-3436a9d0-d46c-4868-b0d7-261daf7dabad tempest-VolumesSnapshotListTestJSON-2060127140 None] Lock "cinder-quobyte-2f73ee1f-ae3b-4535-ac0f-7a2205655901" released by "delete_volume" :: held 0.771s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:33:04 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-3436a9d0-d46c-4868-b0d7-261daf7dabad tempest-VolumesSnapshotListTestJSON-2060127140 None] Created reservations ['2e3fc6d9-f8f4-4a52-9057-a93b15d2000d', 'fca43381-61aa-430c-a817-b2cbd8c4a663', '9d780c44-24eb-4d11-ad0c-93e20bfdad26', '975a67b7-5f7f-4b2d-afaa-ac2af4685835'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:33:04 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-3436a9d0-d46c-4868-b0d7-261daf7dabad tempest-VolumesSnapshotListTestJSON-2060127140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:33:04 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-3436a9d0-d46c-4868-b0d7-261daf7dabad tempest-VolumesSnapshotListTestJSON-2060127140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:33:04 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-3436a9d0-d46c-4868-b0d7-261daf7dabad tempest-VolumesSnapshotListTestJSON-2060127140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:33:04 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-3436a9d0-d46c-4868-b0d7-261daf7dabad tempest-VolumesSnapshotListTestJSON-2060127140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:33:04 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-3436a9d0-d46c-4868-b0d7-261daf7dabad tempest-VolumesSnapshotListTestJSON-2060127140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:33:04 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3436a9d0-d46c-4868-b0d7-261daf7dabad tempest-VolumesSnapshotListTestJSON-2060127140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:33:04 devstack sudo[100909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:33:04 devstack sudo[100909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:33:05 devstack sudo[100909]: pam_unix(sudo:session): session closed for user root
Jul 30 20:33:05 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3436a9d0-d46c-4868-b0d7-261daf7dabad tempest-VolumesSnapshotListTestJSON-2060127140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.425s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:33:05 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-3436a9d0-d46c-4868-b0d7-261daf7dabad tempest-VolumesSnapshotListTestJSON-2060127140 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:33:05 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-7c387ef8-0c16-484b-ae96-b7d78d433e69 tempest-SnapshotsActionsTest-570958061 None] Acquiring lock "cinder-d1f2643d-b07c-4a9d-b886-76c6d82a2f7e-delete_snapshot" by "delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:33:05 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-3436a9d0-d46c-4868-b0d7-261daf7dabad tempest-VolumesSnapshotListTestJSON-2060127140 None] Deleted volume successfully.
Jul 30 20:33:05 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-3436a9d0-d46c-4868-b0d7-261daf7dabad tempest-VolumesSnapshotListTestJSON-2060127140 None] Lock "cinder-2f73ee1f-ae3b-4535-ac0f-7a2205655901-delete_volume" released by "delete_volume" :: held 1.541s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:33:05 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-7c387ef8-0c16-484b-ae96-b7d78d433e69 tempest-SnapshotsActionsTest-570958061 None] Lock "cinder-d1f2643d-b07c-4a9d-b886-76c6d82a2f7e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.052s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:33:05 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-7c387ef8-0c16-484b-ae96-b7d78d433e69 tempest-SnapshotsActionsTest-570958061 None] Acquiring lock "cinder-quobyte-088699a2-98b7-48e0-986a-b14388fd3b58" by "delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:33:05 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-7c387ef8-0c16-484b-ae96-b7d78d433e69 tempest-SnapshotsActionsTest-570958061 None] Lock "cinder-quobyte-088699a2-98b7-48e0-986a-b14388fd3b58" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:33:05 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-7c387ef8-0c16-484b-ae96-b7d78d433e69 tempest-SnapshotsActionsTest-570958061 None] Acquiring lock "cinder-quobyte-d1f2643d-b07c-4a9d-b886-76c6d82a2f7e" by "_delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:33:05 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-7c387ef8-0c16-484b-ae96-b7d78d433e69 tempest-SnapshotsActionsTest-570958061 None] Lock "cinder-quobyte-d1f2643d-b07c-4a9d-b886-76c6d82a2f7e" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:33:05 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-7c387ef8-0c16-484b-ae96-b7d78d433e69 tempest-SnapshotsActionsTest-570958061 None] Deleting offline snapshot d1f2643d-b07c-4a9d-b886-76c6d82a2f7e of volume 088699a2-98b7-48e0-986a-b14388fd3b58 {{(pid=88719) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 30 20:33:05 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-7c387ef8-0c16-484b-ae96-b7d78d433e69 tempest-SnapshotsActionsTest-570958061 None] snapshot_file for this snap is: volume-088699a2-98b7-48e0-986a-b14388fd3b58.d1f2643d-b07c-4a9d-b886-76c6d82a2f7e {{(pid=88719) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 30 20:33:05 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[a426cee0-f936-4725-bcc5-c39c146c3c9e]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:33:05 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-7c387ef8-0c16-484b-ae96-b7d78d433e69 tempest-SnapshotsActionsTest-570958061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.d1f2643d-b07c-4a9d-b886-76c6d82a2f7e {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:33:05 devstack sudo[100912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.d1f2643d-b07c-4a9d-b886-76c6d82a2f7e
Jul 30 20:33:05 devstack sudo[100912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:33:05 devstack sudo[100912]: pam_unix(sudo:session): session closed for user root
Jul 30 20:33:05 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-7c387ef8-0c16-484b-ae96-b7d78d433e69 tempest-SnapshotsActionsTest-570958061 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.d1f2643d-b07c-4a9d-b886-76c6d82a2f7e" returned: 0 in 0.555s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:33:05 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-7c387ef8-0c16-484b-ae96-b7d78d433e69 tempest-SnapshotsActionsTest-570958061 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-088699a2-98b7-48e0-986a-b14388fd3b58(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88719) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 30 20:33:05 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee5de9d8-6355-4fa3-b90c-40d91d2e1bd9]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:33:05 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-7c387ef8-0c16-484b-ae96-b7d78d433e69 tempest-SnapshotsActionsTest-570958061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:33:05 devstack sudo[100918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58
Jul 30 20:33:05 devstack sudo[100918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:33:06 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae8ce1cb-ae50-48b0-9a50-edfdce543c92 tempest-TestServerVolumeAttachScenarioOldVersion-1469863940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:33:06 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-ae8ce1cb-ae50-48b0-9a50-edfdce543c92 tempest-TestServerVolumeAttachScenarioOldVersion-1469863940 None] Flow 'volume_create_manager' (4879b775-7b46-4e5c-b7df-c7b2cae8c168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:33:06 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-ae8ce1cb-ae50-48b0-9a50-edfdce543c92 tempest-TestServerVolumeAttachScenarioOldVersion-1469863940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffb4df41-78be-43d9-85dd-21873a731036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:33:06 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-ae8ce1cb-ae50-48b0-9a50-edfdce543c92 tempest-TestServerVolumeAttachScenarioOldVersion-1469863940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffb4df41-78be-43d9-85dd-21873a731036) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:33:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1455072933',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4c771f9-e051-4fe3-af69-b8acc273431a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a272684f1d04633b5b466d905d7a4f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:33:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:33:06Z,use_quota=True,user_id='35ffd59c2f36453a8bb1ef823e20d3ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:33:06 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-ae8ce1cb-ae50-48b0-9a50-edfdce543c92 tempest-TestServerVolumeAttachScenarioOldVersion-1469863940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c404545-7f31-46f2-83a7-52dad9a140b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:33:06 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-ae8ce1cb-ae50-48b0-9a50-edfdce543c92 tempest-TestServerVolumeAttachScenarioOldVersion-1469863940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c404545-7f31-46f2-83a7-52dad9a140b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:33:06 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-ae8ce1cb-ae50-48b0-9a50-edfdce543c92 tempest-TestServerVolumeAttachScenarioOldVersion-1469863940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fbf4192-e438-4fc9-9a1e-13e89568887b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:33:06 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-ae8ce1cb-ae50-48b0-9a50-edfdce543c92 tempest-TestServerVolumeAttachScenarioOldVersion-1469863940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fbf4192-e438-4fc9-9a1e-13e89568887b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4c771f9-e051-4fe3-af69-b8acc273431a', 'volume_name': 'volume-c4c771f9-e051-4fe3-af69-b8acc273431a', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:33:06 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-ae8ce1cb-ae50-48b0-9a50-edfdce543c92 tempest-TestServerVolumeAttachScenarioOldVersion-1469863940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59975ad8-fda5-4fcf-b1d7-d7e9b4235aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:33:06 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-ae8ce1cb-ae50-48b0-9a50-edfdce543c92 tempest-TestServerVolumeAttachScenarioOldVersion-1469863940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59975ad8-fda5-4fcf-b1d7-d7e9b4235aa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:33:06 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-ae8ce1cb-ae50-48b0-9a50-edfdce543c92 tempest-TestServerVolumeAttachScenarioOldVersion-1469863940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95d4700b-eaaa-4978-9663-61689a504f02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:33:06 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-ae8ce1cb-ae50-48b0-9a50-edfdce543c92 tempest-TestServerVolumeAttachScenarioOldVersion-1469863940 None] Volume c4c771f9-e051-4fe3-af69-b8acc273431a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4c771f9-e051-4fe3-af69-b8acc273431a', 'volume_size': 1}
Jul 30 20:33:06 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-ae8ce1cb-ae50-48b0-9a50-edfdce543c92 tempest-TestServerVolumeAttachScenarioOldVersion-1469863940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:33:06 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-ae8ce1cb-ae50-48b0-9a50-edfdce543c92 tempest-TestServerVolumeAttachScenarioOldVersion-1469863940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:33:06 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-ae8ce1cb-ae50-48b0-9a50-edfdce543c92 tempest-TestServerVolumeAttachScenarioOldVersion-1469863940 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:33:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1455072933',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4c771f9-e051-4fe3-af69-b8acc273431a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a272684f1d04633b5b466d905d7a4f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:33:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:33:06Z,use_quota=True,user_id='35ffd59c2f36453a8bb1ef823e20d3ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:33:06 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-ae8ce1cb-ae50-48b0-9a50-edfdce543c92 tempest-TestServerVolumeAttachScenarioOldVersion-1469863940 None] Creating volume c4c771f9-e051-4fe3-af69-b8acc273431a {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:33:06 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-ae8ce1cb-ae50-48b0-9a50-edfdce543c92 tempest-TestServerVolumeAttachScenarioOldVersion-1469863940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:33:06 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-ae8ce1cb-ae50-48b0-9a50-edfdce543c92 tempest-TestServerVolumeAttachScenarioOldVersion-1469863940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:33:06 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-ae8ce1cb-ae50-48b0-9a50-edfdce543c92 tempest-TestServerVolumeAttachScenarioOldVersion-1469863940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:33:06 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-ae8ce1cb-ae50-48b0-9a50-edfdce543c92 tempest-TestServerVolumeAttachScenarioOldVersion-1469863940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:33:06 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-ae8ce1cb-ae50-48b0-9a50-edfdce543c92 tempest-TestServerVolumeAttachScenarioOldVersion-1469863940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:33:06 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-ae8ce1cb-ae50-48b0-9a50-edfdce543c92 tempest-TestServerVolumeAttachScenarioOldVersion-1469863940 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:33:06 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-ae8ce1cb-ae50-48b0-9a50-edfdce543c92 tempest-TestServerVolumeAttachScenarioOldVersion-1469863940 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:33:06 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-ae8ce1cb-ae50-48b0-9a50-edfdce543c92 tempest-TestServerVolumeAttachScenarioOldVersion-1469863940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c4c771f9-e051-4fe3-af69-b8acc273431a 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:33:06 devstack sudo[100925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c4c771f9-e051-4fe3-af69-b8acc273431a 1073741824
Jul 30 20:33:06 devstack sudo[100925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:33:06 devstack sudo[100918]: pam_unix(sudo:session): session closed for user root
Jul 30 20:33:06 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-7c387ef8-0c16-484b-ae96-b7d78d433e69 tempest-SnapshotsActionsTest-570958061 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58" returned: 0 in 0.429s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:33:06 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-7c387ef8-0c16-484b-ae96-b7d78d433e69 tempest-SnapshotsActionsTest-570958061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.d1f2643d-b07c-4a9d-b886-76c6d82a2f7e {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:33:06 devstack sudo[100931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.d1f2643d-b07c-4a9d-b886-76c6d82a2f7e
Jul 30 20:33:06 devstack sudo[100931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:33:06 devstack sudo[100931]: pam_unix(sudo:session): session closed for user root
Jul 30 20:33:06 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-7c387ef8-0c16-484b-ae96-b7d78d433e69 tempest-SnapshotsActionsTest-570958061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.d1f2643d-b07c-4a9d-b886-76c6d82a2f7e" returned: 0 in 0.501s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:33:06 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-7c387ef8-0c16-484b-ae96-b7d78d433e69 tempest-SnapshotsActionsTest-570958061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.d1f2643d-b07c-4a9d-b886-76c6d82a2f7e {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:33:06 devstack sudo[100925]: pam_unix(sudo:session): session closed for user root
Jul 30 20:33:06 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-ae8ce1cb-ae50-48b0-9a50-edfdce543c92 tempest-TestServerVolumeAttachScenarioOldVersion-1469863940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c4c771f9-e051-4fe3-af69-b8acc273431a 1073741824" returned: 0 in 0.621s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:33:06 devstack sudo[100941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.d1f2643d-b07c-4a9d-b886-76c6d82a2f7e
Jul 30 20:33:06 devstack sudo[100941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:33:06 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-ae8ce1cb-ae50-48b0-9a50-edfdce543c92 tempest-TestServerVolumeAttachScenarioOldVersion-1469863940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c4c771f9-e051-4fe3-af69-b8acc273431a {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:33:06 devstack sudo[100943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c4c771f9-e051-4fe3-af69-b8acc273431a
Jul 30 20:33:06 devstack sudo[100943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:33:07 devstack sudo[100943]: pam_unix(sudo:session): session closed for user root
Jul 30 20:33:07 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-ae8ce1cb-ae50-48b0-9a50-edfdce543c92 tempest-TestServerVolumeAttachScenarioOldVersion-1469863940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c4c771f9-e051-4fe3-af69-b8acc273431a" returned: 0 in 0.293s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:33:07 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-ae8ce1cb-ae50-48b0-9a50-edfdce543c92 tempest-TestServerVolumeAttachScenarioOldVersion-1469863940 None] <== create_volume: return (1002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:33:07 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-ae8ce1cb-ae50-48b0-9a50-edfdce543c92 tempest-TestServerVolumeAttachScenarioOldVersion-1469863940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.004s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:33:07 devstack sudo[100941]: pam_unix(sudo:session): session closed for user root
Jul 30 20:33:07 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-7c387ef8-0c16-484b-ae96-b7d78d433e69 tempest-SnapshotsActionsTest-570958061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58.d1f2643d-b07c-4a9d-b886-76c6d82a2f7e" returned: 0 in 0.409s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:33:07 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-ae8ce1cb-ae50-48b0-9a50-edfdce543c92 tempest-TestServerVolumeAttachScenarioOldVersion-1469863940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95d4700b-eaaa-4978-9663-61689a504f02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4c771f9-e051-4fe3-af69-b8acc273431a', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:33:07 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-ae8ce1cb-ae50-48b0-9a50-edfdce543c92 tempest-TestServerVolumeAttachScenarioOldVersion-1469863940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebc14384-61db-4322-a178-baae644a9aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:33:07 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-ae8ce1cb-ae50-48b0-9a50-edfdce543c92 tempest-TestServerVolumeAttachScenarioOldVersion-1469863940 None] Volume volume-c4c771f9-e051-4fe3-af69-b8acc273431a (c4c771f9-e051-4fe3-af69-b8acc273431a): created successfully
Jul 30 20:33:07 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-ae8ce1cb-ae50-48b0-9a50-edfdce543c92 tempest-TestServerVolumeAttachScenarioOldVersion-1469863940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebc14384-61db-4322-a178-baae644a9aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:33:07 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-ae8ce1cb-ae50-48b0-9a50-edfdce543c92 tempest-TestServerVolumeAttachScenarioOldVersion-1469863940 None] Flow 'volume_create_manager' (4879b775-7b46-4e5c-b7df-c7b2cae8c168) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:33:07 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-7c387ef8-0c16-484b-ae96-b7d78d433e69 tempest-SnapshotsActionsTest-570958061 None] Lock "cinder-quobyte-d1f2643d-b07c-4a9d-b886-76c6d82a2f7e" released by "_delete_snapshot" :: held 2.114s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:33:07 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-7c387ef8-0c16-484b-ae96-b7d78d433e69 tempest-SnapshotsActionsTest-570958061 None] Lock "cinder-quobyte-088699a2-98b7-48e0-986a-b14388fd3b58" released by "delete_snapshot" :: held 2.145s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:33:07 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-ae8ce1cb-ae50-48b0-9a50-edfdce543c92 tempest-TestServerVolumeAttachScenarioOldVersion-1469863940 None] Created volume successfully.
Jul 30 20:33:07 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-7c387ef8-0c16-484b-ae96-b7d78d433e69 tempest-SnapshotsActionsTest-570958061 None] Created reservations ['d1c1dc07-2ad8-45bb-876b-1b2ba7fe6da3', '0befab30-2d73-4e31-861c-b7f18dd4d898', '8cca0dac-2951-46d4-92ea-f9a32b88f5da', 'abaa618a-3df1-4aef-a931-d7ec2b653466'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:33:07 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-7c387ef8-0c16-484b-ae96-b7d78d433e69 tempest-SnapshotsActionsTest-570958061 None] Delete snapshot completed successfully.
Jul 30 20:33:07 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-7c387ef8-0c16-484b-ae96-b7d78d433e69 tempest-SnapshotsActionsTest-570958061 None] Lock "cinder-d1f2643d-b07c-4a9d-b886-76c6d82a2f7e-delete_snapshot" released by "delete_snapshot" :: held 2.342s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:33:08 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-50379831-8ba4-4830-917b-43c3cbee3595 tempest-SnapshotsActionsTest-570958061 None] Acquiring lock "cinder-088699a2-98b7-48e0-986a-b14388fd3b58-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:33:08 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-50379831-8ba4-4830-917b-43c3cbee3595 tempest-SnapshotsActionsTest-570958061 None] Lock "cinder-088699a2-98b7-48e0-986a-b14388fd3b58-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:33:08 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-50379831-8ba4-4830-917b-43c3cbee3595 tempest-SnapshotsActionsTest-570958061 None] Acquiring lock "cinder-quobyte-088699a2-98b7-48e0-986a-b14388fd3b58" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:33:08 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-50379831-8ba4-4830-917b-43c3cbee3595 tempest-SnapshotsActionsTest-570958061 None] Lock "cinder-quobyte-088699a2-98b7-48e0-986a-b14388fd3b58" acquired by "delete_volume" :: waited 0.027s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:33:08 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3918bb7-2be3-4b7d-ad09-cee9b84d9063]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:33:08 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-50379831-8ba4-4830-917b-43c3cbee3595 tempest-SnapshotsActionsTest-570958061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:33:08 devstack sudo[100950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58
Jul 30 20:33:08 devstack sudo[100950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:33:08 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-3019c226-0280-4dfe-bba7-0cb9ffcb99ee tempest-VolumesSnapshotNegativeTestJSON-1723256142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:33:08 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-3019c226-0280-4dfe-bba7-0cb9ffcb99ee tempest-VolumesSnapshotNegativeTestJSON-1723256142 None] Flow 'volume_create_manager' (ac9349b7-d14a-4115-a493-ee36e98d7967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:33:09 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-3019c226-0280-4dfe-bba7-0cb9ffcb99ee tempest-VolumesSnapshotNegativeTestJSON-1723256142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1020e381-d0c2-4cb5-a4d8-75956a734fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:33:09 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-3019c226-0280-4dfe-bba7-0cb9ffcb99ee tempest-VolumesSnapshotNegativeTestJSON-1723256142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1020e381-d0c2-4cb5-a4d8-75956a734fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:33:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-42148010',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1ec998d-9ffa-4511-bc7c-d76a73c02570,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48d962bf8a824b9eb9a2572bc10cf906',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:33:09Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:33:09Z,use_quota=True,user_id='4daab78f81af4ee3956c8527fcc7469a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:33:09 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-3019c226-0280-4dfe-bba7-0cb9ffcb99ee tempest-VolumesSnapshotNegativeTestJSON-1723256142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (127d1a1e-30de-49b0-adc3-e059073dac79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:33:09 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-3019c226-0280-4dfe-bba7-0cb9ffcb99ee tempest-VolumesSnapshotNegativeTestJSON-1723256142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (127d1a1e-30de-49b0-adc3-e059073dac79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:33:09 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-3019c226-0280-4dfe-bba7-0cb9ffcb99ee tempest-VolumesSnapshotNegativeTestJSON-1723256142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6e82501-354e-4a94-b772-842119567474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:33:09 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-3019c226-0280-4dfe-bba7-0cb9ffcb99ee tempest-VolumesSnapshotNegativeTestJSON-1723256142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6e82501-354e-4a94-b772-842119567474) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1ec998d-9ffa-4511-bc7c-d76a73c02570', 'volume_name': 'volume-a1ec998d-9ffa-4511-bc7c-d76a73c02570', 'volume_size': 2}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:33:09 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-3019c226-0280-4dfe-bba7-0cb9ffcb99ee tempest-VolumesSnapshotNegativeTestJSON-1723256142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53f77249-ded2-4e36-9147-36e4c7ad6ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:33:09 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-3019c226-0280-4dfe-bba7-0cb9ffcb99ee tempest-VolumesSnapshotNegativeTestJSON-1723256142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53f77249-ded2-4e36-9147-36e4c7ad6ba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:33:09 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-3019c226-0280-4dfe-bba7-0cb9ffcb99ee tempest-VolumesSnapshotNegativeTestJSON-1723256142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0196c7ff-0886-4288-b9d6-aa79f8954378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:33:09 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-3019c226-0280-4dfe-bba7-0cb9ffcb99ee tempest-VolumesSnapshotNegativeTestJSON-1723256142 None] Volume a1ec998d-9ffa-4511-bc7c-d76a73c02570: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1ec998d-9ffa-4511-bc7c-d76a73c02570', 'volume_size': 2}
Jul 30 20:33:09 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-3019c226-0280-4dfe-bba7-0cb9ffcb99ee tempest-VolumesSnapshotNegativeTestJSON-1723256142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:33:09 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-3019c226-0280-4dfe-bba7-0cb9ffcb99ee tempest-VolumesSnapshotNegativeTestJSON-1723256142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:33:09 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-3019c226-0280-4dfe-bba7-0cb9ffcb99ee tempest-VolumesSnapshotNegativeTestJSON-1723256142 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:33:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-42148010',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1ec998d-9ffa-4511-bc7c-d76a73c02570,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48d962bf8a824b9eb9a2572bc10cf906',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:33:09Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:33:09Z,use_quota=True,user_id='4daab78f81af4ee3956c8527fcc7469a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:33:09 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-3019c226-0280-4dfe-bba7-0cb9ffcb99ee tempest-VolumesSnapshotNegativeTestJSON-1723256142 None] Creating volume a1ec998d-9ffa-4511-bc7c-d76a73c02570 {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:33:09 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-3019c226-0280-4dfe-bba7-0cb9ffcb99ee tempest-VolumesSnapshotNegativeTestJSON-1723256142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:33:09 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-3019c226-0280-4dfe-bba7-0cb9ffcb99ee tempest-VolumesSnapshotNegativeTestJSON-1723256142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:33:09 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-3019c226-0280-4dfe-bba7-0cb9ffcb99ee tempest-VolumesSnapshotNegativeTestJSON-1723256142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:33:09 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-3019c226-0280-4dfe-bba7-0cb9ffcb99ee tempest-VolumesSnapshotNegativeTestJSON-1723256142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:33:09 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-3019c226-0280-4dfe-bba7-0cb9ffcb99ee tempest-VolumesSnapshotNegativeTestJSON-1723256142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:33:09 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-3019c226-0280-4dfe-bba7-0cb9ffcb99ee tempest-VolumesSnapshotNegativeTestJSON-1723256142 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:33:09 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-3019c226-0280-4dfe-bba7-0cb9ffcb99ee tempest-VolumesSnapshotNegativeTestJSON-1723256142 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:33:09 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3019c226-0280-4dfe-bba7-0cb9ffcb99ee tempest-VolumesSnapshotNegativeTestJSON-1723256142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-a1ec998d-9ffa-4511-bc7c-d76a73c02570 2147483648 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:33:09 devstack sudo[100952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-a1ec998d-9ffa-4511-bc7c-d76a73c02570 2147483648
Jul 30 20:33:09 devstack sudo[100952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:33:09 devstack sudo[100950]: pam_unix(sudo:session): session closed for user root
Jul 30 20:33:09 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-50379831-8ba4-4830-917b-43c3cbee3595 tempest-SnapshotsActionsTest-570958061 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58" returned: 0 in 0.670s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:33:09 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-50379831-8ba4-4830-917b-43c3cbee3595 tempest-SnapshotsActionsTest-570958061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:33:09 devstack sudo[100960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58
Jul 30 20:33:09 devstack sudo[100960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:33:09 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [req-19eaa242-37b6-49ec-bddb-73e81d40e37a req-ee745cd5-d60e-4e2c-8fc0-de7fb3e6ef89 tempest-TestServerVolumeAttachScenarioOldVersion-1469863940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:33:09 devstack sudo[100960]: pam_unix(sudo:session): session closed for user root
Jul 30 20:33:09 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-50379831-8ba4-4830-917b-43c3cbee3595 tempest-SnapshotsActionsTest-570958061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-088699a2-98b7-48e0-986a-b14388fd3b58" returned: 0 in 0.391s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:33:09 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-50379831-8ba4-4830-917b-43c3cbee3595 tempest-SnapshotsActionsTest-570958061 None] Lock "cinder-quobyte-088699a2-98b7-48e0-986a-b14388fd3b58" released by "delete_volume" :: held 1.177s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:33:09 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-50379831-8ba4-4830-917b-43c3cbee3595 tempest-SnapshotsActionsTest-570958061 None] Created reservations ['5366c2e3-37ef-446b-a818-cfeba1db13cd', '5ddcf6bc-7b33-48c5-a484-3bd1f4635e93', 'b21cc894-3bf9-4de9-879f-408fbe32472d', '14f7f2bc-cf03-4bda-97f9-47d3e0dc235d'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:33:09 devstack sudo[100952]: pam_unix(sudo:session): session closed for user root
Jul 30 20:33:09 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3019c226-0280-4dfe-bba7-0cb9ffcb99ee tempest-VolumesSnapshotNegativeTestJSON-1723256142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-a1ec998d-9ffa-4511-bc7c-d76a73c02570 2147483648" returned: 0 in 0.612s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:33:09 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3019c226-0280-4dfe-bba7-0cb9ffcb99ee tempest-VolumesSnapshotNegativeTestJSON-1723256142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-a1ec998d-9ffa-4511-bc7c-d76a73c02570 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:33:09 devstack sudo[100972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-a1ec998d-9ffa-4511-bc7c-d76a73c02570
Jul 30 20:33:09 devstack sudo[100972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:33:09 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-50379831-8ba4-4830-917b-43c3cbee3595 tempest-SnapshotsActionsTest-570958061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:33:09 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-50379831-8ba4-4830-917b-43c3cbee3595 tempest-SnapshotsActionsTest-570958061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:33:09 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-50379831-8ba4-4830-917b-43c3cbee3595 tempest-SnapshotsActionsTest-570958061 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:33:09 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-50379831-8ba4-4830-917b-43c3cbee3595 tempest-SnapshotsActionsTest-570958061 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:33:09 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-50379831-8ba4-4830-917b-43c3cbee3595 tempest-SnapshotsActionsTest-570958061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:33:09 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-50379831-8ba4-4830-917b-43c3cbee3595 tempest-SnapshotsActionsTest-570958061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:33:09 devstack sudo[100974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:33:09 devstack sudo[100974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:33:10 devstack sudo[100972]: pam_unix(sudo:session): session closed for user root
Jul 30 20:33:10 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3019c226-0280-4dfe-bba7-0cb9ffcb99ee tempest-VolumesSnapshotNegativeTestJSON-1723256142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-a1ec998d-9ffa-4511-bc7c-d76a73c02570" returned: 0 in 0.323s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:33:10 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-3019c226-0280-4dfe-bba7-0cb9ffcb99ee tempest-VolumesSnapshotNegativeTestJSON-1723256142 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:33:10 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-3019c226-0280-4dfe-bba7-0cb9ffcb99ee tempest-VolumesSnapshotNegativeTestJSON-1723256142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:33:10 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [req-19eaa242-37b6-49ec-bddb-73e81d40e37a req-ee745cd5-d60e-4e2c-8fc0-de7fb3e6ef89 tempest-TestServerVolumeAttachScenarioOldVersion-1469863940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.581s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:33:10 devstack sudo[100974]: pam_unix(sudo:session): session closed for user root
Jul 30 20:33:10 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-3019c226-0280-4dfe-bba7-0cb9ffcb99ee tempest-VolumesSnapshotNegativeTestJSON-1723256142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0196c7ff-0886-4288-b9d6-aa79f8954378) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1ec998d-9ffa-4511-bc7c-d76a73c02570', 'volume_size': 2}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:33:10 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-3019c226-0280-4dfe-bba7-0cb9ffcb99ee tempest-VolumesSnapshotNegativeTestJSON-1723256142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7ff9dbe-6b4f-4d6a-9373-ab287df6043d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:33:10 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-50379831-8ba4-4830-917b-43c3cbee3595 tempest-SnapshotsActionsTest-570958061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.308s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:33:10 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-50379831-8ba4-4830-917b-43c3cbee3595 tempest-SnapshotsActionsTest-570958061 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:33:10 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [req-19eaa242-37b6-49ec-bddb-73e81d40e37a req-ee745cd5-d60e-4e2c-8fc0-de7fb3e6ef89 tempest-TestServerVolumeAttachScenarioOldVersion-1469863940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.051s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:33:10 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-50379831-8ba4-4830-917b-43c3cbee3595 tempest-SnapshotsActionsTest-570958061 None] Deleted volume successfully.
Jul 30 20:33:10 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-3019c226-0280-4dfe-bba7-0cb9ffcb99ee tempest-VolumesSnapshotNegativeTestJSON-1723256142 None] Volume volume-a1ec998d-9ffa-4511-bc7c-d76a73c02570 (a1ec998d-9ffa-4511-bc7c-d76a73c02570): created successfully
Jul 30 20:33:10 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-3019c226-0280-4dfe-bba7-0cb9ffcb99ee tempest-VolumesSnapshotNegativeTestJSON-1723256142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7ff9dbe-6b4f-4d6a-9373-ab287df6043d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:33:10 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-3019c226-0280-4dfe-bba7-0cb9ffcb99ee tempest-VolumesSnapshotNegativeTestJSON-1723256142 None] Flow 'volume_create_manager' (ac9349b7-d14a-4115-a493-ee36e98d7967) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:33:10 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-3019c226-0280-4dfe-bba7-0cb9ffcb99ee tempest-VolumesSnapshotNegativeTestJSON-1723256142 None] Created volume successfully.
Jul 30 20:33:10 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-50379831-8ba4-4830-917b-43c3cbee3595 tempest-SnapshotsActionsTest-570958061 None] Lock "cinder-088699a2-98b7-48e0-986a-b14388fd3b58-delete_volume" released by "delete_volume" :: held 1.794s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:33:10 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [req-19eaa242-37b6-49ec-bddb-73e81d40e37a req-ee745cd5-d60e-4e2c-8fc0-de7fb3e6ef89 tempest-TestServerVolumeAttachScenarioOldVersion-1469863940 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5', 'name': 'volume-c4c771f9-e051-4fe3-af69-b8acc273431a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a97c3c30-ca1f-4cdf-8c9e-446c0e067957', 'enforce_multipath': True} {{(pid=88719) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 30 20:33:10 devstack cinder-volume[88719]: INFO cinder.volume.manager [req-19eaa242-37b6-49ec-bddb-73e81d40e37a req-ee745cd5-d60e-4e2c-8fc0-de7fb3e6ef89 tempest-TestServerVolumeAttachScenarioOldVersion-1469863940 None] attachment_update completed successfully.
Jul 30 20:33:11 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-51592c68-ff6d-4d2f-adf1-15f1cea6fde3 tempest-VolumesSnapshotNegativeTestJSON-1723256142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:33:11 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-51592c68-ff6d-4d2f-adf1-15f1cea6fde3 tempest-VolumesSnapshotNegativeTestJSON-1723256142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:33:11 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-51592c68-ff6d-4d2f-adf1-15f1cea6fde3 tempest-VolumesSnapshotNegativeTestJSON-1723256142 None] Creating offline snapshot 50c0ab65-c4b5-4848-bd3b-4f71ae57301b of volume a1ec998d-9ffa-4511-bc7c-d76a73c02570 {{(pid=88719) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 30 20:33:11 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[70b61b7d-509c-4f46-9592-a4da5d47c2ef]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:33:11 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-51592c68-ff6d-4d2f-adf1-15f1cea6fde3 tempest-VolumesSnapshotNegativeTestJSON-1723256142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-a1ec998d-9ffa-4511-bc7c-d76a73c02570 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:33:11 devstack sudo[101364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-a1ec998d-9ffa-4511-bc7c-d76a73c02570
Jul 30 20:33:11 devstack sudo[101364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:33:12 devstack sudo[101364]: pam_unix(sudo:session): session closed for user root
Jul 30 20:33:12 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-51592c68-ff6d-4d2f-adf1-15f1cea6fde3 tempest-VolumesSnapshotNegativeTestJSON-1723256142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-a1ec998d-9ffa-4511-bc7c-d76a73c02570" returned: 0 in 0.615s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:33:12 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-51592c68-ff6d-4d2f-adf1-15f1cea6fde3 tempest-VolumesSnapshotNegativeTestJSON-1723256142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-a1ec998d-9ffa-4511-bc7c-d76a73c02570,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-a1ec998d-9ffa-4511-bc7c-d76a73c02570.50c0ab65-c4b5-4848-bd3b-4f71ae57301b 2G {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:33:12 devstack sudo[101371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-a1ec998d-9ffa-4511-bc7c-d76a73c02570,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-a1ec998d-9ffa-4511-bc7c-d76a73c02570.50c0ab65-c4b5-4848-bd3b-4f71ae57301b 2G
Jul 30 20:33:12 devstack sudo[101371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:33:12 devstack sudo[101371]: pam_unix(sudo:session): session closed for user root
Jul 30 20:33:12 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-51592c68-ff6d-4d2f-adf1-15f1cea6fde3 tempest-VolumesSnapshotNegativeTestJSON-1723256142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-a1ec998d-9ffa-4511-bc7c-d76a73c02570,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-a1ec998d-9ffa-4511-bc7c-d76a73c02570.50c0ab65-c4b5-4848-bd3b-4f71ae57301b 2G" returned: 0 in 0.586s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:33:12 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-51592c68-ff6d-4d2f-adf1-15f1cea6fde3 tempest-VolumesSnapshotNegativeTestJSON-1723256142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1ec998d-9ffa-4511-bc7c-d76a73c02570 -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-a1ec998d-9ffa-4511-bc7c-d76a73c02570.50c0ab65-c4b5-4848-bd3b-4f71ae57301b {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:33:12 devstack sudo[101376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1ec998d-9ffa-4511-bc7c-d76a73c02570 -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-a1ec998d-9ffa-4511-bc7c-d76a73c02570.50c0ab65-c4b5-4848-bd3b-4f71ae57301b
Jul 30 20:33:12 devstack sudo[101376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:33:13 devstack sudo[101376]: pam_unix(sudo:session): session closed for user root
Jul 30 20:33:13 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-51592c68-ff6d-4d2f-adf1-15f1cea6fde3 tempest-VolumesSnapshotNegativeTestJSON-1723256142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1ec998d-9ffa-4511-bc7c-d76a73c02570 -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-a1ec998d-9ffa-4511-bc7c-d76a73c02570.50c0ab65-c4b5-4848-bd3b-4f71ae57301b" returned: 0 in 0.390s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:33:13 devstack cinder-volume[88719]: WARNING cinder.volume.drivers.remotefs [None req-51592c68-ff6d-4d2f-adf1-15f1cea6fde3 tempest-VolumesSnapshotNegativeTestJSON-1723256142 None] /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-a1ec998d-9ffa-4511-bc7c-d76a73c02570.50c0ab65-c4b5-4848-bd3b-4f71ae57301b is being set with open permissions: ugo+rw
Jul 30 20:33:13 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-51592c68-ff6d-4d2f-adf1-15f1cea6fde3 tempest-VolumesSnapshotNegativeTestJSON-1723256142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-a1ec998d-9ffa-4511-bc7c-d76a73c02570.50c0ab65-c4b5-4848-bd3b-4f71ae57301b {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:33:13 devstack sudo[101382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-a1ec998d-9ffa-4511-bc7c-d76a73c02570.50c0ab65-c4b5-4848-bd3b-4f71ae57301b
Jul 30 20:33:13 devstack sudo[101382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:33:13 devstack sudo[101382]: pam_unix(sudo:session): session closed for user root
Jul 30 20:33:13 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-51592c68-ff6d-4d2f-adf1-15f1cea6fde3 tempest-VolumesSnapshotNegativeTestJSON-1723256142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-a1ec998d-9ffa-4511-bc7c-d76a73c02570.50c0ab65-c4b5-4848-bd3b-4f71ae57301b" returned: 0 in 0.361s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:33:13 devstack cinder-volume[88719]: DEBUG dbcounter [-] [88719] Writing DB stats cinder:SELECT=164,cinder:UPDATE=166,cinder:INSERT=39,cinder:DELETE=11 {{(pid=88719) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 30 20:33:13 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-51592c68-ff6d-4d2f-adf1-15f1cea6fde3 tempest-VolumesSnapshotNegativeTestJSON-1723256142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-a1ec998d-9ffa-4511-bc7c-d76a73c02570.info {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:33:13 devstack sudo[101385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-a1ec998d-9ffa-4511-bc7c-d76a73c02570.info
Jul 30 20:33:13 devstack sudo[101385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:33:14 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-51592c68-ff6d-4d2f-adf1-15f1cea6fde3 tempest-VolumesSnapshotNegativeTestJSON-1723256142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-a1ec998d-9ffa-4511-bc7c-d76a73c02570.info" returned: 0 in 0.437s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:33:14 devstack cinder-volume[88719]: WARNING cinder.volume.drivers.remotefs [None req-51592c68-ff6d-4d2f-adf1-15f1cea6fde3 tempest-VolumesSnapshotNegativeTestJSON-1723256142 None] /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-a1ec998d-9ffa-4511-bc7c-d76a73c02570.info is being set with open permissions: ugo+rw
Jul 30 20:33:14 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-51592c68-ff6d-4d2f-adf1-15f1cea6fde3 tempest-VolumesSnapshotNegativeTestJSON-1723256142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-a1ec998d-9ffa-4511-bc7c-d76a73c02570.info {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:33:14 devstack sudo[101385]: pam_unix(sudo:session): session closed for user root
Jul 30 20:33:14 devstack sudo[101388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-a1ec998d-9ffa-4511-bc7c-d76a73c02570.info
Jul 30 20:33:14 devstack sudo[101388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:33:14 devstack sudo[101388]: pam_unix(sudo:session): session closed for user root
Jul 30 20:33:14 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-51592c68-ff6d-4d2f-adf1-15f1cea6fde3 tempest-VolumesSnapshotNegativeTestJSON-1723256142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-a1ec998d-9ffa-4511-bc7c-d76a73c02570.info" returned: 0 in 0.282s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:33:14 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-51592c68-ff6d-4d2f-adf1-15f1cea6fde3 tempest-VolumesSnapshotNegativeTestJSON-1723256142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.843s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:33:14 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-51592c68-ff6d-4d2f-adf1-15f1cea6fde3 tempest-VolumesSnapshotNegativeTestJSON-1723256142 None] Create snapshot completed successfully
Jul 30 20:33:14 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-d4b531a4-64e8-4238-8406-eeb339a46e88 tempest-VolumesSnapshotNegativeTestJSON-1723256142 None] Acquiring lock "cinder-50c0ab65-c4b5-4848-bd3b-4f71ae57301b-delete_snapshot" by "delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:33:14 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-d4b531a4-64e8-4238-8406-eeb339a46e88 tempest-VolumesSnapshotNegativeTestJSON-1723256142 None] Lock "cinder-50c0ab65-c4b5-4848-bd3b-4f71ae57301b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:33:14 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-d4b531a4-64e8-4238-8406-eeb339a46e88 tempest-VolumesSnapshotNegativeTestJSON-1723256142 None] Acquiring lock "cinder-quobyte-a1ec998d-9ffa-4511-bc7c-d76a73c02570" by "delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:33:14 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-d4b531a4-64e8-4238-8406-eeb339a46e88 tempest-VolumesSnapshotNegativeTestJSON-1723256142 None] Lock "cinder-quobyte-a1ec998d-9ffa-4511-bc7c-d76a73c02570" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:33:14 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-d4b531a4-64e8-4238-8406-eeb339a46e88 tempest-VolumesSnapshotNegativeTestJSON-1723256142 None] Acquiring lock "cinder-quobyte-50c0ab65-c4b5-4848-bd3b-4f71ae57301b" by "_delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:33:14 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-d4b531a4-64e8-4238-8406-eeb339a46e88 tempest-VolumesSnapshotNegativeTestJSON-1723256142 None] Lock "cinder-quobyte-50c0ab65-c4b5-4848-bd3b-4f71ae57301b" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:33:14 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-d4b531a4-64e8-4238-8406-eeb339a46e88 tempest-VolumesSnapshotNegativeTestJSON-1723256142 None] Deleting offline snapshot 50c0ab65-c4b5-4848-bd3b-4f71ae57301b of volume a1ec998d-9ffa-4511-bc7c-d76a73c02570 {{(pid=88719) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 30 20:33:14 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-d4b531a4-64e8-4238-8406-eeb339a46e88 tempest-VolumesSnapshotNegativeTestJSON-1723256142 None] snapshot_file for this snap is: volume-a1ec998d-9ffa-4511-bc7c-d76a73c02570.50c0ab65-c4b5-4848-bd3b-4f71ae57301b {{(pid=88719) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 30 20:33:14 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[f65982db-c4ae-4c55-9f52-8d6b8b21e8e4]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:33:14 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-d4b531a4-64e8-4238-8406-eeb339a46e88 tempest-VolumesSnapshotNegativeTestJSON-1723256142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-a1ec998d-9ffa-4511-bc7c-d76a73c02570.50c0ab65-c4b5-4848-bd3b-4f71ae57301b {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:33:15 devstack sudo[101395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-a1ec998d-9ffa-4511-bc7c-d76a73c02570.50c0ab65-c4b5-4848-bd3b-4f71ae57301b
Jul 30 20:33:15 devstack sudo[101395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:33:15 devstack cinder-volume[88719]: INFO cinder.volume.manager [req-e183b1e0-e174-401f-8265-7be43153f62a req-1662a511-5851-4c6b-9402-44882687cc68 tempest-TestServerVolumeAttachScenarioOldVersion-1469863940 None] Terminate volume connection completed successfully.
Jul 30 20:33:15 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [req-e183b1e0-e174-401f-8265-7be43153f62a req-1662a511-5851-4c6b-9402-44882687cc68 tempest-TestServerVolumeAttachScenarioOldVersion-1469863940 None] Deleting attachment a97c3c30-ca1f-4cdf-8c9e-446c0e067957. {{(pid=88719) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 30 20:33:15 devstack sudo[101395]: pam_unix(sudo:session): session closed for user root
Jul 30 20:33:15 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-d4b531a4-64e8-4238-8406-eeb339a46e88 tempest-VolumesSnapshotNegativeTestJSON-1723256142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-a1ec998d-9ffa-4511-bc7c-d76a73c02570.50c0ab65-c4b5-4848-bd3b-4f71ae57301b" returned: 0 in 0.482s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:33:15 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-d4b531a4-64e8-4238-8406-eeb339a46e88 tempest-VolumesSnapshotNegativeTestJSON-1723256142 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a1ec998d-9ffa-4511-bc7c-d76a73c02570(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88719) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 30 20:33:15 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[d38a6480-069a-485e-8e5d-a15ffda49dd6]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:33:15 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-d4b531a4-64e8-4238-8406-eeb339a46e88 tempest-VolumesSnapshotNegativeTestJSON-1723256142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-a1ec998d-9ffa-4511-bc7c-d76a73c02570 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:33:15 devstack sudo[101427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-a1ec998d-9ffa-4511-bc7c-d76a73c02570
Jul 30 20:33:15 devstack sudo[101427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:33:15 devstack sudo[101427]: pam_unix(sudo:session): session closed for user root
Jul 30 20:33:15 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-d4b531a4-64e8-4238-8406-eeb339a46e88 tempest-VolumesSnapshotNegativeTestJSON-1723256142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-a1ec998d-9ffa-4511-bc7c-d76a73c02570" returned: 0 in 0.495s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:33:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-d4b531a4-64e8-4238-8406-eeb339a46e88 tempest-VolumesSnapshotNegativeTestJSON-1723256142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-a1ec998d-9ffa-4511-bc7c-d76a73c02570.50c0ab65-c4b5-4848-bd3b-4f71ae57301b {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:33:16 devstack sudo[101432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-a1ec998d-9ffa-4511-bc7c-d76a73c02570.50c0ab65-c4b5-4848-bd3b-4f71ae57301b
Jul 30 20:33:16 devstack sudo[101432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:33:16 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-83812e22-7e9c-4b07-991d-79f721a42306 tempest-TestServerVolumeAttachScenarioOldVersion-1469863940 None] Acquiring lock "cinder-c4c771f9-e051-4fe3-af69-b8acc273431a-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:33:16 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-83812e22-7e9c-4b07-991d-79f721a42306 tempest-TestServerVolumeAttachScenarioOldVersion-1469863940 None] Lock "cinder-c4c771f9-e051-4fe3-af69-b8acc273431a-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:33:16 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-83812e22-7e9c-4b07-991d-79f721a42306 tempest-TestServerVolumeAttachScenarioOldVersion-1469863940 None] Acquiring lock "cinder-quobyte-c4c771f9-e051-4fe3-af69-b8acc273431a" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:33:16 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-83812e22-7e9c-4b07-991d-79f721a42306 tempest-TestServerVolumeAttachScenarioOldVersion-1469863940 None] Lock "cinder-quobyte-c4c771f9-e051-4fe3-af69-b8acc273431a" acquired by "delete_volume" :: waited 0.024s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:33:16 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e2c144d-49ae-4ba3-a202-0346e7f2d7d1]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:33:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-83812e22-7e9c-4b07-991d-79f721a42306 tempest-TestServerVolumeAttachScenarioOldVersion-1469863940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c4c771f9-e051-4fe3-af69-b8acc273431a {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:33:16 devstack cinder-volume[88719]: DEBUG oslo_service.periodic_task [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88719) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 30 20:33:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:33:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:33:16 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:33:16 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:33:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:33:16 devstack sudo[101436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c4c771f9-e051-4fe3-af69-b8acc273431a
Jul 30 20:33:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:33:16 devstack sudo[101436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:33:16 devstack sudo[101440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:33:16 devstack sudo[101440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:33:16 devstack sudo[101432]: pam_unix(sudo:session): session closed for user root
Jul 30 20:33:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-d4b531a4-64e8-4238-8406-eeb339a46e88 tempest-VolumesSnapshotNegativeTestJSON-1723256142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-a1ec998d-9ffa-4511-bc7c-d76a73c02570.50c0ab65-c4b5-4848-bd3b-4f71ae57301b" returned: 0 in 0.550s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:33:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-d4b531a4-64e8-4238-8406-eeb339a46e88 tempest-VolumesSnapshotNegativeTestJSON-1723256142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-a1ec998d-9ffa-4511-bc7c-d76a73c02570.50c0ab65-c4b5-4848-bd3b-4f71ae57301b {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:33:16 devstack sudo[101442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-a1ec998d-9ffa-4511-bc7c-d76a73c02570.50c0ab65-c4b5-4848-bd3b-4f71ae57301b
Jul 30 20:33:16 devstack sudo[101442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:33:16 devstack sudo[101436]: pam_unix(sudo:session): session closed for user root
Jul 30 20:33:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-83812e22-7e9c-4b07-991d-79f721a42306 tempest-TestServerVolumeAttachScenarioOldVersion-1469863940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c4c771f9-e051-4fe3-af69-b8acc273431a" returned: 0 in 0.433s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:33:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-83812e22-7e9c-4b07-991d-79f721a42306 tempest-TestServerVolumeAttachScenarioOldVersion-1469863940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c4c771f9-e051-4fe3-af69-b8acc273431a {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:33:16 devstack sudo[101448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c4c771f9-e051-4fe3-af69-b8acc273431a
Jul 30 20:33:16 devstack sudo[101448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:33:16 devstack sudo[101442]: pam_unix(sudo:session): session closed for user root
Jul 30 20:33:16 devstack sudo[101440]: pam_unix(sudo:session): session closed for user root
Jul 30 20:33:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-d4b531a4-64e8-4238-8406-eeb339a46e88 tempest-VolumesSnapshotNegativeTestJSON-1723256142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-a1ec998d-9ffa-4511-bc7c-d76a73c02570.50c0ab65-c4b5-4848-bd3b-4f71ae57301b" returned: 0 in 0.333s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:33:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.429s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:33:16 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:33:16 devstack cinder-volume[88719]: DEBUG oslo_service.periodic_task [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Running periodic task VolumeManager._thread_info {{(pid=88719) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 30 20:33:16 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] thread count: 28 {{(pid=88719) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 30 20:33:16 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] thread info: [<_MainThread(MainThread, started 132390416908416)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132390306497536)>, <Thread(Thread-3 (stat_writer), started daemon 132390304471680)>, <Thread(Rabbit-heartbeat, started daemon 132390303393408)>, <Thread(Thread-5 (_runner), started daemon 132390303543168)>, <Thread(Thread-7 (_runner), started daemon 132390303563392)>, <Thread(fd_logger, started daemon 132390301344640)>, <Thread(privsep_reader, started daemon 132390301560640)>, <Thread(tpool_thread_0, started daemon 132390291470016)>, <Thread(tpool_thread_1, started daemon 132390283077312)>, <Thread(tpool_thread_2, started daemon 132390274684608)>, <Thread(tpool_thread_3, started daemon 132390266291904)>, <Thread(tpool_thread_4, started daemon 132390257899200)>, <Thread(tpool_thread_5, started daemon 132390249506496)>, <Thread(tpool_thread_6, started daemon 132390241113792)>, <Thread(tpool_thread_7, started daemon 132390232721088)>, <Thread(tpool_thread_8, started daemon 132390224328384)>, <Thread(tpool_thread_9, started daemon 132390215919296)>, <Thread(tpool_thread_10, started daemon 132390207510208)>, <Thread(tpool_thread_11, started daemon 132390199101120)>, <Thread(tpool_thread_12, started daemon 132390190692032)>, <Thread(tpool_thread_13, started daemon 132390182282944)>, <Thread(tpool_thread_14, started daemon 132390173873856)>, <Thread(tpool_thread_15, started daemon 132390165464768)>, <Thread(tpool_thread_16, started daemon 132390157055680)>, <Thread(tpool_thread_17, started daemon 132390148646592)>, <Thread(tpool_thread_18, started daemon 132390140237504)>, <Thread(tpool_thread_19, started daemon 132390131828416)>] {{(pid=88719) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 30 20:33:16 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-d4b531a4-64e8-4238-8406-eeb339a46e88 tempest-VolumesSnapshotNegativeTestJSON-1723256142 None] Lock "cinder-quobyte-50c0ab65-c4b5-4848-bd3b-4f71ae57301b" released by "_delete_snapshot" :: held 2.037s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:33:16 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-d4b531a4-64e8-4238-8406-eeb339a46e88 tempest-VolumesSnapshotNegativeTestJSON-1723256142 None] Lock "cinder-quobyte-a1ec998d-9ffa-4511-bc7c-d76a73c02570" released by "delete_snapshot" :: held 2.070s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:33:17 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-d4b531a4-64e8-4238-8406-eeb339a46e88 tempest-VolumesSnapshotNegativeTestJSON-1723256142 None] Created reservations ['b8941664-8953-4d54-bb26-019dc5041034', '50f644b6-ec0c-4922-a8aa-3c2294240a7e', '80be34ae-c1df-418b-9646-b0ecd57eba36', '8b1ad754-6179-4da2-a181-7b965f0a84f0'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:33:17 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-d4b531a4-64e8-4238-8406-eeb339a46e88 tempest-VolumesSnapshotNegativeTestJSON-1723256142 None] Delete snapshot completed successfully.
Jul 30 20:33:17 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-d4b531a4-64e8-4238-8406-eeb339a46e88 tempest-VolumesSnapshotNegativeTestJSON-1723256142 None] Lock "cinder-50c0ab65-c4b5-4848-bd3b-4f71ae57301b-delete_snapshot" released by "delete_snapshot" :: held 2.269s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:33:17 devstack sudo[101448]: pam_unix(sudo:session): session closed for user root
Jul 30 20:33:17 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-83812e22-7e9c-4b07-991d-79f721a42306 tempest-TestServerVolumeAttachScenarioOldVersion-1469863940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c4c771f9-e051-4fe3-af69-b8acc273431a" returned: 0 in 0.385s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:33:17 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-83812e22-7e9c-4b07-991d-79f721a42306 tempest-TestServerVolumeAttachScenarioOldVersion-1469863940 None] Lock "cinder-quobyte-c4c771f9-e051-4fe3-af69-b8acc273431a" released by "delete_volume" :: held 0.876s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:33:17 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-83812e22-7e9c-4b07-991d-79f721a42306 tempest-TestServerVolumeAttachScenarioOldVersion-1469863940 None] Created reservations ['c28adf97-1985-44a4-bcee-29f8409d9866', '273c4c7e-3b55-4183-ac12-c1b5ac58057e', 'f807a41a-44f7-4b54-a237-d0807db37652', '468052df-38ac-46f9-8e73-93caa1899757'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:33:17 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-83812e22-7e9c-4b07-991d-79f721a42306 tempest-TestServerVolumeAttachScenarioOldVersion-1469863940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:33:17 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-83812e22-7e9c-4b07-991d-79f721a42306 tempest-TestServerVolumeAttachScenarioOldVersion-1469863940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:33:17 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-83812e22-7e9c-4b07-991d-79f721a42306 tempest-TestServerVolumeAttachScenarioOldVersion-1469863940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:33:17 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-83812e22-7e9c-4b07-991d-79f721a42306 tempest-TestServerVolumeAttachScenarioOldVersion-1469863940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:33:17 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-83812e22-7e9c-4b07-991d-79f721a42306 tempest-TestServerVolumeAttachScenarioOldVersion-1469863940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:33:17 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-83812e22-7e9c-4b07-991d-79f721a42306 tempest-TestServerVolumeAttachScenarioOldVersion-1469863940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:33:17 devstack sudo[101453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:33:17 devstack sudo[101453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:33:17 devstack sudo[101453]: pam_unix(sudo:session): session closed for user root
Jul 30 20:33:17 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-83812e22-7e9c-4b07-991d-79f721a42306 tempest-TestServerVolumeAttachScenarioOldVersion-1469863940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.367s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:33:17 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-83812e22-7e9c-4b07-991d-79f721a42306 tempest-TestServerVolumeAttachScenarioOldVersion-1469863940 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:33:17 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-83812e22-7e9c-4b07-991d-79f721a42306 tempest-TestServerVolumeAttachScenarioOldVersion-1469863940 None] Deleted volume successfully.
Jul 30 20:33:17 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-83812e22-7e9c-4b07-991d-79f721a42306 tempest-TestServerVolumeAttachScenarioOldVersion-1469863940 None] Lock "cinder-c4c771f9-e051-4fe3-af69-b8acc273431a-delete_volume" released by "delete_volume" :: held 1.506s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:33:18 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-8c2207f7-b080-4d38-b19f-0d6a14b61250 tempest-VolumesSnapshotNegativeTestJSON-1723256142 None] Acquiring lock "cinder-a1ec998d-9ffa-4511-bc7c-d76a73c02570-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:33:18 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-8c2207f7-b080-4d38-b19f-0d6a14b61250 tempest-VolumesSnapshotNegativeTestJSON-1723256142 None] Lock "cinder-a1ec998d-9ffa-4511-bc7c-d76a73c02570-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:33:18 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-8c2207f7-b080-4d38-b19f-0d6a14b61250 tempest-VolumesSnapshotNegativeTestJSON-1723256142 None] Acquiring lock "cinder-quobyte-a1ec998d-9ffa-4511-bc7c-d76a73c02570" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:33:18 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-8c2207f7-b080-4d38-b19f-0d6a14b61250 tempest-VolumesSnapshotNegativeTestJSON-1723256142 None] Lock "cinder-quobyte-a1ec998d-9ffa-4511-bc7c-d76a73c02570" acquired by "delete_volume" :: waited 0.013s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:33:18 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[412a3ff9-525d-44ac-a0f3-4bffbae9bc91]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:33:18 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8c2207f7-b080-4d38-b19f-0d6a14b61250 tempest-VolumesSnapshotNegativeTestJSON-1723256142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-a1ec998d-9ffa-4511-bc7c-d76a73c02570 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:33:18 devstack sudo[101479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-a1ec998d-9ffa-4511-bc7c-d76a73c02570
Jul 30 20:33:18 devstack sudo[101479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:33:19 devstack sudo[101479]: pam_unix(sudo:session): session closed for user root
Jul 30 20:33:19 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8c2207f7-b080-4d38-b19f-0d6a14b61250 tempest-VolumesSnapshotNegativeTestJSON-1723256142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-a1ec998d-9ffa-4511-bc7c-d76a73c02570" returned: 0 in 0.525s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:33:19 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8c2207f7-b080-4d38-b19f-0d6a14b61250 tempest-VolumesSnapshotNegativeTestJSON-1723256142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-a1ec998d-9ffa-4511-bc7c-d76a73c02570 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:33:19 devstack sudo[101485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-a1ec998d-9ffa-4511-bc7c-d76a73c02570
Jul 30 20:33:19 devstack sudo[101485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:33:19 devstack sudo[101485]: pam_unix(sudo:session): session closed for user root
Jul 30 20:33:19 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8c2207f7-b080-4d38-b19f-0d6a14b61250 tempest-VolumesSnapshotNegativeTestJSON-1723256142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-a1ec998d-9ffa-4511-bc7c-d76a73c02570" returned: 0 in 0.404s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:33:19 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-8c2207f7-b080-4d38-b19f-0d6a14b61250 tempest-VolumesSnapshotNegativeTestJSON-1723256142 None] Lock "cinder-quobyte-a1ec998d-9ffa-4511-bc7c-d76a73c02570" released by "delete_volume" :: held 1.023s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:33:19 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-8c2207f7-b080-4d38-b19f-0d6a14b61250 tempest-VolumesSnapshotNegativeTestJSON-1723256142 None] Created reservations ['ea9d2fcd-c421-413b-a2c5-0be5e46de2d2', '114c0bac-8535-413f-a28b-c4981e395a4b', '3e7f8765-7460-4d91-99ee-3207ae61d08e', '94e6e70b-95a4-4d94-af14-81bfb44ace98'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:33:19 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-8c2207f7-b080-4d38-b19f-0d6a14b61250 tempest-VolumesSnapshotNegativeTestJSON-1723256142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:33:19 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-8c2207f7-b080-4d38-b19f-0d6a14b61250 tempest-VolumesSnapshotNegativeTestJSON-1723256142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:33:19 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-8c2207f7-b080-4d38-b19f-0d6a14b61250 tempest-VolumesSnapshotNegativeTestJSON-1723256142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:33:19 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-8c2207f7-b080-4d38-b19f-0d6a14b61250 tempest-VolumesSnapshotNegativeTestJSON-1723256142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:33:19 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-8c2207f7-b080-4d38-b19f-0d6a14b61250 tempest-VolumesSnapshotNegativeTestJSON-1723256142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:33:19 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8c2207f7-b080-4d38-b19f-0d6a14b61250 tempest-VolumesSnapshotNegativeTestJSON-1723256142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:33:19 devstack sudo[101489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:33:19 devstack sudo[101489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:33:19 devstack sudo[101489]: pam_unix(sudo:session): session closed for user root
Jul 30 20:33:19 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8c2207f7-b080-4d38-b19f-0d6a14b61250 tempest-VolumesSnapshotNegativeTestJSON-1723256142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.274s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:33:19 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-8c2207f7-b080-4d38-b19f-0d6a14b61250 tempest-VolumesSnapshotNegativeTestJSON-1723256142 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:33:19 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-8c2207f7-b080-4d38-b19f-0d6a14b61250 tempest-VolumesSnapshotNegativeTestJSON-1723256142 None] Deleted volume successfully.
Jul 30 20:33:20 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-8c2207f7-b080-4d38-b19f-0d6a14b61250 tempest-VolumesSnapshotNegativeTestJSON-1723256142 None] Lock "cinder-a1ec998d-9ffa-4511-bc7c-d76a73c02570-delete_volume" released by "delete_volume" :: held 1.580s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:33:27 devstack cinder-volume[88719]: DEBUG dbcounter [-] [88719] Writing DB stats cinder:UPDATE=167,cinder:SELECT=149,cinder:INSERT=61,cinder:DELETE=13 {{(pid=88719) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 30 20:33:27 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2a8c698-4d45-44e8-9410-10ec1831e707 tempest-TestImageHashVerification-1676059427 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:33:27 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e2a8c698-4d45-44e8-9410-10ec1831e707 tempest-TestImageHashVerification-1676059427 None] Flow 'volume_create_manager' (37585d86-95cb-4215-9645-bead345229ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:33:27 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e2a8c698-4d45-44e8-9410-10ec1831e707 tempest-TestImageHashVerification-1676059427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0bf8381-db10-4513-acb1-f848bad86e6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:33:27 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e2a8c698-4d45-44e8-9410-10ec1831e707 tempest-TestImageHashVerification-1676059427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0bf8381-db10-4513-acb1-f848bad86e6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:33:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-530468858',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8ed7ec8-8372-4984-a96d-bf41e9ff6908,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='630b40dc5ee84b7dab1c569e421ba1d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:33:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:33:27Z,use_quota=True,user_id='d6db6c99b1b0496e919709e2b7c0f358',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:33:27 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e2a8c698-4d45-44e8-9410-10ec1831e707 tempest-TestImageHashVerification-1676059427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a4968c8-2348-48b8-beaf-61e847344c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:33:27 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e2a8c698-4d45-44e8-9410-10ec1831e707 tempest-TestImageHashVerification-1676059427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a4968c8-2348-48b8-beaf-61e847344c3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:33:27 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e2a8c698-4d45-44e8-9410-10ec1831e707 tempest-TestImageHashVerification-1676059427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f70c0c7-4121-46f8-a874-29dfd51943af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:33:27 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e2a8c698-4d45-44e8-9410-10ec1831e707 tempest-TestImageHashVerification-1676059427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f70c0c7-4121-46f8-a874-29dfd51943af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8ed7ec8-8372-4984-a96d-bf41e9ff6908', 'volume_name': 'volume-f8ed7ec8-8372-4984-a96d-bf41e9ff6908', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:33:27 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e2a8c698-4d45-44e8-9410-10ec1831e707 tempest-TestImageHashVerification-1676059427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63af6da2-d14c-4cd2-a4e6-26c4af41ca2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:33:27 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e2a8c698-4d45-44e8-9410-10ec1831e707 tempest-TestImageHashVerification-1676059427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63af6da2-d14c-4cd2-a4e6-26c4af41ca2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:33:27 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e2a8c698-4d45-44e8-9410-10ec1831e707 tempest-TestImageHashVerification-1676059427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfa04986-8982-4fe2-abd7-49904e85e583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:33:27 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-e2a8c698-4d45-44e8-9410-10ec1831e707 tempest-TestImageHashVerification-1676059427 None] Volume f8ed7ec8-8372-4984-a96d-bf41e9ff6908: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8ed7ec8-8372-4984-a96d-bf41e9ff6908', 'volume_size': 1}
Jul 30 20:33:27 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-e2a8c698-4d45-44e8-9410-10ec1831e707 tempest-TestImageHashVerification-1676059427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:33:27 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-e2a8c698-4d45-44e8-9410-10ec1831e707 tempest-TestImageHashVerification-1676059427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:33:27 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-e2a8c698-4d45-44e8-9410-10ec1831e707 tempest-TestImageHashVerification-1676059427 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:33:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-530468858',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8ed7ec8-8372-4984-a96d-bf41e9ff6908,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='630b40dc5ee84b7dab1c569e421ba1d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:33:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:33:27Z,use_quota=True,user_id='d6db6c99b1b0496e919709e2b7c0f358',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:33:27 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-e2a8c698-4d45-44e8-9410-10ec1831e707 tempest-TestImageHashVerification-1676059427 None] Creating volume f8ed7ec8-8372-4984-a96d-bf41e9ff6908 {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:33:27 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-e2a8c698-4d45-44e8-9410-10ec1831e707 tempest-TestImageHashVerification-1676059427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:33:27 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-e2a8c698-4d45-44e8-9410-10ec1831e707 tempest-TestImageHashVerification-1676059427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:33:27 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-e2a8c698-4d45-44e8-9410-10ec1831e707 tempest-TestImageHashVerification-1676059427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:33:27 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-e2a8c698-4d45-44e8-9410-10ec1831e707 tempest-TestImageHashVerification-1676059427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:33:27 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-e2a8c698-4d45-44e8-9410-10ec1831e707 tempest-TestImageHashVerification-1676059427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:33:27 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-e2a8c698-4d45-44e8-9410-10ec1831e707 tempest-TestImageHashVerification-1676059427 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:33:27 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-e2a8c698-4d45-44e8-9410-10ec1831e707 tempest-TestImageHashVerification-1676059427 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:33:27 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-e2a8c698-4d45-44e8-9410-10ec1831e707 tempest-TestImageHashVerification-1676059427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f8ed7ec8-8372-4984-a96d-bf41e9ff6908 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:33:27 devstack sudo[101495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f8ed7ec8-8372-4984-a96d-bf41e9ff6908 1073741824
Jul 30 20:33:27 devstack sudo[101495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:33:27 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-66edd616-f6b3-4878-b63e-497437788212 tempest-VolumeRetypeWithoutMigrationTest-678467801 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:33:27 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-66edd616-f6b3-4878-b63e-497437788212 tempest-VolumeRetypeWithoutMigrationTest-678467801 None] Flow 'volume_create_manager' (74efd7e3-b745-4061-92b3-9688862d5d46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:33:27 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-66edd616-f6b3-4878-b63e-497437788212 tempest-VolumeRetypeWithoutMigrationTest-678467801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65e7ae1a-0570-4157-8d6e-7e6d09f60e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:33:27 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-66edd616-f6b3-4878-b63e-497437788212 tempest-VolumeRetypeWithoutMigrationTest-678467801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65e7ae1a-0570-4157-8d6e-7e6d09f60e60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:33:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1641353173',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e569a066-1655-4e98-b146-3e5963c2f7d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f4e657ecddb44c9b8d38b0d02a47471',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:33:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:33:28Z,use_quota=True,user_id='0c40c01ea72c446c90db093329f59a3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091aeb31-40d9-4c25-8e6f-0f835ede3aeb),volume_type_id=091aeb31-40d9-4c25-8e6f-0f835ede3aeb)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:33:27 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-66edd616-f6b3-4878-b63e-497437788212 tempest-VolumeRetypeWithoutMigrationTest-678467801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8114eb4a-9ea9-451d-992a-77807a909ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:33:27 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-66edd616-f6b3-4878-b63e-497437788212 tempest-VolumeRetypeWithoutMigrationTest-678467801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8114eb4a-9ea9-451d-992a-77807a909ed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:33:27 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-66edd616-f6b3-4878-b63e-497437788212 tempest-VolumeRetypeWithoutMigrationTest-678467801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07d44abe-2511-407b-a221-1e8ba9bedaf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:33:27 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-66edd616-f6b3-4878-b63e-497437788212 tempest-VolumeRetypeWithoutMigrationTest-678467801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07d44abe-2511-407b-a221-1e8ba9bedaf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e569a066-1655-4e98-b146-3e5963c2f7d3', 'volume_name': 'volume-e569a066-1655-4e98-b146-3e5963c2f7d3', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:33:27 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-66edd616-f6b3-4878-b63e-497437788212 tempest-VolumeRetypeWithoutMigrationTest-678467801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6868aee4-fe0a-4cc4-a369-8085d56b1c22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:33:27 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-66edd616-f6b3-4878-b63e-497437788212 tempest-VolumeRetypeWithoutMigrationTest-678467801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6868aee4-fe0a-4cc4-a369-8085d56b1c22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:33:27 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-66edd616-f6b3-4878-b63e-497437788212 tempest-VolumeRetypeWithoutMigrationTest-678467801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ca5d18f-ad8b-4f95-8ab2-8d6d042dc23f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:33:27 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-66edd616-f6b3-4878-b63e-497437788212 tempest-VolumeRetypeWithoutMigrationTest-678467801 None] Volume e569a066-1655-4e98-b146-3e5963c2f7d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e569a066-1655-4e98-b146-3e5963c2f7d3', 'volume_size': 1}
Jul 30 20:33:27 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-66edd616-f6b3-4878-b63e-497437788212 tempest-VolumeRetypeWithoutMigrationTest-678467801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:33:28 devstack sudo[101495]: pam_unix(sudo:session): session closed for user root
Jul 30 20:33:28 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-e2a8c698-4d45-44e8-9410-10ec1831e707 tempest-TestImageHashVerification-1676059427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f8ed7ec8-8372-4984-a96d-bf41e9ff6908 1073741824" returned: 0 in 0.577s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:33:28 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-e2a8c698-4d45-44e8-9410-10ec1831e707 tempest-TestImageHashVerification-1676059427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f8ed7ec8-8372-4984-a96d-bf41e9ff6908 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:33:28 devstack sudo[101502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f8ed7ec8-8372-4984-a96d-bf41e9ff6908
Jul 30 20:33:28 devstack sudo[101502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:33:28 devstack sudo[101502]: pam_unix(sudo:session): session closed for user root
Jul 30 20:33:28 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-e2a8c698-4d45-44e8-9410-10ec1831e707 tempest-TestImageHashVerification-1676059427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f8ed7ec8-8372-4984-a96d-bf41e9ff6908" returned: 0 in 0.285s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:33:28 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-e2a8c698-4d45-44e8-9410-10ec1831e707 tempest-TestImageHashVerification-1676059427 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:33:28 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-e2a8c698-4d45-44e8-9410-10ec1831e707 tempest-TestImageHashVerification-1676059427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:33:28 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-66edd616-f6b3-4878-b63e-497437788212 tempest-VolumeRetypeWithoutMigrationTest-678467801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.587s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:33:28 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-66edd616-f6b3-4878-b63e-497437788212 tempest-VolumeRetypeWithoutMigrationTest-678467801 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:33:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1641353173',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e569a066-1655-4e98-b146-3e5963c2f7d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f4e657ecddb44c9b8d38b0d02a47471',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:33:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:33:28Z,use_quota=True,user_id='0c40c01ea72c446c90db093329f59a3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091aeb31-40d9-4c25-8e6f-0f835ede3aeb),volume_type_id=091aeb31-40d9-4c25-8e6f-0f835ede3aeb)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:33:28 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-66edd616-f6b3-4878-b63e-497437788212 tempest-VolumeRetypeWithoutMigrationTest-678467801 None] Creating volume e569a066-1655-4e98-b146-3e5963c2f7d3 {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:33:28 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-66edd616-f6b3-4878-b63e-497437788212 tempest-VolumeRetypeWithoutMigrationTest-678467801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:33:28 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-66edd616-f6b3-4878-b63e-497437788212 tempest-VolumeRetypeWithoutMigrationTest-678467801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:33:28 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-66edd616-f6b3-4878-b63e-497437788212 tempest-VolumeRetypeWithoutMigrationTest-678467801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:33:28 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-66edd616-f6b3-4878-b63e-497437788212 tempest-VolumeRetypeWithoutMigrationTest-678467801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:33:28 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-66edd616-f6b3-4878-b63e-497437788212 tempest-VolumeRetypeWithoutMigrationTest-678467801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:33:28 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-66edd616-f6b3-4878-b63e-497437788212 tempest-VolumeRetypeWithoutMigrationTest-678467801 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:33:28 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-66edd616-f6b3-4878-b63e-497437788212 tempest-VolumeRetypeWithoutMigrationTest-678467801 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:33:28 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-66edd616-f6b3-4878-b63e-497437788212 tempest-VolumeRetypeWithoutMigrationTest-678467801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-e569a066-1655-4e98-b146-3e5963c2f7d3 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:33:28 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e2a8c698-4d45-44e8-9410-10ec1831e707 tempest-TestImageHashVerification-1676059427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfa04986-8982-4fe2-abd7-49904e85e583) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8ed7ec8-8372-4984-a96d-bf41e9ff6908', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:33:28 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e2a8c698-4d45-44e8-9410-10ec1831e707 tempest-TestImageHashVerification-1676059427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bea677d8-9495-4f49-96fe-a3e53728aba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:33:28 devstack sudo[101505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-e569a066-1655-4e98-b146-3e5963c2f7d3 1073741824
Jul 30 20:33:28 devstack sudo[101505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:33:28 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-e2a8c698-4d45-44e8-9410-10ec1831e707 tempest-TestImageHashVerification-1676059427 None] Volume volume-f8ed7ec8-8372-4984-a96d-bf41e9ff6908 (f8ed7ec8-8372-4984-a96d-bf41e9ff6908): created successfully
Jul 30 20:33:28 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e2a8c698-4d45-44e8-9410-10ec1831e707 tempest-TestImageHashVerification-1676059427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bea677d8-9495-4f49-96fe-a3e53728aba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:33:28 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e2a8c698-4d45-44e8-9410-10ec1831e707 tempest-TestImageHashVerification-1676059427 None] Flow 'volume_create_manager' (37585d86-95cb-4215-9645-bead345229ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:33:28 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-e2a8c698-4d45-44e8-9410-10ec1831e707 tempest-TestImageHashVerification-1676059427 None] Created volume successfully.
Jul 30 20:33:28 devstack sudo[101505]: pam_unix(sudo:session): session closed for user root
Jul 30 20:33:28 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-66edd616-f6b3-4878-b63e-497437788212 tempest-VolumeRetypeWithoutMigrationTest-678467801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-e569a066-1655-4e98-b146-3e5963c2f7d3 1073741824" returned: 0 in 0.547s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:33:29 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-66edd616-f6b3-4878-b63e-497437788212 tempest-VolumeRetypeWithoutMigrationTest-678467801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-e569a066-1655-4e98-b146-3e5963c2f7d3 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:33:29 devstack sudo[101511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-e569a066-1655-4e98-b146-3e5963c2f7d3
Jul 30 20:33:29 devstack sudo[101511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:33:29 devstack sudo[101511]: pam_unix(sudo:session): session closed for user root
Jul 30 20:33:29 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-66edd616-f6b3-4878-b63e-497437788212 tempest-VolumeRetypeWithoutMigrationTest-678467801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-e569a066-1655-4e98-b146-3e5963c2f7d3" returned: 0 in 0.294s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:33:29 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-66edd616-f6b3-4878-b63e-497437788212 tempest-VolumeRetypeWithoutMigrationTest-678467801 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:33:29 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-66edd616-f6b3-4878-b63e-497437788212 tempest-VolumeRetypeWithoutMigrationTest-678467801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:33:29 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-66edd616-f6b3-4878-b63e-497437788212 tempest-VolumeRetypeWithoutMigrationTest-678467801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ca5d18f-ad8b-4f95-8ab2-8d6d042dc23f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e569a066-1655-4e98-b146-3e5963c2f7d3', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:33:29 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-66edd616-f6b3-4878-b63e-497437788212 tempest-VolumeRetypeWithoutMigrationTest-678467801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d34b1bdd-5e2c-4ac9-8089-bd13da268d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:33:29 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-66edd616-f6b3-4878-b63e-497437788212 tempest-VolumeRetypeWithoutMigrationTest-678467801 None] Volume volume-e569a066-1655-4e98-b146-3e5963c2f7d3 (e569a066-1655-4e98-b146-3e5963c2f7d3): created successfully
Jul 30 20:33:29 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-66edd616-f6b3-4878-b63e-497437788212 tempest-VolumeRetypeWithoutMigrationTest-678467801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d34b1bdd-5e2c-4ac9-8089-bd13da268d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:33:29 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-66edd616-f6b3-4878-b63e-497437788212 tempest-VolumeRetypeWithoutMigrationTest-678467801 None] Flow 'volume_create_manager' (74efd7e3-b745-4061-92b3-9688862d5d46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:33:29 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-66edd616-f6b3-4878-b63e-497437788212 tempest-VolumeRetypeWithoutMigrationTest-678467801 None] Created volume successfully.
Jul 30 20:33:30 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-34161e0e-57f3-49fa-a7a2-8088bd3972cf tempest-VolumeRetypeWithoutMigrationTest-678467801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:33:30 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-34161e0e-57f3-49fa-a7a2-8088bd3972cf tempest-VolumeRetypeWithoutMigrationTest-678467801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:33:30 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-34161e0e-57f3-49fa-a7a2-8088bd3972cf tempest-VolumeRetypeWithoutMigrationTest-678467801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:33:30 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-34161e0e-57f3-49fa-a7a2-8088bd3972cf tempest-VolumeRetypeWithoutMigrationTest-678467801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:33:30 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-34161e0e-57f3-49fa-a7a2-8088bd3972cf tempest-VolumeRetypeWithoutMigrationTest-678467801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:33:30 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-34161e0e-57f3-49fa-a7a2-8088bd3972cf tempest-VolumeRetypeWithoutMigrationTest-678467801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:33:30 devstack sudo[101514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:33:30 devstack sudo[101514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:33:30 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-4ea2699a-3dba-4a6e-9700-b0e37c24d3a0 tempest-TestImageHashVerification-1676059427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:33:30 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-4ea2699a-3dba-4a6e-9700-b0e37c24d3a0 tempest-TestImageHashVerification-1676059427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:33:30 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbb29b3d-1916-47c8-82c3-2c017cda6f2a]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:33:30 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-4ea2699a-3dba-4a6e-9700-b0e37c24d3a0 tempest-TestImageHashVerification-1676059427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f8ed7ec8-8372-4984-a96d-bf41e9ff6908 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:33:30 devstack sudo[101514]: pam_unix(sudo:session): session closed for user root
Jul 30 20:33:30 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-34161e0e-57f3-49fa-a7a2-8088bd3972cf tempest-VolumeRetypeWithoutMigrationTest-678467801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.343s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:33:30 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-34161e0e-57f3-49fa-a7a2-8088bd3972cf tempest-VolumeRetypeWithoutMigrationTest-678467801 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:33:30 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-34161e0e-57f3-49fa-a7a2-8088bd3972cf tempest-VolumeRetypeWithoutMigrationTest-678467801 None] Retype volume completed successfully.
Jul 30 20:33:30 devstack sudo[101517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f8ed7ec8-8372-4984-a96d-bf41e9ff6908
Jul 30 20:33:30 devstack sudo[101517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:33:31 devstack sudo[101517]: pam_unix(sudo:session): session closed for user root
Jul 30 20:33:31 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-4ea2699a-3dba-4a6e-9700-b0e37c24d3a0 tempest-TestImageHashVerification-1676059427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f8ed7ec8-8372-4984-a96d-bf41e9ff6908" returned: 0 in 0.479s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:33:31 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0578e2b-e83f-42bd-933e-5fbf636b8ab2]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:33:31 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-4ea2699a-3dba-4a6e-9700-b0e37c24d3a0 tempest-TestImageHashVerification-1676059427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f8ed7ec8-8372-4984-a96d-bf41e9ff6908 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:33:31 devstack sudo[101523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f8ed7ec8-8372-4984-a96d-bf41e9ff6908
Jul 30 20:33:31 devstack sudo[101523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:33:31 devstack sudo[101523]: pam_unix(sudo:session): session closed for user root
Jul 30 20:33:31 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-4ea2699a-3dba-4a6e-9700-b0e37c24d3a0 tempest-TestImageHashVerification-1676059427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f8ed7ec8-8372-4984-a96d-bf41e9ff6908" returned: 0 in 0.444s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:33:31 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-4ea2699a-3dba-4a6e-9700-b0e37c24d3a0 tempest-TestImageHashVerification-1676059427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f8ed7ec8-8372-4984-a96d-bf41e9ff6908 /opt/stack/data/cinder/conversion/f8ed7ec8-8372-4984-a96d-bf41e9ff6908.temp_image.07064fd4-d995-4db8-8cf9-d1560897d8ebd877ch84.img {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:33:31 devstack sudo[101528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f8ed7ec8-8372-4984-a96d-bf41e9ff6908 /opt/stack/data/cinder/conversion/f8ed7ec8-8372-4984-a96d-bf41e9ff6908.temp_image.07064fd4-d995-4db8-8cf9-d1560897d8ebd877ch84.img
Jul 30 20:33:31 devstack sudo[101528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:33:31 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-6b641d0c-d384-455d-80e2-d067d6bb31f6 tempest-VolumeRetypeWithoutMigrationTest-678467801 None] Acquiring lock "cinder-e569a066-1655-4e98-b146-3e5963c2f7d3-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:33:31 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-6b641d0c-d384-455d-80e2-d067d6bb31f6 tempest-VolumeRetypeWithoutMigrationTest-678467801 None] Lock "cinder-e569a066-1655-4e98-b146-3e5963c2f7d3-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:33:31 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-6b641d0c-d384-455d-80e2-d067d6bb31f6 tempest-VolumeRetypeWithoutMigrationTest-678467801 None] Acquiring lock "cinder-quobyte-e569a066-1655-4e98-b146-3e5963c2f7d3" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:33:31 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-6b641d0c-d384-455d-80e2-d067d6bb31f6 tempest-VolumeRetypeWithoutMigrationTest-678467801 None] Lock "cinder-quobyte-e569a066-1655-4e98-b146-3e5963c2f7d3" acquired by "delete_volume" :: waited 0.023s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:33:31 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[6af514cf-09dd-41ed-984c-b80a31a89d2c]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:33:31 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-6b641d0c-d384-455d-80e2-d067d6bb31f6 tempest-VolumeRetypeWithoutMigrationTest-678467801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-e569a066-1655-4e98-b146-3e5963c2f7d3 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:33:31 devstack sudo[101530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-e569a066-1655-4e98-b146-3e5963c2f7d3
Jul 30 20:33:31 devstack sudo[101530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:33:32 devstack sudo[101530]: pam_unix(sudo:session): session closed for user root
Jul 30 20:33:32 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-6b641d0c-d384-455d-80e2-d067d6bb31f6 tempest-VolumeRetypeWithoutMigrationTest-678467801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-e569a066-1655-4e98-b146-3e5963c2f7d3" returned: 0 in 0.958s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:33:32 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-6b641d0c-d384-455d-80e2-d067d6bb31f6 tempest-VolumeRetypeWithoutMigrationTest-678467801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-e569a066-1655-4e98-b146-3e5963c2f7d3 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:33:32 devstack sudo[101546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-e569a066-1655-4e98-b146-3e5963c2f7d3
Jul 30 20:33:32 devstack sudo[101546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:33:33 devstack sudo[101546]: pam_unix(sudo:session): session closed for user root
Jul 30 20:33:33 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-6b641d0c-d384-455d-80e2-d067d6bb31f6 tempest-VolumeRetypeWithoutMigrationTest-678467801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-e569a066-1655-4e98-b146-3e5963c2f7d3" returned: 0 in 0.533s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:33:33 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-6b641d0c-d384-455d-80e2-d067d6bb31f6 tempest-VolumeRetypeWithoutMigrationTest-678467801 None] Lock "cinder-quobyte-e569a066-1655-4e98-b146-3e5963c2f7d3" released by "delete_volume" :: held 1.616s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:33:33 devstack cinder-volume[88719]: WARNING cinder.quota [None req-6b641d0c-d384-455d-80e2-d067d6bb31f6 tempest-VolumeRetypeWithoutMigrationTest-678467801 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Jul 30 20:33:33 devstack cinder-volume[88719]: WARNING cinder.quota [None req-6b641d0c-d384-455d-80e2-d067d6bb31f6 tempest-VolumeRetypeWithoutMigrationTest-678467801 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Jul 30 20:33:33 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-6b641d0c-d384-455d-80e2-d067d6bb31f6 tempest-VolumeRetypeWithoutMigrationTest-678467801 None] Created reservations ['1c316d6e-c47b-4e5d-9f58-1b2c97209d4b', 'ca4db946-1310-446b-8845-51f44eefc78b', 'd67ac9f5-5933-49d9-8495-58b260be4ce3', 'e91f6cbf-f891-4441-9d96-fb0f96aab8c4'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:33:33 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-6b641d0c-d384-455d-80e2-d067d6bb31f6 tempest-VolumeRetypeWithoutMigrationTest-678467801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:33:33 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-6b641d0c-d384-455d-80e2-d067d6bb31f6 tempest-VolumeRetypeWithoutMigrationTest-678467801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.014s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:33:33 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-6b641d0c-d384-455d-80e2-d067d6bb31f6 tempest-VolumeRetypeWithoutMigrationTest-678467801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:33:33 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-6b641d0c-d384-455d-80e2-d067d6bb31f6 tempest-VolumeRetypeWithoutMigrationTest-678467801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:33:33 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-6b641d0c-d384-455d-80e2-d067d6bb31f6 tempest-VolumeRetypeWithoutMigrationTest-678467801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:33:33 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-6b641d0c-d384-455d-80e2-d067d6bb31f6 tempest-VolumeRetypeWithoutMigrationTest-678467801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:33:34 devstack sudo[101550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:33:34 devstack sudo[101550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:33:34 devstack sudo[101550]: pam_unix(sudo:session): session closed for user root
Jul 30 20:33:34 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-6b641d0c-d384-455d-80e2-d067d6bb31f6 tempest-VolumeRetypeWithoutMigrationTest-678467801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.556s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:33:34 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-6b641d0c-d384-455d-80e2-d067d6bb31f6 tempest-VolumeRetypeWithoutMigrationTest-678467801 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:33:34 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-6b641d0c-d384-455d-80e2-d067d6bb31f6 tempest-VolumeRetypeWithoutMigrationTest-678467801 None] Deleted volume successfully.
Jul 30 20:33:34 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-6b641d0c-d384-455d-80e2-d067d6bb31f6 tempest-VolumeRetypeWithoutMigrationTest-678467801 None] Lock "cinder-e569a066-1655-4e98-b146-3e5963c2f7d3-delete_volume" released by "delete_volume" :: held 2.939s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:33:37 devstack sudo[101528]: pam_unix(sudo:session): session closed for user root
Jul 30 20:33:37 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-4ea2699a-3dba-4a6e-9700-b0e37c24d3a0 tempest-TestImageHashVerification-1676059427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f8ed7ec8-8372-4984-a96d-bf41e9ff6908 /opt/stack/data/cinder/conversion/f8ed7ec8-8372-4984-a96d-bf41e9ff6908.temp_image.07064fd4-d995-4db8-8cf9-d1560897d8ebd877ch84.img" returned: 0 in 6.179s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:33:37 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c5891c3-f2c2-4a6a-a97b-1cfd6fcc481d]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:33:37 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-4ea2699a-3dba-4a6e-9700-b0e37c24d3a0 tempest-TestImageHashVerification-1676059427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f8ed7ec8-8372-4984-a96d-bf41e9ff6908 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:33:37 devstack sudo[101557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f8ed7ec8-8372-4984-a96d-bf41e9ff6908
Jul 30 20:33:37 devstack sudo[101557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:33:38 devstack sudo[101557]: pam_unix(sudo:session): session closed for user root
Jul 30 20:33:38 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-4ea2699a-3dba-4a6e-9700-b0e37c24d3a0 tempest-TestImageHashVerification-1676059427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f8ed7ec8-8372-4984-a96d-bf41e9ff6908" returned: 0 in 0.680s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:33:38 devstack cinder-volume[88719]: DEBUG cinder.image.image_utils [None req-4ea2699a-3dba-4a6e-9700-b0e37c24d3a0 tempest-TestImageHashVerification-1676059427 None] Image conversion details: src /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f8ed7ec8-8372-4984-a96d-bf41e9ff6908, size 1024.00 MB, duration 6.18 sec, destination /opt/stack/data/cinder/conversion/f8ed7ec8-8372-4984-a96d-bf41e9ff6908.temp_image.07064fd4-d995-4db8-8cf9-d1560897d8ebd877ch84.img {{(pid=88719) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 30 20:33:38 devstack cinder-volume[88719]: INFO cinder.image.image_utils [None req-4ea2699a-3dba-4a6e-9700-b0e37c24d3a0 tempest-TestImageHashVerification-1676059427 None] Converted 1024.00 MB image at 165.64 MB/s
Jul 30 20:33:38 devstack cinder-volume[88719]: DEBUG cinder.image.image_utils [None req-4ea2699a-3dba-4a6e-9700-b0e37c24d3a0 tempest-TestImageHashVerification-1676059427 None] 07064fd4-d995-4db8-8cf9-d1560897d8eb was raw, no need to convert to raw {{(pid=88719) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}}
Jul 30 20:33:48 devstack cinder-volume[88719]: DEBUG dbcounter [-] [88719] Writing DB stats cinder:SELECT=17,cinder:UPDATE=18,cinder:DELETE=3,cinder:INSERT=3 {{(pid=88719) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 30 20:33:48 devstack cinder-volume[88719]: DEBUG dbcounter [-] [88719] Writing DB stats cinder:SELECT=35,cinder:UPDATE=45,cinder:INSERT=10,cinder:DELETE=1 {{(pid=88719) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 30 20:33:52 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e5f84dd-4c84-4f17-bb97-0ba60f8807e7 tempest-SnapshotMetadataTestJSON-497369993 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:33:52 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-8e5f84dd-4c84-4f17-bb97-0ba60f8807e7 tempest-SnapshotMetadataTestJSON-497369993 None] Flow 'volume_create_manager' (6cbe2eb7-86e8-48d8-8363-2fc23f381fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:33:52 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-8e5f84dd-4c84-4f17-bb97-0ba60f8807e7 tempest-SnapshotMetadataTestJSON-497369993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31f6c88c-f3eb-4698-84e4-be996af82824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:33:52 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-8e5f84dd-4c84-4f17-bb97-0ba60f8807e7 tempest-SnapshotMetadataTestJSON-497369993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31f6c88c-f3eb-4698-84e4-be996af82824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:33:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1301573306',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8406921c-ee01-4cbd-a43b-1387e8a6769b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0690d204459143da817abac2fd613915',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:33:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:33:52Z,use_quota=True,user_id='66af9a4510164816b51fe2af3f1d9b7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:33:52 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-8e5f84dd-4c84-4f17-bb97-0ba60f8807e7 tempest-SnapshotMetadataTestJSON-497369993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8d600e1-d35f-49c5-ac99-2857ae0170b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:33:52 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-8e5f84dd-4c84-4f17-bb97-0ba60f8807e7 tempest-SnapshotMetadataTestJSON-497369993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8d600e1-d35f-49c5-ac99-2857ae0170b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:33:52 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-8e5f84dd-4c84-4f17-bb97-0ba60f8807e7 tempest-SnapshotMetadataTestJSON-497369993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1afde22-5a18-4e59-98ad-259ec90df4e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:33:52 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-8e5f84dd-4c84-4f17-bb97-0ba60f8807e7 tempest-SnapshotMetadataTestJSON-497369993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1afde22-5a18-4e59-98ad-259ec90df4e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8406921c-ee01-4cbd-a43b-1387e8a6769b', 'volume_name': 'volume-8406921c-ee01-4cbd-a43b-1387e8a6769b', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:33:52 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-8e5f84dd-4c84-4f17-bb97-0ba60f8807e7 tempest-SnapshotMetadataTestJSON-497369993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a2ac8ba-b499-4d89-8fae-267455c17c6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:33:52 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-8e5f84dd-4c84-4f17-bb97-0ba60f8807e7 tempest-SnapshotMetadataTestJSON-497369993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a2ac8ba-b499-4d89-8fae-267455c17c6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:33:52 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-8e5f84dd-4c84-4f17-bb97-0ba60f8807e7 tempest-SnapshotMetadataTestJSON-497369993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89076f47-025c-4aaf-add8-cca11fd9e3ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:33:52 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-8e5f84dd-4c84-4f17-bb97-0ba60f8807e7 tempest-SnapshotMetadataTestJSON-497369993 None] Volume 8406921c-ee01-4cbd-a43b-1387e8a6769b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8406921c-ee01-4cbd-a43b-1387e8a6769b', 'volume_size': 1}
Jul 30 20:33:52 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-8e5f84dd-4c84-4f17-bb97-0ba60f8807e7 tempest-SnapshotMetadataTestJSON-497369993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:33:52 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-6810fbc8-f126-4378-a0f2-06249067476e tempest-VolumeAndVolumeTypeFromImageTest-167469837 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:33:52 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-6810fbc8-f126-4378-a0f2-06249067476e tempest-VolumeAndVolumeTypeFromImageTest-167469837 None] Flow 'volume_create_manager' (67c6740c-8055-4cf9-a212-c139d0075ed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:33:52 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-6810fbc8-f126-4378-a0f2-06249067476e tempest-VolumeAndVolumeTypeFromImageTest-167469837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c570df01-e1ae-4344-a4c8-ad1d2bc17068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:33:52 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-6810fbc8-f126-4378-a0f2-06249067476e tempest-VolumeAndVolumeTypeFromImageTest-167469837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c570df01-e1ae-4344-a4c8-ad1d2bc17068) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:33:52Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac927d88-400d-4704-a250-79d74d5fa42f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='293f03aee39d49b88a754a94a096f163',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:33:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:33:52Z,use_quota=True,user_id='7a1432c10d2f4b2caafb752e4725b5c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6ff841a-ff7c-4026-a4bf-58ba359c3635),volume_type_id=f6ff841a-ff7c-4026-a4bf-58ba359c3635)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:33:52 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-6810fbc8-f126-4378-a0f2-06249067476e tempest-VolumeAndVolumeTypeFromImageTest-167469837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac3052fc-01e7-478c-a254-2ffcc1028f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:33:52 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-6810fbc8-f126-4378-a0f2-06249067476e tempest-VolumeAndVolumeTypeFromImageTest-167469837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac3052fc-01e7-478c-a254-2ffcc1028f61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:33:52 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-6810fbc8-f126-4378-a0f2-06249067476e tempest-VolumeAndVolumeTypeFromImageTest-167469837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0fbdc12-b17e-4588-9561-064e896e5f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:33:52 devstack cinder-volume[88719]: DEBUG cinder.image.glance [None req-6810fbc8-f126-4378-a0f2-06249067476e tempest-VolumeAndVolumeTypeFromImageTest-167469837 None] Creating Keystone auth plugin from conf {{(pid=88719) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 30 20:33:53 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-6810fbc8-f126-4378-a0f2-06249067476e tempest-VolumeAndVolumeTypeFromImageTest-167469837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0fbdc12-b17e-4588-9561-064e896e5f5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ac927d88-400d-4704-a250-79d74d5fa42f', 'volume_name': 'volume-ac927d88-400d-4704-a250-79d74d5fa42f', 'volume_size': 1, 'image_id': '7c942c33-af92-4b5c-85c2-86bc177d295a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7c942c33-af92-4b5c-85c2-86bc177d295a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5805e1dbb6524b5d55ddd10ca2da6589', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '293f03aee39d49b88a754a94a096f163', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2416f8433c044746e7615f29a9e1b5650cc0e02ffa98d74923f50fc07c1e31e945ee5ecffc1ce7d414d7f0f0f9bf6c96a320e36afa39a406e23c04257fde290a', 'id': '7c942c33-af92-4b5c-85c2-86bc177d295a', 'created_at': datetime.datetime(2026, 7, 30, 18, 33, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 18, 33, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7c942c33-af92-4b5c-85c2-86bc177d295a/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x786884887ce0>}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:33:53 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-6810fbc8-f126-4378-a0f2-06249067476e tempest-VolumeAndVolumeTypeFromImageTest-167469837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90cce415-36aa-44d5-bf8f-4cca0f12d0b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:33:53 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-6810fbc8-f126-4378-a0f2-06249067476e tempest-VolumeAndVolumeTypeFromImageTest-167469837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90cce415-36aa-44d5-bf8f-4cca0f12d0b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:33:53 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-6810fbc8-f126-4378-a0f2-06249067476e tempest-VolumeAndVolumeTypeFromImageTest-167469837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95c573ae-f62f-4996-a644-8102270f29d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:33:53 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-6810fbc8-f126-4378-a0f2-06249067476e tempest-VolumeAndVolumeTypeFromImageTest-167469837 None] Volume ac927d88-400d-4704-a250-79d74d5fa42f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ac927d88-400d-4704-a250-79d74d5fa42f', 'volume_size': 1, 'image_id': '7c942c33-af92-4b5c-85c2-86bc177d295a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7c942c33-af92-4b5c-85c2-86bc177d295a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5805e1dbb6524b5d55ddd10ca2da6589', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '293f03aee39d49b88a754a94a096f163', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2416f8433c044746e7615f29a9e1b5650cc0e02ffa98d74923f50fc07c1e31e945ee5ecffc1ce7d414d7f0f0f9bf6c96a320e36afa39a406e23c04257fde290a', 'id': '7c942c33-af92-4b5c-85c2-86bc177d295a', 'created_at': datetime.datetime(2026, 7, 30, 18, 33, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 18, 33, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7c942c33-af92-4b5c-85c2-86bc177d295a/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x786884887ce0>}
Jul 30 20:33:53 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-6810fbc8-f126-4378-a0f2-06249067476e tempest-VolumeAndVolumeTypeFromImageTest-167469837 None] Trying to clone ac927d88-400d-4704-a250-79d74d5fa42f from image 7c942c33-af92-4b5c-85c2-86bc177d295a at location (None, [{'url': 'file:///opt/stack/data/glance/images/7c942c33-af92-4b5c-85c2-86bc177d295a', 'metadata': {}}]). {{(pid=88719) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 30 20:33:53 devstack cinder-volume[88719]: DEBUG cinder.image.image_utils [None req-6810fbc8-f126-4378-a0f2-06249067476e tempest-VolumeAndVolumeTypeFromImageTest-167469837 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7c942c33-af92-4b5c-85c2-86bc177d295a_j45hj2t0devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88719) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 30 20:33:53 devstack cinder-volume[88719]: INFO cinder.image.image_utils [None req-6810fbc8-f126-4378-a0f2-06249067476e tempest-VolumeAndVolumeTypeFromImageTest-167469837 None] Image download 0.00 MB at 0.00 MB/s
Jul 30 20:33:53 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e52edf1-5b26-4b29-b900-1802b9b8e4a5]: (4, 'raw') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:33:53 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-6810fbc8-f126-4378-a0f2-06249067476e tempest-VolumeAndVolumeTypeFromImageTest-167469837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7c942c33-af92-4b5c-85c2-86bc177d295a_j45hj2t0devstack@QuobyteHD {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:33:53 devstack sudo[101564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7c942c33-af92-4b5c-85c2-86bc177d295a_j45hj2t0devstack@QuobyteHD
Jul 30 20:33:53 devstack sudo[101564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:33:53 devstack sudo[101564]: pam_unix(sudo:session): session closed for user root
Jul 30 20:33:53 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-6810fbc8-f126-4378-a0f2-06249067476e tempest-VolumeAndVolumeTypeFromImageTest-167469837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7c942c33-af92-4b5c-85c2-86bc177d295a_j45hj2t0devstack@QuobyteHD" returned: 0 in 0.408s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:33:53 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-6810fbc8-f126-4378-a0f2-06249067476e tempest-VolumeAndVolumeTypeFromImageTest-167469837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7c942c33-af92-4b5c-85c2-86bc177d295a_j45hj2t0devstack@QuobyteHD {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:33:53 devstack sudo[101568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7c942c33-af92-4b5c-85c2-86bc177d295a_j45hj2t0devstack@QuobyteHD
Jul 30 20:33:53 devstack sudo[101568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:33:54 devstack sudo[101568]: pam_unix(sudo:session): session closed for user root
Jul 30 20:33:54 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-6810fbc8-f126-4378-a0f2-06249067476e tempest-VolumeAndVolumeTypeFromImageTest-167469837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7c942c33-af92-4b5c-85c2-86bc177d295a_j45hj2t0devstack@QuobyteHD" returned: 1 in 0.395s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:33:54 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-6810fbc8-f126-4378-a0f2-06249067476e tempest-VolumeAndVolumeTypeFromImageTest-167469837 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7c942c33-af92-4b5c-85c2-86bc177d295a_j45hj2t0devstack@QuobyteHD' failed. Not Retrying. {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 30 20:33:54 devstack cinder-volume[88719]: DEBUG cinder.image.image_utils [None req-6810fbc8-f126-4378-a0f2-06249067476e tempest-VolumeAndVolumeTypeFromImageTest-167469837 None] Temporary image 7c942c33-af92-4b5c-85c2-86bc177d295a is fetched for user 7a1432c10d2f4b2caafb752e4725b5c6. {{(pid=88719) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 30 20:33:54 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[77243128-0b67-485c-a0b5-57f861db1f4b]: (4, 'raw') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:33:54 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-6810fbc8-f126-4378-a0f2-06249067476e tempest-VolumeAndVolumeTypeFromImageTest-167469837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7c942c33-af92-4b5c-85c2-86bc177d295a_j45hj2t0devstack@QuobyteHD {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:33:54 devstack sudo[101573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7c942c33-af92-4b5c-85c2-86bc177d295a_j45hj2t0devstack@QuobyteHD
Jul 30 20:33:54 devstack sudo[101573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:33:54 devstack sudo[101573]: pam_unix(sudo:session): session closed for user root
Jul 30 20:33:54 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-6810fbc8-f126-4378-a0f2-06249067476e tempest-VolumeAndVolumeTypeFromImageTest-167469837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7c942c33-af92-4b5c-85c2-86bc177d295a_j45hj2t0devstack@QuobyteHD" returned: 0 in 0.445s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:33:54 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-6810fbc8-f126-4378-a0f2-06249067476e tempest-VolumeAndVolumeTypeFromImageTest-167469837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7c942c33-af92-4b5c-85c2-86bc177d295a_j45hj2t0devstack@QuobyteHD {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:33:54 devstack sudo[101578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7c942c33-af92-4b5c-85c2-86bc177d295a_j45hj2t0devstack@QuobyteHD
Jul 30 20:33:54 devstack sudo[101578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:33:55 devstack sudo[101578]: pam_unix(sudo:session): session closed for user root
Jul 30 20:33:55 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-6810fbc8-f126-4378-a0f2-06249067476e tempest-VolumeAndVolumeTypeFromImageTest-167469837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7c942c33-af92-4b5c-85c2-86bc177d295a_j45hj2t0devstack@QuobyteHD" returned: 1 in 0.383s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:33:55 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-6810fbc8-f126-4378-a0f2-06249067476e tempest-VolumeAndVolumeTypeFromImageTest-167469837 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7c942c33-af92-4b5c-85c2-86bc177d295a_j45hj2t0devstack@QuobyteHD' failed. Not Retrying. {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 30 20:33:55 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-6810fbc8-f126-4378-a0f2-06249067476e tempest-VolumeAndVolumeTypeFromImageTest-167469837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:34:02 devstack cinder-volume[88719]: DEBUG dbcounter [-] [88719] Writing DB stats cinder:SELECT=4 {{(pid=88719) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 30 20:34:04 devstack cinder-volume[88719]: DEBUG dbcounter [-] [88719] Writing DB stats cinder:UPDATE=3,cinder:SELECT=3,cinder:INSERT=1 {{(pid=88719) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 30 20:34:04 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-4ea2699a-3dba-4a6e-9700-b0e37c24d3a0 tempest-TestImageHashVerification-1676059427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 33.982s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:34:04 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-4ea2699a-3dba-4a6e-9700-b0e37c24d3a0 tempest-TestImageHashVerification-1676059427 None] Uploaded volume to glance image-id: 07064fd4-d995-4db8-8cf9-d1560897d8eb. {{(pid=88719) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Jul 30 20:34:04 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-8e5f84dd-4c84-4f17-bb97-0ba60f8807e7 tempest-SnapshotMetadataTestJSON-497369993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.085s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:34:04 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-8e5f84dd-4c84-4f17-bb97-0ba60f8807e7 tempest-SnapshotMetadataTestJSON-497369993 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:33:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1301573306',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8406921c-ee01-4cbd-a43b-1387e8a6769b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0690d204459143da817abac2fd613915',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:33:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:33:52Z,use_quota=True,user_id='66af9a4510164816b51fe2af3f1d9b7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:34:04 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-8e5f84dd-4c84-4f17-bb97-0ba60f8807e7 tempest-SnapshotMetadataTestJSON-497369993 None] Creating volume 8406921c-ee01-4cbd-a43b-1387e8a6769b {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:34:04 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-8e5f84dd-4c84-4f17-bb97-0ba60f8807e7 tempest-SnapshotMetadataTestJSON-497369993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:34:04 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-8e5f84dd-4c84-4f17-bb97-0ba60f8807e7 tempest-SnapshotMetadataTestJSON-497369993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:34:04 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-8e5f84dd-4c84-4f17-bb97-0ba60f8807e7 tempest-SnapshotMetadataTestJSON-497369993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:34:04 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-8e5f84dd-4c84-4f17-bb97-0ba60f8807e7 tempest-SnapshotMetadataTestJSON-497369993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:34:04 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-8e5f84dd-4c84-4f17-bb97-0ba60f8807e7 tempest-SnapshotMetadataTestJSON-497369993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:34:04 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-8e5f84dd-4c84-4f17-bb97-0ba60f8807e7 tempest-SnapshotMetadataTestJSON-497369993 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:34:04 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-8e5f84dd-4c84-4f17-bb97-0ba60f8807e7 tempest-SnapshotMetadataTestJSON-497369993 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:34:04 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8e5f84dd-4c84-4f17-bb97-0ba60f8807e7 tempest-SnapshotMetadataTestJSON-497369993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-8406921c-ee01-4cbd-a43b-1387e8a6769b 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:34:04 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-4ea2699a-3dba-4a6e-9700-b0e37c24d3a0 tempest-TestImageHashVerification-1676059427 None] Copy volume to image completed successfully.
Jul 30 20:34:04 devstack sudo[101625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-8406921c-ee01-4cbd-a43b-1387e8a6769b 1073741824
Jul 30 20:34:04 devstack sudo[101625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:34:05 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8e5f84dd-4c84-4f17-bb97-0ba60f8807e7 tempest-SnapshotMetadataTestJSON-497369993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-8406921c-ee01-4cbd-a43b-1387e8a6769b 1073741824" returned: 0 in 0.793s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:34:05 devstack sudo[101625]: pam_unix(sudo:session): session closed for user root
Jul 30 20:34:05 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8e5f84dd-4c84-4f17-bb97-0ba60f8807e7 tempest-SnapshotMetadataTestJSON-497369993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-8406921c-ee01-4cbd-a43b-1387e8a6769b {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:34:05 devstack sudo[101636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-8406921c-ee01-4cbd-a43b-1387e8a6769b
Jul 30 20:34:05 devstack sudo[101636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:34:05 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-6c2ebcd7-6b97-430d-968d-f8538387a5b0 tempest-TestImageHashVerification-1676059427 None] Acquiring lock "cinder-f8ed7ec8-8372-4984-a96d-bf41e9ff6908-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:34:05 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-6c2ebcd7-6b97-430d-968d-f8538387a5b0 tempest-TestImageHashVerification-1676059427 None] Lock "cinder-f8ed7ec8-8372-4984-a96d-bf41e9ff6908-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:34:05 devstack sudo[101636]: pam_unix(sudo:session): session closed for user root
Jul 30 20:34:05 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-6c2ebcd7-6b97-430d-968d-f8538387a5b0 tempest-TestImageHashVerification-1676059427 None] Acquiring lock "cinder-quobyte-f8ed7ec8-8372-4984-a96d-bf41e9ff6908" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:34:05 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8e5f84dd-4c84-4f17-bb97-0ba60f8807e7 tempest-SnapshotMetadataTestJSON-497369993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-8406921c-ee01-4cbd-a43b-1387e8a6769b" returned: 0 in 0.331s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:34:05 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-8e5f84dd-4c84-4f17-bb97-0ba60f8807e7 tempest-SnapshotMetadataTestJSON-497369993 None] <== create_volume: return (1188ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:34:05 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-8e5f84dd-4c84-4f17-bb97-0ba60f8807e7 tempest-SnapshotMetadataTestJSON-497369993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.191s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:34:05 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-6810fbc8-f126-4378-a0f2-06249067476e tempest-VolumeAndVolumeTypeFromImageTest-167469837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.592s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:34:05 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-6810fbc8-f126-4378-a0f2-06249067476e tempest-VolumeAndVolumeTypeFromImageTest-167469837 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:33:52Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac927d88-400d-4704-a250-79d74d5fa42f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='293f03aee39d49b88a754a94a096f163',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:33:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:33:52Z,use_quota=True,user_id='7a1432c10d2f4b2caafb752e4725b5c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6ff841a-ff7c-4026-a4bf-58ba359c3635),volume_type_id=f6ff841a-ff7c-4026-a4bf-58ba359c3635)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:34:05 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-6810fbc8-f126-4378-a0f2-06249067476e tempest-VolumeAndVolumeTypeFromImageTest-167469837 None] Creating volume ac927d88-400d-4704-a250-79d74d5fa42f {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:34:05 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-6810fbc8-f126-4378-a0f2-06249067476e tempest-VolumeAndVolumeTypeFromImageTest-167469837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:34:05 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-6810fbc8-f126-4378-a0f2-06249067476e tempest-VolumeAndVolumeTypeFromImageTest-167469837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:34:05 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-6810fbc8-f126-4378-a0f2-06249067476e tempest-VolumeAndVolumeTypeFromImageTest-167469837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:34:05 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-6810fbc8-f126-4378-a0f2-06249067476e tempest-VolumeAndVolumeTypeFromImageTest-167469837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:34:05 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-6810fbc8-f126-4378-a0f2-06249067476e tempest-VolumeAndVolumeTypeFromImageTest-167469837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:34:05 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-6810fbc8-f126-4378-a0f2-06249067476e tempest-VolumeAndVolumeTypeFromImageTest-167469837 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:34:05 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-6810fbc8-f126-4378-a0f2-06249067476e tempest-VolumeAndVolumeTypeFromImageTest-167469837 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:34:05 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-6810fbc8-f126-4378-a0f2-06249067476e tempest-VolumeAndVolumeTypeFromImageTest-167469837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-ac927d88-400d-4704-a250-79d74d5fa42f 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:34:05 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-6c2ebcd7-6b97-430d-968d-f8538387a5b0 tempest-TestImageHashVerification-1676059427 None] Lock "cinder-quobyte-f8ed7ec8-8372-4984-a96d-bf41e9ff6908" acquired by "delete_volume" :: waited 0.051s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:34:05 devstack sudo[101649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-ac927d88-400d-4704-a250-79d74d5fa42f 1073741824
Jul 30 20:34:05 devstack sudo[101649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:34:05 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-8e5f84dd-4c84-4f17-bb97-0ba60f8807e7 tempest-SnapshotMetadataTestJSON-497369993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89076f47-025c-4aaf-add8-cca11fd9e3ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8406921c-ee01-4cbd-a43b-1387e8a6769b', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:34:05 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-8e5f84dd-4c84-4f17-bb97-0ba60f8807e7 tempest-SnapshotMetadataTestJSON-497369993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa43e76c-2db9-4953-806c-24f1fa925bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:34:05 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[0610cead-86aa-4520-b17d-172ebbfbd3f2]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:34:05 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-6c2ebcd7-6b97-430d-968d-f8538387a5b0 tempest-TestImageHashVerification-1676059427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f8ed7ec8-8372-4984-a96d-bf41e9ff6908 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:34:05 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-8e5f84dd-4c84-4f17-bb97-0ba60f8807e7 tempest-SnapshotMetadataTestJSON-497369993 None] Volume volume-8406921c-ee01-4cbd-a43b-1387e8a6769b (8406921c-ee01-4cbd-a43b-1387e8a6769b): created successfully
Jul 30 20:34:05 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-8e5f84dd-4c84-4f17-bb97-0ba60f8807e7 tempest-SnapshotMetadataTestJSON-497369993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa43e76c-2db9-4953-806c-24f1fa925bbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:34:05 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-8e5f84dd-4c84-4f17-bb97-0ba60f8807e7 tempest-SnapshotMetadataTestJSON-497369993 None] Flow 'volume_create_manager' (6cbe2eb7-86e8-48d8-8363-2fc23f381fb3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:34:05 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-8e5f84dd-4c84-4f17-bb97-0ba60f8807e7 tempest-SnapshotMetadataTestJSON-497369993 None] Created volume successfully.
Jul 30 20:34:05 devstack sudo[101652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f8ed7ec8-8372-4984-a96d-bf41e9ff6908
Jul 30 20:34:05 devstack sudo[101652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:34:06 devstack sudo[101652]: pam_unix(sudo:session): session closed for user root
Jul 30 20:34:06 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-6c2ebcd7-6b97-430d-968d-f8538387a5b0 tempest-TestImageHashVerification-1676059427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f8ed7ec8-8372-4984-a96d-bf41e9ff6908" returned: 0 in 0.427s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:34:06 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-6c2ebcd7-6b97-430d-968d-f8538387a5b0 tempest-TestImageHashVerification-1676059427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f8ed7ec8-8372-4984-a96d-bf41e9ff6908 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:34:06 devstack sudo[101666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f8ed7ec8-8372-4984-a96d-bf41e9ff6908
Jul 30 20:34:06 devstack sudo[101666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:34:06 devstack sudo[101649]: pam_unix(sudo:session): session closed for user root
Jul 30 20:34:06 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-6810fbc8-f126-4378-a0f2-06249067476e tempest-VolumeAndVolumeTypeFromImageTest-167469837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-ac927d88-400d-4704-a250-79d74d5fa42f 1073741824" returned: 0 in 0.747s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:34:06 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-6810fbc8-f126-4378-a0f2-06249067476e tempest-VolumeAndVolumeTypeFromImageTest-167469837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-ac927d88-400d-4704-a250-79d74d5fa42f {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:34:06 devstack sudo[101681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-ac927d88-400d-4704-a250-79d74d5fa42f
Jul 30 20:34:06 devstack sudo[101681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:34:06 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-e657e75a-a6ac-4f65-b998-10ae55bbacf2 tempest-SnapshotMetadataTestJSON-497369993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:34:06 devstack sudo[101666]: pam_unix(sudo:session): session closed for user root
Jul 30 20:34:06 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-6c2ebcd7-6b97-430d-968d-f8538387a5b0 tempest-TestImageHashVerification-1676059427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f8ed7ec8-8372-4984-a96d-bf41e9ff6908" returned: 0 in 0.454s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:34:06 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-6c2ebcd7-6b97-430d-968d-f8538387a5b0 tempest-TestImageHashVerification-1676059427 None] Lock "cinder-quobyte-f8ed7ec8-8372-4984-a96d-bf41e9ff6908" released by "delete_volume" :: held 0.948s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:34:06 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-6c2ebcd7-6b97-430d-968d-f8538387a5b0 tempest-TestImageHashVerification-1676059427 None] Created reservations ['a66ec644-ea1f-44ec-9ac6-15d78e9470b4', 'd8b0f4ad-3d42-4f76-bb03-dab0796bf277', 'e8d09c7c-5885-4abe-a7ae-241b1902f90f', '589e9275-7a78-4266-b38b-fd8096544ce9'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:34:06 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-6c2ebcd7-6b97-430d-968d-f8538387a5b0 tempest-TestImageHashVerification-1676059427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:34:06 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-6c2ebcd7-6b97-430d-968d-f8538387a5b0 tempest-TestImageHashVerification-1676059427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:34:06 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-6c2ebcd7-6b97-430d-968d-f8538387a5b0 tempest-TestImageHashVerification-1676059427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:34:06 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-6c2ebcd7-6b97-430d-968d-f8538387a5b0 tempest-TestImageHashVerification-1676059427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:34:06 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-6c2ebcd7-6b97-430d-968d-f8538387a5b0 tempest-TestImageHashVerification-1676059427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:34:06 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-6c2ebcd7-6b97-430d-968d-f8538387a5b0 tempest-TestImageHashVerification-1676059427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:34:07 devstack sudo[101681]: pam_unix(sudo:session): session closed for user root
Jul 30 20:34:07 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-6810fbc8-f126-4378-a0f2-06249067476e tempest-VolumeAndVolumeTypeFromImageTest-167469837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-ac927d88-400d-4704-a250-79d74d5fa42f" returned: 0 in 0.431s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:34:07 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-6810fbc8-f126-4378-a0f2-06249067476e tempest-VolumeAndVolumeTypeFromImageTest-167469837 None] <== create_volume: return (1277ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:34:07 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-6810fbc8-f126-4378-a0f2-06249067476e tempest-VolumeAndVolumeTypeFromImageTest-167469837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.280s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:34:07 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-e657e75a-a6ac-4f65-b998-10ae55bbacf2 tempest-SnapshotMetadataTestJSON-497369993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.335s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:34:07 devstack sudo[101689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:34:07 devstack sudo[101689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:34:07 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-e657e75a-a6ac-4f65-b998-10ae55bbacf2 tempest-SnapshotMetadataTestJSON-497369993 None] Creating offline snapshot ea0adcc6-2e6b-4c25-9544-5b117e1880b5 of volume 8406921c-ee01-4cbd-a43b-1387e8a6769b {{(pid=88719) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 30 20:34:07 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[975d382a-946f-4646-84a1-82ad13f39af2]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:34:07 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-e657e75a-a6ac-4f65-b998-10ae55bbacf2 tempest-SnapshotMetadataTestJSON-497369993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-8406921c-ee01-4cbd-a43b-1387e8a6769b {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:34:07 devstack cinder-volume[88719]: DEBUG cinder.volume.volume_utils [None req-6810fbc8-f126-4378-a0f2-06249067476e tempest-VolumeAndVolumeTypeFromImageTest-167469837 None] Attempting download of 7c942c33-af92-4b5c-85c2-86bc177d295a ((None, [{'url': 'file:///opt/stack/data/glance/images/7c942c33-af92-4b5c-85c2-86bc177d295a', 'metadata': {}}])) to volume ac927d88-400d-4704-a250-79d74d5fa42f. {{(pid=88719) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 30 20:34:07 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdda2f5a-3d1e-4638-a93e-9436b7338d7c]: (4, 'raw') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:34:07 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-6810fbc8-f126-4378-a0f2-06249067476e tempest-VolumeAndVolumeTypeFromImageTest-167469837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7c942c33-af92-4b5c-85c2-86bc177d295a_nplahnue {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:34:07 devstack sudo[101694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-8406921c-ee01-4cbd-a43b-1387e8a6769b
Jul 30 20:34:07 devstack sudo[101694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:34:07 devstack sudo[101695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7c942c33-af92-4b5c-85c2-86bc177d295a_nplahnue
Jul 30 20:34:07 devstack sudo[101695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:34:07 devstack sudo[101689]: pam_unix(sudo:session): session closed for user root
Jul 30 20:34:07 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-6c2ebcd7-6b97-430d-968d-f8538387a5b0 tempest-TestImageHashVerification-1676059427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.327s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:34:07 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-6c2ebcd7-6b97-430d-968d-f8538387a5b0 tempest-TestImageHashVerification-1676059427 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:34:07 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-6c2ebcd7-6b97-430d-968d-f8538387a5b0 tempest-TestImageHashVerification-1676059427 None] Deleted volume successfully.
Jul 30 20:34:07 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-6c2ebcd7-6b97-430d-968d-f8538387a5b0 tempest-TestImageHashVerification-1676059427 None] Lock "cinder-f8ed7ec8-8372-4984-a96d-bf41e9ff6908-delete_volume" released by "delete_volume" :: held 1.709s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:34:07 devstack sudo[101695]: pam_unix(sudo:session): session closed for user root
Jul 30 20:34:07 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-6810fbc8-f126-4378-a0f2-06249067476e tempest-VolumeAndVolumeTypeFromImageTest-167469837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7c942c33-af92-4b5c-85c2-86bc177d295a_nplahnue" returned: 0 in 0.364s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:34:07 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-6810fbc8-f126-4378-a0f2-06249067476e tempest-VolumeAndVolumeTypeFromImageTest-167469837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7c942c33-af92-4b5c-85c2-86bc177d295a_nplahnue {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:34:07 devstack sudo[101694]: pam_unix(sudo:session): session closed for user root
Jul 30 20:34:07 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-e657e75a-a6ac-4f65-b998-10ae55bbacf2 tempest-SnapshotMetadataTestJSON-497369993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-8406921c-ee01-4cbd-a43b-1387e8a6769b" returned: 0 in 0.473s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:34:07 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-e657e75a-a6ac-4f65-b998-10ae55bbacf2 tempest-SnapshotMetadataTestJSON-497369993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-8406921c-ee01-4cbd-a43b-1387e8a6769b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-8406921c-ee01-4cbd-a43b-1387e8a6769b.ea0adcc6-2e6b-4c25-9544-5b117e1880b5 1G {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:34:07 devstack sudo[101706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-8406921c-ee01-4cbd-a43b-1387e8a6769b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-8406921c-ee01-4cbd-a43b-1387e8a6769b.ea0adcc6-2e6b-4c25-9544-5b117e1880b5 1G
Jul 30 20:34:07 devstack sudo[101706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:34:07 devstack sudo[101705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7c942c33-af92-4b5c-85c2-86bc177d295a_nplahnue
Jul 30 20:34:07 devstack sudo[101705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:34:08 devstack sudo[101705]: pam_unix(sudo:session): session closed for user root
Jul 30 20:34:08 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-6810fbc8-f126-4378-a0f2-06249067476e tempest-VolumeAndVolumeTypeFromImageTest-167469837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7c942c33-af92-4b5c-85c2-86bc177d295a_nplahnue" returned: 1 in 0.730s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:34:08 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-6810fbc8-f126-4378-a0f2-06249067476e tempest-VolumeAndVolumeTypeFromImageTest-167469837 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7c942c33-af92-4b5c-85c2-86bc177d295a_nplahnue' failed. Not Retrying. {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 30 20:34:08 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[591903f4-8f74-4fc7-9abb-cefda400b297]: (4, 'raw') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:34:08 devstack sudo[101706]: pam_unix(sudo:session): session closed for user root
Jul 30 20:34:08 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-6810fbc8-f126-4378-a0f2-06249067476e tempest-VolumeAndVolumeTypeFromImageTest-167469837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7c942c33-af92-4b5c-85c2-86bc177d295a_j45hj2t0devstack@QuobyteHD {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:34:08 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-e657e75a-a6ac-4f65-b998-10ae55bbacf2 tempest-SnapshotMetadataTestJSON-497369993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-8406921c-ee01-4cbd-a43b-1387e8a6769b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-8406921c-ee01-4cbd-a43b-1387e8a6769b.ea0adcc6-2e6b-4c25-9544-5b117e1880b5 1G" returned: 0 in 0.738s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:34:08 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-e657e75a-a6ac-4f65-b998-10ae55bbacf2 tempest-SnapshotMetadataTestJSON-497369993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8406921c-ee01-4cbd-a43b-1387e8a6769b -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-8406921c-ee01-4cbd-a43b-1387e8a6769b.ea0adcc6-2e6b-4c25-9544-5b117e1880b5 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:34:08 devstack sudo[101752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8406921c-ee01-4cbd-a43b-1387e8a6769b -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-8406921c-ee01-4cbd-a43b-1387e8a6769b.ea0adcc6-2e6b-4c25-9544-5b117e1880b5
Jul 30 20:34:08 devstack sudo[101752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:34:08 devstack sudo[101750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7c942c33-af92-4b5c-85c2-86bc177d295a_j45hj2t0devstack@QuobyteHD
Jul 30 20:34:08 devstack sudo[101750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:34:08 devstack sudo[101752]: pam_unix(sudo:session): session closed for user root
Jul 30 20:34:08 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-e657e75a-a6ac-4f65-b998-10ae55bbacf2 tempest-SnapshotMetadataTestJSON-497369993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8406921c-ee01-4cbd-a43b-1387e8a6769b -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-8406921c-ee01-4cbd-a43b-1387e8a6769b.ea0adcc6-2e6b-4c25-9544-5b117e1880b5" returned: 0 in 0.606s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:34:08 devstack cinder-volume[88719]: WARNING cinder.volume.drivers.remotefs [None req-e657e75a-a6ac-4f65-b998-10ae55bbacf2 tempest-SnapshotMetadataTestJSON-497369993 None] /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-8406921c-ee01-4cbd-a43b-1387e8a6769b.ea0adcc6-2e6b-4c25-9544-5b117e1880b5 is being set with open permissions: ugo+rw
Jul 30 20:34:08 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-e657e75a-a6ac-4f65-b998-10ae55bbacf2 tempest-SnapshotMetadataTestJSON-497369993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-8406921c-ee01-4cbd-a43b-1387e8a6769b.ea0adcc6-2e6b-4c25-9544-5b117e1880b5 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:34:08 devstack sudo[101750]: pam_unix(sudo:session): session closed for user root
Jul 30 20:34:08 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-6810fbc8-f126-4378-a0f2-06249067476e tempest-VolumeAndVolumeTypeFromImageTest-167469837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7c942c33-af92-4b5c-85c2-86bc177d295a_j45hj2t0devstack@QuobyteHD" returned: 0 in 0.664s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:34:08 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-6810fbc8-f126-4378-a0f2-06249067476e tempest-VolumeAndVolumeTypeFromImageTest-167469837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7c942c33-af92-4b5c-85c2-86bc177d295a_j45hj2t0devstack@QuobyteHD {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:34:08 devstack sudo[101785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-8406921c-ee01-4cbd-a43b-1387e8a6769b.ea0adcc6-2e6b-4c25-9544-5b117e1880b5
Jul 30 20:34:08 devstack sudo[101785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:34:09 devstack sudo[101790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7c942c33-af92-4b5c-85c2-86bc177d295a_j45hj2t0devstack@QuobyteHD
Jul 30 20:34:09 devstack sudo[101790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:34:09 devstack sudo[101785]: pam_unix(sudo:session): session closed for user root
Jul 30 20:34:09 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-e657e75a-a6ac-4f65-b998-10ae55bbacf2 tempest-SnapshotMetadataTestJSON-497369993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-8406921c-ee01-4cbd-a43b-1387e8a6769b.ea0adcc6-2e6b-4c25-9544-5b117e1880b5" returned: 0 in 0.297s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:34:09 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-e657e75a-a6ac-4f65-b998-10ae55bbacf2 tempest-SnapshotMetadataTestJSON-497369993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-8406921c-ee01-4cbd-a43b-1387e8a6769b.info {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:34:09 devstack sudo[101808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-8406921c-ee01-4cbd-a43b-1387e8a6769b.info
Jul 30 20:34:09 devstack sudo[101808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:34:09 devstack sudo[101790]: pam_unix(sudo:session): session closed for user root
Jul 30 20:34:09 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-6810fbc8-f126-4378-a0f2-06249067476e tempest-VolumeAndVolumeTypeFromImageTest-167469837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7c942c33-af92-4b5c-85c2-86bc177d295a_j45hj2t0devstack@QuobyteHD" returned: 1 in 0.396s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:34:09 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-6810fbc8-f126-4378-a0f2-06249067476e tempest-VolumeAndVolumeTypeFromImageTest-167469837 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7c942c33-af92-4b5c-85c2-86bc177d295a_j45hj2t0devstack@QuobyteHD' failed. Not Retrying. {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 30 20:34:09 devstack cinder-volume[88719]: DEBUG cinder.image.image_utils [None req-6810fbc8-f126-4378-a0f2-06249067476e tempest-VolumeAndVolumeTypeFromImageTest-167469837 None] 7c942c33-af92-4b5c-85c2-86bc177d295a was raw, converting to qcow2 {{(pid=88719) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 30 20:34:09 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-6810fbc8-f126-4378-a0f2-06249067476e tempest-VolumeAndVolumeTypeFromImageTest-167469837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7c942c33-af92-4b5c-85c2-86bc177d295a_j45hj2t0devstack@QuobyteHD /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-ac927d88-400d-4704-a250-79d74d5fa42f {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:34:09 devstack sudo[101815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7c942c33-af92-4b5c-85c2-86bc177d295a_j45hj2t0devstack@QuobyteHD /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-ac927d88-400d-4704-a250-79d74d5fa42f
Jul 30 20:34:09 devstack sudo[101815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:34:09 devstack sudo[101808]: pam_unix(sudo:session): session closed for user root
Jul 30 20:34:09 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-e657e75a-a6ac-4f65-b998-10ae55bbacf2 tempest-SnapshotMetadataTestJSON-497369993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-8406921c-ee01-4cbd-a43b-1387e8a6769b.info" returned: 0 in 0.333s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:34:09 devstack cinder-volume[88719]: WARNING cinder.volume.drivers.remotefs [None req-e657e75a-a6ac-4f65-b998-10ae55bbacf2 tempest-SnapshotMetadataTestJSON-497369993 None] /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-8406921c-ee01-4cbd-a43b-1387e8a6769b.info is being set with open permissions: ugo+rw
Jul 30 20:34:09 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-e657e75a-a6ac-4f65-b998-10ae55bbacf2 tempest-SnapshotMetadataTestJSON-497369993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-8406921c-ee01-4cbd-a43b-1387e8a6769b.info {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:34:09 devstack sudo[101818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-8406921c-ee01-4cbd-a43b-1387e8a6769b.info
Jul 30 20:34:09 devstack sudo[101818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:34:09 devstack sudo[101818]: pam_unix(sudo:session): session closed for user root
Jul 30 20:34:09 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-e657e75a-a6ac-4f65-b998-10ae55bbacf2 tempest-SnapshotMetadataTestJSON-497369993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-8406921c-ee01-4cbd-a43b-1387e8a6769b.info" returned: 0 in 0.381s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:34:09 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-e657e75a-a6ac-4f65-b998-10ae55bbacf2 tempest-SnapshotMetadataTestJSON-497369993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.948s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:34:10 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-e657e75a-a6ac-4f65-b998-10ae55bbacf2 tempest-SnapshotMetadataTestJSON-497369993 None] Create snapshot completed successfully
Jul 30 20:34:10 devstack sudo[101815]: pam_unix(sudo:session): session closed for user root
Jul 30 20:34:10 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-6810fbc8-f126-4378-a0f2-06249067476e tempest-VolumeAndVolumeTypeFromImageTest-167469837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7c942c33-af92-4b5c-85c2-86bc177d295a_j45hj2t0devstack@QuobyteHD /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-ac927d88-400d-4704-a250-79d74d5fa42f" returned: 0 in 0.783s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:34:10 devstack cinder-volume[88719]: DEBUG cinder.image.image_utils [None req-6810fbc8-f126-4378-a0f2-06249067476e tempest-VolumeAndVolumeTypeFromImageTest-167469837 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7c942c33-af92-4b5c-85c2-86bc177d295a_j45hj2t0devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-ac927d88-400d-4704-a250-79d74d5fa42f {{(pid=88719) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 30 20:34:10 devstack cinder-volume[88719]: INFO cinder.image.image_utils [None req-6810fbc8-f126-4378-a0f2-06249067476e tempest-VolumeAndVolumeTypeFromImageTest-167469837 None] Converted 0.00 MB image at 0.00 MB/s
Jul 30 20:34:10 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-6810fbc8-f126-4378-a0f2-06249067476e tempest-VolumeAndVolumeTypeFromImageTest-167469837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-ac927d88-400d-4704-a250-79d74d5fa42f 1G {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:34:10 devstack sudo[101825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-ac927d88-400d-4704-a250-79d74d5fa42f 1G
Jul 30 20:34:10 devstack sudo[101825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:34:10 devstack sudo[101825]: pam_unix(sudo:session): session closed for user root
Jul 30 20:34:10 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-6810fbc8-f126-4378-a0f2-06249067476e tempest-VolumeAndVolumeTypeFromImageTest-167469837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-ac927d88-400d-4704-a250-79d74d5fa42f 1G" returned: 0 in 0.490s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:34:10 devstack cinder-volume[88719]: DEBUG cinder.volume.volume_utils [None req-6810fbc8-f126-4378-a0f2-06249067476e tempest-VolumeAndVolumeTypeFromImageTest-167469837 None] Downloaded image 7c942c33-af92-4b5c-85c2-86bc177d295a ((None, [{'url': 'file:///opt/stack/data/glance/images/7c942c33-af92-4b5c-85c2-86bc177d295a', 'metadata': {}}])) to volume ac927d88-400d-4704-a250-79d74d5fa42f successfully. {{(pid=88719) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 30 20:34:10 devstack cinder-volume[88719]: DEBUG cinder.image.image_utils [None req-6810fbc8-f126-4378-a0f2-06249067476e tempest-VolumeAndVolumeTypeFromImageTest-167469837 None] Temporary image 7c942c33-af92-4b5c-85c2-86bc177d295a for user 7a1432c10d2f4b2caafb752e4725b5c6 is deleted. {{(pid=88719) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 30 20:34:10 devstack cinder-volume[88719]: DEBUG cinder.volume.volume_utils [None req-6810fbc8-f126-4378-a0f2-06249067476e tempest-VolumeAndVolumeTypeFromImageTest-167469837 None] Marking volume ac927d88-400d-4704-a250-79d74d5fa42f as bootable. {{(pid=88719) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 30 20:34:10 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-6810fbc8-f126-4378-a0f2-06249067476e tempest-VolumeAndVolumeTypeFromImageTest-167469837 None] Copying metadata from image 7c942c33-af92-4b5c-85c2-86bc177d295a to ac927d88-400d-4704-a250-79d74d5fa42f. {{(pid=88719) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 30 20:34:10 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-6810fbc8-f126-4378-a0f2-06249067476e tempest-VolumeAndVolumeTypeFromImageTest-167469837 None] Creating volume glance metadata for volume ac927d88-400d-4704-a250-79d74d5fa42f backed by image 7c942c33-af92-4b5c-85c2-86bc177d295a with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '7c942c33-af92-4b5c-85c2-86bc177d295a', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '5805e1dbb6524b5d55ddd10ca2da6589', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88719) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 30 20:34:10 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-6810fbc8-f126-4378-a0f2-06249067476e tempest-VolumeAndVolumeTypeFromImageTest-167469837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95c573ae-f62f-4996-a644-8102270f29d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac927d88-400d-4704-a250-79d74d5fa42f', 'volume_size': 1, 'image_id': '7c942c33-af92-4b5c-85c2-86bc177d295a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7c942c33-af92-4b5c-85c2-86bc177d295a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5805e1dbb6524b5d55ddd10ca2da6589', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '293f03aee39d49b88a754a94a096f163', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2416f8433c044746e7615f29a9e1b5650cc0e02ffa98d74923f50fc07c1e31e945ee5ecffc1ce7d414d7f0f0f9bf6c96a320e36afa39a406e23c04257fde290a', 'id': '7c942c33-af92-4b5c-85c2-86bc177d295a', 'created_at': datetime.datetime(2026, 7, 30, 18, 33, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 18, 33, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7c942c33-af92-4b5c-85c2-86bc177d295a/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x786884887ce0>}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:34:10 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-6810fbc8-f126-4378-a0f2-06249067476e tempest-VolumeAndVolumeTypeFromImageTest-167469837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f9101ad-f2c6-4f6d-9bf9-fe1835816d1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:34:10 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-6810fbc8-f126-4378-a0f2-06249067476e tempest-VolumeAndVolumeTypeFromImageTest-167469837 None] Volume volume-ac927d88-400d-4704-a250-79d74d5fa42f (ac927d88-400d-4704-a250-79d74d5fa42f): created successfully
Jul 30 20:34:10 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-6810fbc8-f126-4378-a0f2-06249067476e tempest-VolumeAndVolumeTypeFromImageTest-167469837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f9101ad-f2c6-4f6d-9bf9-fe1835816d1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:34:10 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-6810fbc8-f126-4378-a0f2-06249067476e tempest-VolumeAndVolumeTypeFromImageTest-167469837 None] Flow 'volume_create_manager' (67c6740c-8055-4cf9-a212-c139d0075ed0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:34:10 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-6810fbc8-f126-4378-a0f2-06249067476e tempest-VolumeAndVolumeTypeFromImageTest-167469837 None] Created volume successfully.
Jul 30 20:34:12 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-9437dfa7-1d73-425c-aa4b-1183e7e4f2d8 tempest-VolumeAndVolumeTypeFromImageTest-167469837 None] Acquiring lock "cinder-ac927d88-400d-4704-a250-79d74d5fa42f-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:34:12 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-8f8b6ae6-d868-44e5-97f0-cb76d092ae4d tempest-SnapshotMetadataTestJSON-497369993 None] Acquiring lock "cinder-ea0adcc6-2e6b-4c25-9544-5b117e1880b5-delete_snapshot" by "delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:34:12 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-9437dfa7-1d73-425c-aa4b-1183e7e4f2d8 tempest-VolumeAndVolumeTypeFromImageTest-167469837 None] Lock "cinder-ac927d88-400d-4704-a250-79d74d5fa42f-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:34:12 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-8f8b6ae6-d868-44e5-97f0-cb76d092ae4d tempest-SnapshotMetadataTestJSON-497369993 None] Lock "cinder-ea0adcc6-2e6b-4c25-9544-5b117e1880b5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.071s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:34:12 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-8f8b6ae6-d868-44e5-97f0-cb76d092ae4d tempest-SnapshotMetadataTestJSON-497369993 None] Acquiring lock "cinder-quobyte-8406921c-ee01-4cbd-a43b-1387e8a6769b" by "delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:34:12 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-8f8b6ae6-d868-44e5-97f0-cb76d092ae4d tempest-SnapshotMetadataTestJSON-497369993 None] Lock "cinder-quobyte-8406921c-ee01-4cbd-a43b-1387e8a6769b" acquired by "delete_snapshot" :: waited 0.036s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:34:12 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-8f8b6ae6-d868-44e5-97f0-cb76d092ae4d tempest-SnapshotMetadataTestJSON-497369993 None] Acquiring lock "cinder-quobyte-ea0adcc6-2e6b-4c25-9544-5b117e1880b5" by "_delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:34:12 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-8f8b6ae6-d868-44e5-97f0-cb76d092ae4d tempest-SnapshotMetadataTestJSON-497369993 None] Lock "cinder-quobyte-ea0adcc6-2e6b-4c25-9544-5b117e1880b5" acquired by "_delete_snapshot" :: waited 0.045s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:34:12 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-8f8b6ae6-d868-44e5-97f0-cb76d092ae4d tempest-SnapshotMetadataTestJSON-497369993 None] Deleting offline snapshot ea0adcc6-2e6b-4c25-9544-5b117e1880b5 of volume 8406921c-ee01-4cbd-a43b-1387e8a6769b {{(pid=88719) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 30 20:34:12 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-8f8b6ae6-d868-44e5-97f0-cb76d092ae4d tempest-SnapshotMetadataTestJSON-497369993 None] snapshot_file for this snap is: volume-8406921c-ee01-4cbd-a43b-1387e8a6769b.ea0adcc6-2e6b-4c25-9544-5b117e1880b5 {{(pid=88719) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 30 20:34:12 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-9437dfa7-1d73-425c-aa4b-1183e7e4f2d8 tempest-VolumeAndVolumeTypeFromImageTest-167469837 None] Acquiring lock "cinder-quobyte-ac927d88-400d-4704-a250-79d74d5fa42f" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:34:12 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbaf6226-9bc7-40d6-ab64-c7ac8a8c9da1]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:34:12 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8f8b6ae6-d868-44e5-97f0-cb76d092ae4d tempest-SnapshotMetadataTestJSON-497369993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-8406921c-ee01-4cbd-a43b-1387e8a6769b.ea0adcc6-2e6b-4c25-9544-5b117e1880b5 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:34:12 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-9437dfa7-1d73-425c-aa4b-1183e7e4f2d8 tempest-VolumeAndVolumeTypeFromImageTest-167469837 None] Lock "cinder-quobyte-ac927d88-400d-4704-a250-79d74d5fa42f" acquired by "delete_volume" :: waited 0.052s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:34:12 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca7b1f5a-6aca-4b87-aeea-c8ddba7508b7]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:34:12 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-9437dfa7-1d73-425c-aa4b-1183e7e4f2d8 tempest-VolumeAndVolumeTypeFromImageTest-167469837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-ac927d88-400d-4704-a250-79d74d5fa42f {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:34:12 devstack sudo[101836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-8406921c-ee01-4cbd-a43b-1387e8a6769b.ea0adcc6-2e6b-4c25-9544-5b117e1880b5
Jul 30 20:34:12 devstack sudo[101836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:34:12 devstack sudo[101837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-ac927d88-400d-4704-a250-79d74d5fa42f
Jul 30 20:34:12 devstack sudo[101837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:34:13 devstack sudo[101837]: pam_unix(sudo:session): session closed for user root
Jul 30 20:34:13 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-9437dfa7-1d73-425c-aa4b-1183e7e4f2d8 tempest-VolumeAndVolumeTypeFromImageTest-167469837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-ac927d88-400d-4704-a250-79d74d5fa42f" returned: 0 in 0.549s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:34:13 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-9437dfa7-1d73-425c-aa4b-1183e7e4f2d8 tempest-VolumeAndVolumeTypeFromImageTest-167469837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-ac927d88-400d-4704-a250-79d74d5fa42f {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:34:13 devstack sudo[101845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-ac927d88-400d-4704-a250-79d74d5fa42f
Jul 30 20:34:13 devstack sudo[101845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:34:13 devstack sudo[101836]: pam_unix(sudo:session): session closed for user root
Jul 30 20:34:13 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8f8b6ae6-d868-44e5-97f0-cb76d092ae4d tempest-SnapshotMetadataTestJSON-497369993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-8406921c-ee01-4cbd-a43b-1387e8a6769b.ea0adcc6-2e6b-4c25-9544-5b117e1880b5" returned: 0 in 0.798s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:34:13 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-8f8b6ae6-d868-44e5-97f0-cb76d092ae4d tempest-SnapshotMetadataTestJSON-497369993 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8406921c-ee01-4cbd-a43b-1387e8a6769b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88719) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 30 20:34:13 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[a967d20a-5103-4339-8ea0-36f64ea7454b]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:34:13 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8f8b6ae6-d868-44e5-97f0-cb76d092ae4d tempest-SnapshotMetadataTestJSON-497369993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-8406921c-ee01-4cbd-a43b-1387e8a6769b {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:34:13 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b0104b7-e112-49f5-b456-14138847b420 tempest-TestMinimumBasicScenario-570690969 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:34:13 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-8b0104b7-e112-49f5-b456-14138847b420 tempest-TestMinimumBasicScenario-570690969 None] Flow 'volume_create_manager' (42350825-a412-4055-bfdf-fcc7d2aad9b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:34:13 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-8b0104b7-e112-49f5-b456-14138847b420 tempest-TestMinimumBasicScenario-570690969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ae556d0-49d4-45a4-98a2-1759a0ff42a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:34:13 devstack sudo[101845]: pam_unix(sudo:session): session closed for user root
Jul 30 20:34:13 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-8b0104b7-e112-49f5-b456-14138847b420 tempest-TestMinimumBasicScenario-570690969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ae556d0-49d4-45a4-98a2-1759a0ff42a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:34:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1650635720',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d501bebd-a092-4699-b733-29aff8434e13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19f6817c9a464b4899a09c2fff9a2a09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:34:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:34:13Z,use_quota=True,user_id='29e531a9224d4155ba87f405970713f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:34:13 devstack sudo[101848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-8406921c-ee01-4cbd-a43b-1387e8a6769b
Jul 30 20:34:13 devstack sudo[101848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:34:13 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-8b0104b7-e112-49f5-b456-14138847b420 tempest-TestMinimumBasicScenario-570690969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e5a77b7-5fc6-4dd1-a856-08807c6f3589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:34:13 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-8b0104b7-e112-49f5-b456-14138847b420 tempest-TestMinimumBasicScenario-570690969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e5a77b7-5fc6-4dd1-a856-08807c6f3589) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:34:13 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-8b0104b7-e112-49f5-b456-14138847b420 tempest-TestMinimumBasicScenario-570690969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c74d82dc-5e9f-4e4d-a994-e8f87a2da7d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:34:13 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-8b0104b7-e112-49f5-b456-14138847b420 tempest-TestMinimumBasicScenario-570690969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c74d82dc-5e9f-4e4d-a994-e8f87a2da7d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd501bebd-a092-4699-b733-29aff8434e13', 'volume_name': 'volume-d501bebd-a092-4699-b733-29aff8434e13', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:34:13 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-8b0104b7-e112-49f5-b456-14138847b420 tempest-TestMinimumBasicScenario-570690969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1320233-97ee-4373-b810-f02e4ad73c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:34:13 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-8b0104b7-e112-49f5-b456-14138847b420 tempest-TestMinimumBasicScenario-570690969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1320233-97ee-4373-b810-f02e4ad73c48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:34:13 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-8b0104b7-e112-49f5-b456-14138847b420 tempest-TestMinimumBasicScenario-570690969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b384644-c9b3-4ab5-8a7c-0e6514386cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:34:13 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-8b0104b7-e112-49f5-b456-14138847b420 tempest-TestMinimumBasicScenario-570690969 None] Volume d501bebd-a092-4699-b733-29aff8434e13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d501bebd-a092-4699-b733-29aff8434e13', 'volume_size': 1}
Jul 30 20:34:13 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-8b0104b7-e112-49f5-b456-14138847b420 tempest-TestMinimumBasicScenario-570690969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:34:13 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-8b0104b7-e112-49f5-b456-14138847b420 tempest-TestMinimumBasicScenario-570690969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:34:13 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-8b0104b7-e112-49f5-b456-14138847b420 tempest-TestMinimumBasicScenario-570690969 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:34:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1650635720',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d501bebd-a092-4699-b733-29aff8434e13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19f6817c9a464b4899a09c2fff9a2a09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:34:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:34:13Z,use_quota=True,user_id='29e531a9224d4155ba87f405970713f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:34:13 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-8b0104b7-e112-49f5-b456-14138847b420 tempest-TestMinimumBasicScenario-570690969 None] Creating volume d501bebd-a092-4699-b733-29aff8434e13 {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:34:13 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-8b0104b7-e112-49f5-b456-14138847b420 tempest-TestMinimumBasicScenario-570690969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:34:13 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-8b0104b7-e112-49f5-b456-14138847b420 tempest-TestMinimumBasicScenario-570690969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:34:13 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-8b0104b7-e112-49f5-b456-14138847b420 tempest-TestMinimumBasicScenario-570690969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:34:13 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-8b0104b7-e112-49f5-b456-14138847b420 tempest-TestMinimumBasicScenario-570690969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:34:13 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-8b0104b7-e112-49f5-b456-14138847b420 tempest-TestMinimumBasicScenario-570690969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:34:13 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-8b0104b7-e112-49f5-b456-14138847b420 tempest-TestMinimumBasicScenario-570690969 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:34:13 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-8b0104b7-e112-49f5-b456-14138847b420 tempest-TestMinimumBasicScenario-570690969 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:34:13 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8b0104b7-e112-49f5-b456-14138847b420 tempest-TestMinimumBasicScenario-570690969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d501bebd-a092-4699-b733-29aff8434e13 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:34:13 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-9437dfa7-1d73-425c-aa4b-1183e7e4f2d8 tempest-VolumeAndVolumeTypeFromImageTest-167469837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-ac927d88-400d-4704-a250-79d74d5fa42f" returned: 0 in 0.519s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:34:13 devstack sudo[101851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d501bebd-a092-4699-b733-29aff8434e13 1073741824
Jul 30 20:34:13 devstack sudo[101851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:34:13 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-9437dfa7-1d73-425c-aa4b-1183e7e4f2d8 tempest-VolumeAndVolumeTypeFromImageTest-167469837 None] Lock "cinder-quobyte-ac927d88-400d-4704-a250-79d74d5fa42f" released by "delete_volume" :: held 1.158s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:34:13 devstack cinder-volume[88719]: WARNING cinder.quota [None req-9437dfa7-1d73-425c-aa4b-1183e7e4f2d8 tempest-VolumeAndVolumeTypeFromImageTest-167469837 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Jul 30 20:34:13 devstack cinder-volume[88719]: WARNING cinder.quota [None req-9437dfa7-1d73-425c-aa4b-1183e7e4f2d8 tempest-VolumeAndVolumeTypeFromImageTest-167469837 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Jul 30 20:34:13 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-9437dfa7-1d73-425c-aa4b-1183e7e4f2d8 tempest-VolumeAndVolumeTypeFromImageTest-167469837 None] Created reservations ['4462fa65-3101-437b-88be-ae93dbc094fa', '702eb17b-1a97-45c8-abcf-aa66c015f50f', '1e125c4e-ecb8-4c2b-ac4d-d69cfbcb7325', '07669da8-e046-4c13-93dc-64c1f459a722'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:34:13 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-9437dfa7-1d73-425c-aa4b-1183e7e4f2d8 tempest-VolumeAndVolumeTypeFromImageTest-167469837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:34:13 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-9437dfa7-1d73-425c-aa4b-1183e7e4f2d8 tempest-VolumeAndVolumeTypeFromImageTest-167469837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:34:13 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-9437dfa7-1d73-425c-aa4b-1183e7e4f2d8 tempest-VolumeAndVolumeTypeFromImageTest-167469837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:34:13 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-9437dfa7-1d73-425c-aa4b-1183e7e4f2d8 tempest-VolumeAndVolumeTypeFromImageTest-167469837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:34:13 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-9437dfa7-1d73-425c-aa4b-1183e7e4f2d8 tempest-VolumeAndVolumeTypeFromImageTest-167469837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:34:13 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-9437dfa7-1d73-425c-aa4b-1183e7e4f2d8 tempest-VolumeAndVolumeTypeFromImageTest-167469837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:34:13 devstack sudo[101848]: pam_unix(sudo:session): session closed for user root
Jul 30 20:34:13 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8f8b6ae6-d868-44e5-97f0-cb76d092ae4d tempest-SnapshotMetadataTestJSON-497369993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-8406921c-ee01-4cbd-a43b-1387e8a6769b" returned: 0 in 0.680s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:34:13 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8f8b6ae6-d868-44e5-97f0-cb76d092ae4d tempest-SnapshotMetadataTestJSON-497369993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-8406921c-ee01-4cbd-a43b-1387e8a6769b.ea0adcc6-2e6b-4c25-9544-5b117e1880b5 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:34:13 devstack sudo[101856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:34:14 devstack sudo[101856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:34:14 devstack sudo[101858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-8406921c-ee01-4cbd-a43b-1387e8a6769b.ea0adcc6-2e6b-4c25-9544-5b117e1880b5
Jul 30 20:34:14 devstack sudo[101858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:34:14 devstack sudo[101856]: pam_unix(sudo:session): session closed for user root
Jul 30 20:34:14 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-9437dfa7-1d73-425c-aa4b-1183e7e4f2d8 tempest-VolumeAndVolumeTypeFromImageTest-167469837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.416s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:34:14 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-9437dfa7-1d73-425c-aa4b-1183e7e4f2d8 tempest-VolumeAndVolumeTypeFromImageTest-167469837 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:34:14 devstack sudo[101851]: pam_unix(sudo:session): session closed for user root
Jul 30 20:34:14 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-9437dfa7-1d73-425c-aa4b-1183e7e4f2d8 tempest-VolumeAndVolumeTypeFromImageTest-167469837 None] Deleted volume successfully.
Jul 30 20:34:14 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8b0104b7-e112-49f5-b456-14138847b420 tempest-TestMinimumBasicScenario-570690969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d501bebd-a092-4699-b733-29aff8434e13 1073741824" returned: 0 in 0.841s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:34:14 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-9437dfa7-1d73-425c-aa4b-1183e7e4f2d8 tempest-VolumeAndVolumeTypeFromImageTest-167469837 None] Lock "cinder-ac927d88-400d-4704-a250-79d74d5fa42f-delete_volume" released by "delete_volume" :: held 2.184s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:34:14 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8b0104b7-e112-49f5-b456-14138847b420 tempest-TestMinimumBasicScenario-570690969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d501bebd-a092-4699-b733-29aff8434e13 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:34:14 devstack sudo[101869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d501bebd-a092-4699-b733-29aff8434e13
Jul 30 20:34:14 devstack sudo[101869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:34:14 devstack sudo[101858]: pam_unix(sudo:session): session closed for user root
Jul 30 20:34:14 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8f8b6ae6-d868-44e5-97f0-cb76d092ae4d tempest-SnapshotMetadataTestJSON-497369993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-8406921c-ee01-4cbd-a43b-1387e8a6769b.ea0adcc6-2e6b-4c25-9544-5b117e1880b5" returned: 0 in 0.494s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:34:14 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8f8b6ae6-d868-44e5-97f0-cb76d092ae4d tempest-SnapshotMetadataTestJSON-497369993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-8406921c-ee01-4cbd-a43b-1387e8a6769b.ea0adcc6-2e6b-4c25-9544-5b117e1880b5 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:34:14 devstack sudo[101871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-8406921c-ee01-4cbd-a43b-1387e8a6769b.ea0adcc6-2e6b-4c25-9544-5b117e1880b5
Jul 30 20:34:14 devstack sudo[101871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:34:14 devstack sudo[101869]: pam_unix(sudo:session): session closed for user root
Jul 30 20:34:14 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8b0104b7-e112-49f5-b456-14138847b420 tempest-TestMinimumBasicScenario-570690969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d501bebd-a092-4699-b733-29aff8434e13" returned: 0 in 0.389s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:34:14 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-8b0104b7-e112-49f5-b456-14138847b420 tempest-TestMinimumBasicScenario-570690969 None] <== create_volume: return (1284ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:34:14 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-8b0104b7-e112-49f5-b456-14138847b420 tempest-TestMinimumBasicScenario-570690969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.287s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:34:14 devstack sudo[101871]: pam_unix(sudo:session): session closed for user root
Jul 30 20:34:14 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-8b0104b7-e112-49f5-b456-14138847b420 tempest-TestMinimumBasicScenario-570690969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b384644-c9b3-4ab5-8a7c-0e6514386cdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d501bebd-a092-4699-b733-29aff8434e13', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:34:14 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-8b0104b7-e112-49f5-b456-14138847b420 tempest-TestMinimumBasicScenario-570690969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cdd676e-9dc7-4558-bceb-38ae05ff8e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:34:14 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8f8b6ae6-d868-44e5-97f0-cb76d092ae4d tempest-SnapshotMetadataTestJSON-497369993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-8406921c-ee01-4cbd-a43b-1387e8a6769b.ea0adcc6-2e6b-4c25-9544-5b117e1880b5" returned: 0 in 0.393s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:34:14 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-8b0104b7-e112-49f5-b456-14138847b420 tempest-TestMinimumBasicScenario-570690969 None] Volume volume-d501bebd-a092-4699-b733-29aff8434e13 (d501bebd-a092-4699-b733-29aff8434e13): created successfully
Jul 30 20:34:14 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-8b0104b7-e112-49f5-b456-14138847b420 tempest-TestMinimumBasicScenario-570690969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cdd676e-9dc7-4558-bceb-38ae05ff8e03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:34:14 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-8b0104b7-e112-49f5-b456-14138847b420 tempest-TestMinimumBasicScenario-570690969 None] Flow 'volume_create_manager' (42350825-a412-4055-bfdf-fcc7d2aad9b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:34:14 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-8f8b6ae6-d868-44e5-97f0-cb76d092ae4d tempest-SnapshotMetadataTestJSON-497369993 None] Lock "cinder-quobyte-ea0adcc6-2e6b-4c25-9544-5b117e1880b5" released by "_delete_snapshot" :: held 2.634s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:34:15 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-8f8b6ae6-d868-44e5-97f0-cb76d092ae4d tempest-SnapshotMetadataTestJSON-497369993 None] Lock "cinder-quobyte-8406921c-ee01-4cbd-a43b-1387e8a6769b" released by "delete_snapshot" :: held 2.704s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:34:15 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-8b0104b7-e112-49f5-b456-14138847b420 tempest-TestMinimumBasicScenario-570690969 None] Created volume successfully.
Jul 30 20:34:15 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-8f8b6ae6-d868-44e5-97f0-cb76d092ae4d tempest-SnapshotMetadataTestJSON-497369993 None] Created reservations ['3de0cf06-239e-4004-a2b2-ddead400749d', 'c678e260-7d37-4e08-a98b-aeb4b949eeee', 'f5448bc2-42da-4d9b-990a-98d6932cd0e5', 'b9d7b68d-005a-460a-a4a2-83febe8774ae'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:34:15 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-8f8b6ae6-d868-44e5-97f0-cb76d092ae4d tempest-SnapshotMetadataTestJSON-497369993 None] Delete snapshot completed successfully.
Jul 30 20:34:15 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-8f8b6ae6-d868-44e5-97f0-cb76d092ae4d tempest-SnapshotMetadataTestJSON-497369993 None] Lock "cinder-ea0adcc6-2e6b-4c25-9544-5b117e1880b5-delete_snapshot" released by "delete_snapshot" :: held 2.984s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:34:15 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-cf16bf0f-b8ac-437e-b378-b4286ee84148 tempest-SnapshotMetadataTestJSON-497369993 None] Acquiring lock "cinder-8406921c-ee01-4cbd-a43b-1387e8a6769b-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:34:15 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-cf16bf0f-b8ac-437e-b378-b4286ee84148 tempest-SnapshotMetadataTestJSON-497369993 None] Lock "cinder-8406921c-ee01-4cbd-a43b-1387e8a6769b-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:34:15 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-cf16bf0f-b8ac-437e-b378-b4286ee84148 tempest-SnapshotMetadataTestJSON-497369993 None] Acquiring lock "cinder-quobyte-8406921c-ee01-4cbd-a43b-1387e8a6769b" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:34:15 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-cf16bf0f-b8ac-437e-b378-b4286ee84148 tempest-SnapshotMetadataTestJSON-497369993 None] Lock "cinder-quobyte-8406921c-ee01-4cbd-a43b-1387e8a6769b" acquired by "delete_volume" :: waited 0.028s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:34:15 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4d9a1ea-c43c-4872-83bd-254a0389aab9]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:34:15 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-cf16bf0f-b8ac-437e-b378-b4286ee84148 tempest-SnapshotMetadataTestJSON-497369993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-8406921c-ee01-4cbd-a43b-1387e8a6769b {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:34:16 devstack sudo[101879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-8406921c-ee01-4cbd-a43b-1387e8a6769b
Jul 30 20:34:16 devstack sudo[101879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:34:16 devstack cinder-volume[88719]: DEBUG oslo_service.periodic_task [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88719) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 30 20:34:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:34:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:34:16 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:34:16 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:34:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:34:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:34:16 devstack sudo[101889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:34:16 devstack sudo[101889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:34:16 devstack sudo[101879]: pam_unix(sudo:session): session closed for user root
Jul 30 20:34:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-cf16bf0f-b8ac-437e-b378-b4286ee84148 tempest-SnapshotMetadataTestJSON-497369993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-8406921c-ee01-4cbd-a43b-1387e8a6769b" returned: 0 in 0.799s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:34:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-cf16bf0f-b8ac-437e-b378-b4286ee84148 tempest-SnapshotMetadataTestJSON-497369993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-8406921c-ee01-4cbd-a43b-1387e8a6769b {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:34:16 devstack sudo[101895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-8406921c-ee01-4cbd-a43b-1387e8a6769b
Jul 30 20:34:16 devstack sudo[101895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:34:17 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [req-3c2f01cd-1415-47b6-ba26-28ad6b629013 req-22b9c0ca-ade8-4b94-aee7-5ebe77f74b9d tempest-TestMinimumBasicScenario-570690969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:34:17 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [req-3c2f01cd-1415-47b6-ba26-28ad6b629013 req-22b9c0ca-ade8-4b94-aee7-5ebe77f74b9d tempest-TestMinimumBasicScenario-570690969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:34:17 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [req-3c2f01cd-1415-47b6-ba26-28ad6b629013 req-22b9c0ca-ade8-4b94-aee7-5ebe77f74b9d tempest-TestMinimumBasicScenario-570690969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.075s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:34:17 devstack sudo[101889]: pam_unix(sudo:session): session closed for user root
Jul 30 20:34:17 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.708s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:34:17 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:34:17 devstack sudo[101895]: pam_unix(sudo:session): session closed for user root
Jul 30 20:34:17 devstack cinder-volume[88719]: DEBUG oslo_service.periodic_task [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Running periodic task VolumeManager._thread_info {{(pid=88719) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 30 20:34:17 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] thread count: 28 {{(pid=88719) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 30 20:34:17 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] thread info: [<_MainThread(MainThread, started 132390416908416)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132390306497536)>, <Thread(Thread-3 (stat_writer), started daemon 132390304471680)>, <Thread(Rabbit-heartbeat, started daemon 132390303393408)>, <Thread(Thread-5 (_runner), started daemon 132390303543168)>, <Thread(Thread-7 (_runner), started daemon 132390303563392)>, <Thread(fd_logger, started daemon 132390301344640)>, <Thread(privsep_reader, started daemon 132390301560640)>, <Thread(tpool_thread_0, started daemon 132390291470016)>, <Thread(tpool_thread_1, started daemon 132390283077312)>, <Thread(tpool_thread_2, started daemon 132390274684608)>, <Thread(tpool_thread_3, started daemon 132390266291904)>, <Thread(tpool_thread_4, started daemon 132390257899200)>, <Thread(tpool_thread_5, started daemon 132390249506496)>, <Thread(tpool_thread_6, started daemon 132390241113792)>, <Thread(tpool_thread_7, started daemon 132390232721088)>, <Thread(tpool_thread_8, started daemon 132390224328384)>, <Thread(tpool_thread_9, started daemon 132390215919296)>, <Thread(tpool_thread_10, started daemon 132390207510208)>, <Thread(tpool_thread_11, started daemon 132390199101120)>, <Thread(tpool_thread_12, started daemon 132390190692032)>, <Thread(tpool_thread_13, started daemon 132390182282944)>, <Thread(tpool_thread_14, started daemon 132390173873856)>, <Thread(tpool_thread_15, started daemon 132390165464768)>, <Thread(tpool_thread_16, started daemon 132390157055680)>, <Thread(tpool_thread_17, started daemon 132390148646592)>, <Thread(tpool_thread_18, started daemon 132390140237504)>, <Thread(tpool_thread_19, started daemon 132390131828416)>] {{(pid=88719) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 30 20:34:17 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-cf16bf0f-b8ac-437e-b378-b4286ee84148 tempest-SnapshotMetadataTestJSON-497369993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-8406921c-ee01-4cbd-a43b-1387e8a6769b" returned: 0 in 0.624s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:34:17 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-cf16bf0f-b8ac-437e-b378-b4286ee84148 tempest-SnapshotMetadataTestJSON-497369993 None] Lock "cinder-quobyte-8406921c-ee01-4cbd-a43b-1387e8a6769b" released by "delete_volume" :: held 1.531s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:34:17 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [req-3c2f01cd-1415-47b6-ba26-28ad6b629013 req-22b9c0ca-ade8-4b94-aee7-5ebe77f74b9d tempest-TestMinimumBasicScenario-570690969 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5', 'name': 'volume-d501bebd-a092-4699-b733-29aff8434e13', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f94fae35-0c58-4a12-8861-3a8b82fdfbd3', 'enforce_multipath': True} {{(pid=88719) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 30 20:34:17 devstack cinder-volume[88719]: INFO cinder.volume.manager [req-3c2f01cd-1415-47b6-ba26-28ad6b629013 req-22b9c0ca-ade8-4b94-aee7-5ebe77f74b9d tempest-TestMinimumBasicScenario-570690969 None] attachment_update completed successfully.
Jul 30 20:34:17 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-cf16bf0f-b8ac-437e-b378-b4286ee84148 tempest-SnapshotMetadataTestJSON-497369993 None] Created reservations ['23f9950c-0796-411c-9f6a-82a7bf9a9da4', 'c8e91caf-ed5d-4517-b7b1-3ecdc75b90ac', '4ec43426-a7c1-4005-9970-74e971d1c226', '28691011-bcf9-4f48-b293-4572ece55b14'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:34:17 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-cf16bf0f-b8ac-437e-b378-b4286ee84148 tempest-SnapshotMetadataTestJSON-497369993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:34:17 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-cf16bf0f-b8ac-437e-b378-b4286ee84148 tempest-SnapshotMetadataTestJSON-497369993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:34:17 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-cf16bf0f-b8ac-437e-b378-b4286ee84148 tempest-SnapshotMetadataTestJSON-497369993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:34:17 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-cf16bf0f-b8ac-437e-b378-b4286ee84148 tempest-SnapshotMetadataTestJSON-497369993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:34:17 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-cf16bf0f-b8ac-437e-b378-b4286ee84148 tempest-SnapshotMetadataTestJSON-497369993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:34:17 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-cf16bf0f-b8ac-437e-b378-b4286ee84148 tempest-SnapshotMetadataTestJSON-497369993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:34:17 devstack sudo[101922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:34:17 devstack sudo[101922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:34:18 devstack sudo[101922]: pam_unix(sudo:session): session closed for user root
Jul 30 20:34:18 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-cf16bf0f-b8ac-437e-b378-b4286ee84148 tempest-SnapshotMetadataTestJSON-497369993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.424s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:34:18 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-cf16bf0f-b8ac-437e-b378-b4286ee84148 tempest-SnapshotMetadataTestJSON-497369993 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:34:18 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-cf16bf0f-b8ac-437e-b378-b4286ee84148 tempest-SnapshotMetadataTestJSON-497369993 None] Deleted volume successfully.
Jul 30 20:34:18 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-cf16bf0f-b8ac-437e-b378-b4286ee84148 tempest-SnapshotMetadataTestJSON-497369993 None] Lock "cinder-8406921c-ee01-4cbd-a43b-1387e8a6769b-delete_volume" released by "delete_volume" :: held 2.492s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:34:24 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-aae6f18d-b448-438a-85c1-96d46dd52b8c tempest-VolumesCloneNegativeTest-1567397129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:34:24 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-aae6f18d-b448-438a-85c1-96d46dd52b8c tempest-VolumesCloneNegativeTest-1567397129 None] Flow 'volume_create_manager' (53cac895-1089-47b8-8287-1a857e875aab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:34:24 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-aae6f18d-b448-438a-85c1-96d46dd52b8c tempest-VolumesCloneNegativeTest-1567397129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (360f6bea-2b93-4c5c-8899-0fa72108b015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:34:24 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-aae6f18d-b448-438a-85c1-96d46dd52b8c tempest-VolumesCloneNegativeTest-1567397129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (360f6bea-2b93-4c5c-8899-0fa72108b015) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:34:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1842262340',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3208aa50-82e1-4558-89cf-5abaaa4c4875,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee80894402b34ce9b5786b18fd946f79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:34:24Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:34:24Z,use_quota=True,user_id='659e6dd9116047be8d9dc1de0778a78a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:34:24 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-aae6f18d-b448-438a-85c1-96d46dd52b8c tempest-VolumesCloneNegativeTest-1567397129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63c758a4-6377-4e36-af7b-ffe6753c61f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:34:24 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-aae6f18d-b448-438a-85c1-96d46dd52b8c tempest-VolumesCloneNegativeTest-1567397129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63c758a4-6377-4e36-af7b-ffe6753c61f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:34:24 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-aae6f18d-b448-438a-85c1-96d46dd52b8c tempest-VolumesCloneNegativeTest-1567397129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d91a2639-1e14-4b68-bc22-f3449f32a996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:34:24 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-aae6f18d-b448-438a-85c1-96d46dd52b8c tempest-VolumesCloneNegativeTest-1567397129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d91a2639-1e14-4b68-bc22-f3449f32a996) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3208aa50-82e1-4558-89cf-5abaaa4c4875', 'volume_name': 'volume-3208aa50-82e1-4558-89cf-5abaaa4c4875', 'volume_size': 2}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:34:24 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-aae6f18d-b448-438a-85c1-96d46dd52b8c tempest-VolumesCloneNegativeTest-1567397129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6adbfb8d-0ace-45b6-acdc-ccc4bd3c561d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:34:24 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-aae6f18d-b448-438a-85c1-96d46dd52b8c tempest-VolumesCloneNegativeTest-1567397129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6adbfb8d-0ace-45b6-acdc-ccc4bd3c561d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:34:24 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-aae6f18d-b448-438a-85c1-96d46dd52b8c tempest-VolumesCloneNegativeTest-1567397129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52f79cb5-3d7d-4c67-a00d-c1e83e1cbe6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:34:24 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-aae6f18d-b448-438a-85c1-96d46dd52b8c tempest-VolumesCloneNegativeTest-1567397129 None] Volume 3208aa50-82e1-4558-89cf-5abaaa4c4875: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3208aa50-82e1-4558-89cf-5abaaa4c4875', 'volume_size': 2}
Jul 30 20:34:24 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-aae6f18d-b448-438a-85c1-96d46dd52b8c tempest-VolumesCloneNegativeTest-1567397129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:34:24 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-aae6f18d-b448-438a-85c1-96d46dd52b8c tempest-VolumesCloneNegativeTest-1567397129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:34:24 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-aae6f18d-b448-438a-85c1-96d46dd52b8c tempest-VolumesCloneNegativeTest-1567397129 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:34:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1842262340',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3208aa50-82e1-4558-89cf-5abaaa4c4875,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee80894402b34ce9b5786b18fd946f79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:34:24Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:34:24Z,use_quota=True,user_id='659e6dd9116047be8d9dc1de0778a78a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:34:24 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-aae6f18d-b448-438a-85c1-96d46dd52b8c tempest-VolumesCloneNegativeTest-1567397129 None] Creating volume 3208aa50-82e1-4558-89cf-5abaaa4c4875 {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:34:24 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-aae6f18d-b448-438a-85c1-96d46dd52b8c tempest-VolumesCloneNegativeTest-1567397129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:34:24 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-aae6f18d-b448-438a-85c1-96d46dd52b8c tempest-VolumesCloneNegativeTest-1567397129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:34:24 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-aae6f18d-b448-438a-85c1-96d46dd52b8c tempest-VolumesCloneNegativeTest-1567397129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:34:24 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-aae6f18d-b448-438a-85c1-96d46dd52b8c tempest-VolumesCloneNegativeTest-1567397129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:34:24 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-aae6f18d-b448-438a-85c1-96d46dd52b8c tempest-VolumesCloneNegativeTest-1567397129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:34:24 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-aae6f18d-b448-438a-85c1-96d46dd52b8c tempest-VolumesCloneNegativeTest-1567397129 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:34:24 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-aae6f18d-b448-438a-85c1-96d46dd52b8c tempest-VolumesCloneNegativeTest-1567397129 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:34:24 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-aae6f18d-b448-438a-85c1-96d46dd52b8c tempest-VolumesCloneNegativeTest-1567397129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3208aa50-82e1-4558-89cf-5abaaa4c4875 2147483648 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:34:24 devstack sudo[102327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3208aa50-82e1-4558-89cf-5abaaa4c4875 2147483648
Jul 30 20:34:24 devstack sudo[102327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:34:25 devstack sudo[102327]: pam_unix(sudo:session): session closed for user root
Jul 30 20:34:25 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-aae6f18d-b448-438a-85c1-96d46dd52b8c tempest-VolumesCloneNegativeTest-1567397129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3208aa50-82e1-4558-89cf-5abaaa4c4875 2147483648" returned: 0 in 0.719s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:34:25 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-aae6f18d-b448-438a-85c1-96d46dd52b8c tempest-VolumesCloneNegativeTest-1567397129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3208aa50-82e1-4558-89cf-5abaaa4c4875 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:34:25 devstack sudo[102336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3208aa50-82e1-4558-89cf-5abaaa4c4875
Jul 30 20:34:25 devstack sudo[102336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:34:25 devstack sudo[102336]: pam_unix(sudo:session): session closed for user root
Jul 30 20:34:25 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-aae6f18d-b448-438a-85c1-96d46dd52b8c tempest-VolumesCloneNegativeTest-1567397129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3208aa50-82e1-4558-89cf-5abaaa4c4875" returned: 0 in 0.465s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:34:25 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-aae6f18d-b448-438a-85c1-96d46dd52b8c tempest-VolumesCloneNegativeTest-1567397129 None] <== create_volume: return (1260ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:34:25 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-aae6f18d-b448-438a-85c1-96d46dd52b8c tempest-VolumesCloneNegativeTest-1567397129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.263s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:34:25 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-aae6f18d-b448-438a-85c1-96d46dd52b8c tempest-VolumesCloneNegativeTest-1567397129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52f79cb5-3d7d-4c67-a00d-c1e83e1cbe6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3208aa50-82e1-4558-89cf-5abaaa4c4875', 'volume_size': 2}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:34:25 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-aae6f18d-b448-438a-85c1-96d46dd52b8c tempest-VolumesCloneNegativeTest-1567397129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2e22302-b9b5-4fd6-b324-077286401a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:34:25 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-aae6f18d-b448-438a-85c1-96d46dd52b8c tempest-VolumesCloneNegativeTest-1567397129 None] Volume volume-3208aa50-82e1-4558-89cf-5abaaa4c4875 (3208aa50-82e1-4558-89cf-5abaaa4c4875): created successfully
Jul 30 20:34:25 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-aae6f18d-b448-438a-85c1-96d46dd52b8c tempest-VolumesCloneNegativeTest-1567397129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2e22302-b9b5-4fd6-b324-077286401a5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:34:25 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-aae6f18d-b448-438a-85c1-96d46dd52b8c tempest-VolumesCloneNegativeTest-1567397129 None] Flow 'volume_create_manager' (53cac895-1089-47b8-8287-1a857e875aab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:34:25 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-aae6f18d-b448-438a-85c1-96d46dd52b8c tempest-VolumesCloneNegativeTest-1567397129 None] Created volume successfully.
Jul 30 20:34:26 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-3f9ff946-bebe-4264-bce7-16192666f2ee tempest-VolumesCloneNegativeTest-1567397129 None] Acquiring lock "cinder-3208aa50-82e1-4558-89cf-5abaaa4c4875-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:34:26 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-3f9ff946-bebe-4264-bce7-16192666f2ee tempest-VolumesCloneNegativeTest-1567397129 None] Lock "cinder-3208aa50-82e1-4558-89cf-5abaaa4c4875-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:34:26 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-3f9ff946-bebe-4264-bce7-16192666f2ee tempest-VolumesCloneNegativeTest-1567397129 None] Acquiring lock "cinder-quobyte-3208aa50-82e1-4558-89cf-5abaaa4c4875" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:34:26 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-3f9ff946-bebe-4264-bce7-16192666f2ee tempest-VolumesCloneNegativeTest-1567397129 None] Lock "cinder-quobyte-3208aa50-82e1-4558-89cf-5abaaa4c4875" acquired by "delete_volume" :: waited 0.042s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:34:26 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[df35244b-64f0-484a-82b6-4ba6d1aacb9c]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:34:26 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3f9ff946-bebe-4264-bce7-16192666f2ee tempest-VolumesCloneNegativeTest-1567397129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3208aa50-82e1-4558-89cf-5abaaa4c4875 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:34:27 devstack sudo[102340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3208aa50-82e1-4558-89cf-5abaaa4c4875
Jul 30 20:34:27 devstack sudo[102340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:34:27 devstack sudo[102340]: pam_unix(sudo:session): session closed for user root
Jul 30 20:34:27 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3f9ff946-bebe-4264-bce7-16192666f2ee tempest-VolumesCloneNegativeTest-1567397129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3208aa50-82e1-4558-89cf-5abaaa4c4875" returned: 0 in 0.499s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:34:27 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3f9ff946-bebe-4264-bce7-16192666f2ee tempest-VolumesCloneNegativeTest-1567397129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3208aa50-82e1-4558-89cf-5abaaa4c4875 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:34:27 devstack sudo[102345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3208aa50-82e1-4558-89cf-5abaaa4c4875
Jul 30 20:34:27 devstack sudo[102345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:34:27 devstack sudo[102345]: pam_unix(sudo:session): session closed for user root
Jul 30 20:34:27 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3f9ff946-bebe-4264-bce7-16192666f2ee tempest-VolumesCloneNegativeTest-1567397129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3208aa50-82e1-4558-89cf-5abaaa4c4875" returned: 0 in 0.456s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:34:27 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-3f9ff946-bebe-4264-bce7-16192666f2ee tempest-VolumesCloneNegativeTest-1567397129 None] Lock "cinder-quobyte-3208aa50-82e1-4558-89cf-5abaaa4c4875" released by "delete_volume" :: held 1.037s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:34:28 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-3f9ff946-bebe-4264-bce7-16192666f2ee tempest-VolumesCloneNegativeTest-1567397129 None] Created reservations ['30a557ec-ac9f-44ac-a9ef-2ae6744be3dd', '534d140c-0384-4a13-9655-ce9e18db79cf', 'c41324a9-23f8-4836-ad07-92edb433e498', 'b7bdcb6e-07c5-499d-bb43-7f70c20e626c'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:34:28 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-3f9ff946-bebe-4264-bce7-16192666f2ee tempest-VolumesCloneNegativeTest-1567397129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:34:28 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-3f9ff946-bebe-4264-bce7-16192666f2ee tempest-VolumesCloneNegativeTest-1567397129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:34:28 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-3f9ff946-bebe-4264-bce7-16192666f2ee tempest-VolumesCloneNegativeTest-1567397129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:34:28 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-3f9ff946-bebe-4264-bce7-16192666f2ee tempest-VolumesCloneNegativeTest-1567397129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:34:28 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-3f9ff946-bebe-4264-bce7-16192666f2ee tempest-VolumesCloneNegativeTest-1567397129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:34:28 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3f9ff946-bebe-4264-bce7-16192666f2ee tempest-VolumesCloneNegativeTest-1567397129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:34:28 devstack sudo[102348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:34:28 devstack sudo[102348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:34:28 devstack sudo[102348]: pam_unix(sudo:session): session closed for user root
Jul 30 20:34:28 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3f9ff946-bebe-4264-bce7-16192666f2ee tempest-VolumesCloneNegativeTest-1567397129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.322s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:34:28 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-3f9ff946-bebe-4264-bce7-16192666f2ee tempest-VolumesCloneNegativeTest-1567397129 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:34:28 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-3f9ff946-bebe-4264-bce7-16192666f2ee tempest-VolumesCloneNegativeTest-1567397129 None] Deleted volume successfully.
Jul 30 20:34:28 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff1bdf77-2169-48d2-b8bb-eaa530e85d59 tempest-VolumeImageDependencyTests-1592161875 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:34:28 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-ff1bdf77-2169-48d2-b8bb-eaa530e85d59 tempest-VolumeImageDependencyTests-1592161875 None] Flow 'volume_create_manager' (a39b34b8-eb38-4c1b-b607-82c4e506e712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:34:28 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-ff1bdf77-2169-48d2-b8bb-eaa530e85d59 tempest-VolumeImageDependencyTests-1592161875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca9bb956-f6a5-484c-a525-b719c315b24e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:34:28 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-ff1bdf77-2169-48d2-b8bb-eaa530e85d59 tempest-VolumeImageDependencyTests-1592161875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca9bb956-f6a5-484c-a525-b719c315b24e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:34:28Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53cff57e-da92-493d-b055-959674fd8370,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca8606988742416eab8b28f7bea0452c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:34:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:34:28Z,use_quota=True,user_id='21bd6208ef4442e386c34608f3b58a46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:34:28 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-ff1bdf77-2169-48d2-b8bb-eaa530e85d59 tempest-VolumeImageDependencyTests-1592161875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd1485f3-203a-46ad-affd-c97037020ba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:34:28 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-ff1bdf77-2169-48d2-b8bb-eaa530e85d59 tempest-VolumeImageDependencyTests-1592161875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd1485f3-203a-46ad-affd-c97037020ba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:34:28 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-ff1bdf77-2169-48d2-b8bb-eaa530e85d59 tempest-VolumeImageDependencyTests-1592161875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b30bda9d-a065-46dc-abc3-4d726121cbf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:34:28 devstack cinder-volume[88719]: DEBUG cinder.image.glance [None req-ff1bdf77-2169-48d2-b8bb-eaa530e85d59 tempest-VolumeImageDependencyTests-1592161875 None] Creating Keystone auth plugin from conf {{(pid=88719) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 30 20:34:28 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-3f9ff946-bebe-4264-bce7-16192666f2ee tempest-VolumesCloneNegativeTest-1567397129 None] Lock "cinder-3208aa50-82e1-4558-89cf-5abaaa4c4875-delete_volume" released by "delete_volume" :: held 1.789s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:34:29 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-ff1bdf77-2169-48d2-b8bb-eaa530e85d59 tempest-VolumeImageDependencyTests-1592161875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b30bda9d-a065-46dc-abc3-4d726121cbf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '53cff57e-da92-493d-b055-959674fd8370', 'volume_name': 'volume-53cff57e-da92-493d-b055-959674fd8370', 'volume_size': 1, 'image_id': 'bb26cb7d-a287-477c-804e-794a8a14d451', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bb26cb7d-a287-477c-804e-794a8a14d451', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '71d62fcda988f6288e7b693901cfcb13', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ca8606988742416eab8b28f7bea0452c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e6960dab11a64eeb4b5bda9457060f02b0136121665610ab930c5620925986a06bb93eb5c5dec3fa5243d3c9d0607c18626d6f8bc7aeb688880d3043cdd24516', 'id': 'bb26cb7d-a287-477c-804e-794a8a14d451', 'created_at': datetime.datetime(2026, 7, 30, 18, 34, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 18, 34, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bb26cb7d-a287-477c-804e-794a8a14d451/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x78688482bf20>}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:34:29 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-ff1bdf77-2169-48d2-b8bb-eaa530e85d59 tempest-VolumeImageDependencyTests-1592161875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6abc19b-4cd8-4b08-9ba0-41f620074cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:34:29 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-ff1bdf77-2169-48d2-b8bb-eaa530e85d59 tempest-VolumeImageDependencyTests-1592161875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6abc19b-4cd8-4b08-9ba0-41f620074cf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:34:29 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-ff1bdf77-2169-48d2-b8bb-eaa530e85d59 tempest-VolumeImageDependencyTests-1592161875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2269465b-0e79-49a7-b287-4ea9c0a11ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:34:29 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-ff1bdf77-2169-48d2-b8bb-eaa530e85d59 tempest-VolumeImageDependencyTests-1592161875 None] Volume 53cff57e-da92-493d-b055-959674fd8370: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-53cff57e-da92-493d-b055-959674fd8370', 'volume_size': 1, 'image_id': 'bb26cb7d-a287-477c-804e-794a8a14d451', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bb26cb7d-a287-477c-804e-794a8a14d451', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '71d62fcda988f6288e7b693901cfcb13', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ca8606988742416eab8b28f7bea0452c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e6960dab11a64eeb4b5bda9457060f02b0136121665610ab930c5620925986a06bb93eb5c5dec3fa5243d3c9d0607c18626d6f8bc7aeb688880d3043cdd24516', 'id': 'bb26cb7d-a287-477c-804e-794a8a14d451', 'created_at': datetime.datetime(2026, 7, 30, 18, 34, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 18, 34, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bb26cb7d-a287-477c-804e-794a8a14d451/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x78688482bf20>}
Jul 30 20:34:29 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff1bdf77-2169-48d2-b8bb-eaa530e85d59 tempest-VolumeImageDependencyTests-1592161875 None] Trying to clone 53cff57e-da92-493d-b055-959674fd8370 from image bb26cb7d-a287-477c-804e-794a8a14d451 at location (None, [{'url': 'file:///opt/stack/data/glance/images/bb26cb7d-a287-477c-804e-794a8a14d451', 'metadata': {}}]). {{(pid=88719) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 30 20:34:29 devstack cinder-volume[88719]: DEBUG cinder.image.image_utils [None req-ff1bdf77-2169-48d2-b8bb-eaa530e85d59 tempest-VolumeImageDependencyTests-1592161875 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_bb26cb7d-a287-477c-804e-794a8a14d451_77rh3pi1devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88719) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 30 20:34:29 devstack cinder-volume[88719]: INFO cinder.image.image_utils [None req-ff1bdf77-2169-48d2-b8bb-eaa530e85d59 tempest-VolumeImageDependencyTests-1592161875 None] Image download 0.00 MB at 0.00 MB/s
Jul 30 20:34:29 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[101777c1-28a7-4307-ace5-b251a749ca79]: (4, 'raw') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:34:29 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-ff1bdf77-2169-48d2-b8bb-eaa530e85d59 tempest-VolumeImageDependencyTests-1592161875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bb26cb7d-a287-477c-804e-794a8a14d451_77rh3pi1devstack@QuobyteHD {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:34:29 devstack sudo[102351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bb26cb7d-a287-477c-804e-794a8a14d451_77rh3pi1devstack@QuobyteHD
Jul 30 20:34:29 devstack sudo[102351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:34:29 devstack sudo[102351]: pam_unix(sudo:session): session closed for user root
Jul 30 20:34:29 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-ff1bdf77-2169-48d2-b8bb-eaa530e85d59 tempest-VolumeImageDependencyTests-1592161875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bb26cb7d-a287-477c-804e-794a8a14d451_77rh3pi1devstack@QuobyteHD" returned: 0 in 0.433s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:34:29 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-ff1bdf77-2169-48d2-b8bb-eaa530e85d59 tempest-VolumeImageDependencyTests-1592161875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bb26cb7d-a287-477c-804e-794a8a14d451_77rh3pi1devstack@QuobyteHD {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:34:29 devstack sudo[102355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bb26cb7d-a287-477c-804e-794a8a14d451_77rh3pi1devstack@QuobyteHD
Jul 30 20:34:29 devstack sudo[102355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:34:30 devstack sudo[102355]: pam_unix(sudo:session): session closed for user root
Jul 30 20:34:30 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-ff1bdf77-2169-48d2-b8bb-eaa530e85d59 tempest-VolumeImageDependencyTests-1592161875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bb26cb7d-a287-477c-804e-794a8a14d451_77rh3pi1devstack@QuobyteHD" returned: 1 in 0.382s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:34:30 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-ff1bdf77-2169-48d2-b8bb-eaa530e85d59 tempest-VolumeImageDependencyTests-1592161875 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bb26cb7d-a287-477c-804e-794a8a14d451_77rh3pi1devstack@QuobyteHD' failed. Not Retrying. {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 30 20:34:30 devstack cinder-volume[88719]: DEBUG cinder.image.image_utils [None req-ff1bdf77-2169-48d2-b8bb-eaa530e85d59 tempest-VolumeImageDependencyTests-1592161875 None] Temporary image bb26cb7d-a287-477c-804e-794a8a14d451 is fetched for user 21bd6208ef4442e386c34608f3b58a46. {{(pid=88719) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 30 20:34:30 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c22adef-b814-4f24-b840-0a7d44a9eb60]: (4, 'raw') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:34:30 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-ff1bdf77-2169-48d2-b8bb-eaa530e85d59 tempest-VolumeImageDependencyTests-1592161875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bb26cb7d-a287-477c-804e-794a8a14d451_77rh3pi1devstack@QuobyteHD {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:34:30 devstack sudo[102361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bb26cb7d-a287-477c-804e-794a8a14d451_77rh3pi1devstack@QuobyteHD
Jul 30 20:34:30 devstack sudo[102361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:34:30 devstack sudo[102361]: pam_unix(sudo:session): session closed for user root
Jul 30 20:34:30 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-ff1bdf77-2169-48d2-b8bb-eaa530e85d59 tempest-VolumeImageDependencyTests-1592161875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bb26cb7d-a287-477c-804e-794a8a14d451_77rh3pi1devstack@QuobyteHD" returned: 0 in 0.446s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:34:30 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-ff1bdf77-2169-48d2-b8bb-eaa530e85d59 tempest-VolumeImageDependencyTests-1592161875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bb26cb7d-a287-477c-804e-794a8a14d451_77rh3pi1devstack@QuobyteHD {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:34:30 devstack sudo[102365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bb26cb7d-a287-477c-804e-794a8a14d451_77rh3pi1devstack@QuobyteHD
Jul 30 20:34:30 devstack sudo[102365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:34:31 devstack sudo[102365]: pam_unix(sudo:session): session closed for user root
Jul 30 20:34:31 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-ff1bdf77-2169-48d2-b8bb-eaa530e85d59 tempest-VolumeImageDependencyTests-1592161875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bb26cb7d-a287-477c-804e-794a8a14d451_77rh3pi1devstack@QuobyteHD" returned: 1 in 0.383s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:34:31 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-ff1bdf77-2169-48d2-b8bb-eaa530e85d59 tempest-VolumeImageDependencyTests-1592161875 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bb26cb7d-a287-477c-804e-794a8a14d451_77rh3pi1devstack@QuobyteHD' failed. Not Retrying. {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 30 20:34:31 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-ff1bdf77-2169-48d2-b8bb-eaa530e85d59 tempest-VolumeImageDependencyTests-1592161875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:34:31 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-ff1bdf77-2169-48d2-b8bb-eaa530e85d59 tempest-VolumeImageDependencyTests-1592161875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:34:31 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-ff1bdf77-2169-48d2-b8bb-eaa530e85d59 tempest-VolumeImageDependencyTests-1592161875 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:34:28Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53cff57e-da92-493d-b055-959674fd8370,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca8606988742416eab8b28f7bea0452c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:34:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:34:28Z,use_quota=True,user_id='21bd6208ef4442e386c34608f3b58a46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:34:31 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-ff1bdf77-2169-48d2-b8bb-eaa530e85d59 tempest-VolumeImageDependencyTests-1592161875 None] Creating volume 53cff57e-da92-493d-b055-959674fd8370 {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:34:31 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-ff1bdf77-2169-48d2-b8bb-eaa530e85d59 tempest-VolumeImageDependencyTests-1592161875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:34:31 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-ff1bdf77-2169-48d2-b8bb-eaa530e85d59 tempest-VolumeImageDependencyTests-1592161875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:34:31 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-ff1bdf77-2169-48d2-b8bb-eaa530e85d59 tempest-VolumeImageDependencyTests-1592161875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:34:31 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-ff1bdf77-2169-48d2-b8bb-eaa530e85d59 tempest-VolumeImageDependencyTests-1592161875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:34:31 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-ff1bdf77-2169-48d2-b8bb-eaa530e85d59 tempest-VolumeImageDependencyTests-1592161875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:34:31 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-ff1bdf77-2169-48d2-b8bb-eaa530e85d59 tempest-VolumeImageDependencyTests-1592161875 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:34:31 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-ff1bdf77-2169-48d2-b8bb-eaa530e85d59 tempest-VolumeImageDependencyTests-1592161875 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:34:31 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-ff1bdf77-2169-48d2-b8bb-eaa530e85d59 tempest-VolumeImageDependencyTests-1592161875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-53cff57e-da92-493d-b055-959674fd8370 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:34:31 devstack sudo[102370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-53cff57e-da92-493d-b055-959674fd8370 1073741824
Jul 30 20:34:31 devstack sudo[102370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:34:31 devstack sudo[102370]: pam_unix(sudo:session): session closed for user root
Jul 30 20:34:31 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-ff1bdf77-2169-48d2-b8bb-eaa530e85d59 tempest-VolumeImageDependencyTests-1592161875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-53cff57e-da92-493d-b055-959674fd8370 1073741824" returned: 0 in 0.612s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:34:31 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-ff1bdf77-2169-48d2-b8bb-eaa530e85d59 tempest-VolumeImageDependencyTests-1592161875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-53cff57e-da92-493d-b055-959674fd8370 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:34:31 devstack sudo[102376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-53cff57e-da92-493d-b055-959674fd8370
Jul 30 20:34:31 devstack sudo[102376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:34:32 devstack sudo[102376]: pam_unix(sudo:session): session closed for user root
Jul 30 20:34:32 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-ff1bdf77-2169-48d2-b8bb-eaa530e85d59 tempest-VolumeImageDependencyTests-1592161875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-53cff57e-da92-493d-b055-959674fd8370" returned: 0 in 0.491s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:34:32 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-ff1bdf77-2169-48d2-b8bb-eaa530e85d59 tempest-VolumeImageDependencyTests-1592161875 None] <== create_volume: return (1161ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:34:32 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-ff1bdf77-2169-48d2-b8bb-eaa530e85d59 tempest-VolumeImageDependencyTests-1592161875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.164s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:34:32 devstack cinder-volume[88719]: DEBUG cinder.volume.volume_utils [None req-ff1bdf77-2169-48d2-b8bb-eaa530e85d59 tempest-VolumeImageDependencyTests-1592161875 None] Attempting download of bb26cb7d-a287-477c-804e-794a8a14d451 ((None, [{'url': 'file:///opt/stack/data/glance/images/bb26cb7d-a287-477c-804e-794a8a14d451', 'metadata': {}}])) to volume 53cff57e-da92-493d-b055-959674fd8370. {{(pid=88719) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 30 20:34:32 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7568196-a9ef-4023-b02e-d3fa05a30bdf]: (4, 'raw') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:34:32 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-ff1bdf77-2169-48d2-b8bb-eaa530e85d59 tempest-VolumeImageDependencyTests-1592161875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bb26cb7d-a287-477c-804e-794a8a14d451_9h98v12a {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:34:32 devstack sudo[102379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bb26cb7d-a287-477c-804e-794a8a14d451_9h98v12a
Jul 30 20:34:32 devstack sudo[102379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:34:32 devstack sudo[102379]: pam_unix(sudo:session): session closed for user root
Jul 30 20:34:32 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-ff1bdf77-2169-48d2-b8bb-eaa530e85d59 tempest-VolumeImageDependencyTests-1592161875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bb26cb7d-a287-477c-804e-794a8a14d451_9h98v12a" returned: 0 in 0.472s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:34:32 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-ff1bdf77-2169-48d2-b8bb-eaa530e85d59 tempest-VolumeImageDependencyTests-1592161875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bb26cb7d-a287-477c-804e-794a8a14d451_9h98v12a {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:34:32 devstack sudo[102383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bb26cb7d-a287-477c-804e-794a8a14d451_9h98v12a
Jul 30 20:34:32 devstack sudo[102383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:34:33 devstack sudo[102383]: pam_unix(sudo:session): session closed for user root
Jul 30 20:34:33 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-ff1bdf77-2169-48d2-b8bb-eaa530e85d59 tempest-VolumeImageDependencyTests-1592161875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bb26cb7d-a287-477c-804e-794a8a14d451_9h98v12a" returned: 1 in 0.444s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:34:33 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-ff1bdf77-2169-48d2-b8bb-eaa530e85d59 tempest-VolumeImageDependencyTests-1592161875 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bb26cb7d-a287-477c-804e-794a8a14d451_9h98v12a' failed. Not Retrying. {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 30 20:34:33 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8d41251-aeb1-4f4a-907c-00461c22c9c2]: (4, 'raw') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:34:33 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-ff1bdf77-2169-48d2-b8bb-eaa530e85d59 tempest-VolumeImageDependencyTests-1592161875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bb26cb7d-a287-477c-804e-794a8a14d451_77rh3pi1devstack@QuobyteHD {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:34:33 devstack sudo[102387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bb26cb7d-a287-477c-804e-794a8a14d451_77rh3pi1devstack@QuobyteHD
Jul 30 20:34:33 devstack sudo[102387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:34:33 devstack sudo[102387]: pam_unix(sudo:session): session closed for user root
Jul 30 20:34:33 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-ff1bdf77-2169-48d2-b8bb-eaa530e85d59 tempest-VolumeImageDependencyTests-1592161875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bb26cb7d-a287-477c-804e-794a8a14d451_77rh3pi1devstack@QuobyteHD" returned: 0 in 0.578s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:34:33 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-ff1bdf77-2169-48d2-b8bb-eaa530e85d59 tempest-VolumeImageDependencyTests-1592161875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bb26cb7d-a287-477c-804e-794a8a14d451_77rh3pi1devstack@QuobyteHD {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:34:34 devstack sudo[102391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bb26cb7d-a287-477c-804e-794a8a14d451_77rh3pi1devstack@QuobyteHD
Jul 30 20:34:34 devstack sudo[102391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:34:34 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-2389f0fe-5d32-4d70-bf23-ebcb575ddb29 tempest-VolumesListTestJSON-432618229 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:34:34 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2389f0fe-5d32-4d70-bf23-ebcb575ddb29 tempest-VolumesListTestJSON-432618229 None] Flow 'volume_create_manager' (a4eb67c6-192c-4120-8955-cfc241437fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:34:34 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2389f0fe-5d32-4d70-bf23-ebcb575ddb29 tempest-VolumesListTestJSON-432618229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1773d993-c820-44c3-bb0a-8a49217d4b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:34:34 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2389f0fe-5d32-4d70-bf23-ebcb575ddb29 tempest-VolumesListTestJSON-432618229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1773d993-c820-44c3-bb0a-8a49217d4b6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:34:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1350180974',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae5ec1b2-2d2b-4d4b-8d1b-0eaf2e9eaaee,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='55da8186f6644c328138d551913d0659',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:34:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:34:34Z,use_quota=True,user_id='75b53d8e05dc45129ed5ab4ae384e0ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:34:34 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2389f0fe-5d32-4d70-bf23-ebcb575ddb29 tempest-VolumesListTestJSON-432618229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaf1f5a6-bbb3-4241-845d-de1ac47f62cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:34:34 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2389f0fe-5d32-4d70-bf23-ebcb575ddb29 tempest-VolumesListTestJSON-432618229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaf1f5a6-bbb3-4241-845d-de1ac47f62cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:34:34 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2389f0fe-5d32-4d70-bf23-ebcb575ddb29 tempest-VolumesListTestJSON-432618229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54b25d5e-7c6c-43c6-91e3-ca69c88832dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:34:34 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2389f0fe-5d32-4d70-bf23-ebcb575ddb29 tempest-VolumesListTestJSON-432618229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54b25d5e-7c6c-43c6-91e3-ca69c88832dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae5ec1b2-2d2b-4d4b-8d1b-0eaf2e9eaaee', 'volume_name': 'volume-ae5ec1b2-2d2b-4d4b-8d1b-0eaf2e9eaaee', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:34:34 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2389f0fe-5d32-4d70-bf23-ebcb575ddb29 tempest-VolumesListTestJSON-432618229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfbd32be-3020-41cd-a5fe-ed6cca248070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:34:34 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2389f0fe-5d32-4d70-bf23-ebcb575ddb29 tempest-VolumesListTestJSON-432618229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfbd32be-3020-41cd-a5fe-ed6cca248070) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:34:34 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2389f0fe-5d32-4d70-bf23-ebcb575ddb29 tempest-VolumesListTestJSON-432618229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (211e9684-10da-4bdd-ab4e-38bd13460b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:34:34 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-2389f0fe-5d32-4d70-bf23-ebcb575ddb29 tempest-VolumesListTestJSON-432618229 None] Volume ae5ec1b2-2d2b-4d4b-8d1b-0eaf2e9eaaee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae5ec1b2-2d2b-4d4b-8d1b-0eaf2e9eaaee', 'volume_size': 1}
Jul 30 20:34:34 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-2389f0fe-5d32-4d70-bf23-ebcb575ddb29 tempest-VolumesListTestJSON-432618229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:34:34 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-2389f0fe-5d32-4d70-bf23-ebcb575ddb29 tempest-VolumesListTestJSON-432618229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:34:34 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-2389f0fe-5d32-4d70-bf23-ebcb575ddb29 tempest-VolumesListTestJSON-432618229 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:34:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1350180974',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae5ec1b2-2d2b-4d4b-8d1b-0eaf2e9eaaee,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='55da8186f6644c328138d551913d0659',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:34:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:34:34Z,use_quota=True,user_id='75b53d8e05dc45129ed5ab4ae384e0ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:34:34 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-2389f0fe-5d32-4d70-bf23-ebcb575ddb29 tempest-VolumesListTestJSON-432618229 None] Creating volume ae5ec1b2-2d2b-4d4b-8d1b-0eaf2e9eaaee {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:34:34 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-2389f0fe-5d32-4d70-bf23-ebcb575ddb29 tempest-VolumesListTestJSON-432618229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:34:34 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-2389f0fe-5d32-4d70-bf23-ebcb575ddb29 tempest-VolumesListTestJSON-432618229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:34:34 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-2389f0fe-5d32-4d70-bf23-ebcb575ddb29 tempest-VolumesListTestJSON-432618229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:34:34 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-2389f0fe-5d32-4d70-bf23-ebcb575ddb29 tempest-VolumesListTestJSON-432618229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:34:34 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-2389f0fe-5d32-4d70-bf23-ebcb575ddb29 tempest-VolumesListTestJSON-432618229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:34:34 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-2389f0fe-5d32-4d70-bf23-ebcb575ddb29 tempest-VolumesListTestJSON-432618229 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:34:34 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-2389f0fe-5d32-4d70-bf23-ebcb575ddb29 tempest-VolumesListTestJSON-432618229 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:34:34 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2389f0fe-5d32-4d70-bf23-ebcb575ddb29 tempest-VolumesListTestJSON-432618229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-ae5ec1b2-2d2b-4d4b-8d1b-0eaf2e9eaaee 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:34:34 devstack sudo[102395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-ae5ec1b2-2d2b-4d4b-8d1b-0eaf2e9eaaee 1073741824
Jul 30 20:34:34 devstack sudo[102395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:34:34 devstack sudo[102391]: pam_unix(sudo:session): session closed for user root
Jul 30 20:34:34 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-ff1bdf77-2169-48d2-b8bb-eaa530e85d59 tempest-VolumeImageDependencyTests-1592161875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bb26cb7d-a287-477c-804e-794a8a14d451_77rh3pi1devstack@QuobyteHD" returned: 1 in 0.891s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:34:34 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-ff1bdf77-2169-48d2-b8bb-eaa530e85d59 tempest-VolumeImageDependencyTests-1592161875 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bb26cb7d-a287-477c-804e-794a8a14d451_77rh3pi1devstack@QuobyteHD' failed. Not Retrying. {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 30 20:34:34 devstack cinder-volume[88719]: DEBUG cinder.image.image_utils [None req-ff1bdf77-2169-48d2-b8bb-eaa530e85d59 tempest-VolumeImageDependencyTests-1592161875 None] bb26cb7d-a287-477c-804e-794a8a14d451 was raw, converting to qcow2 {{(pid=88719) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 30 20:34:34 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-ff1bdf77-2169-48d2-b8bb-eaa530e85d59 tempest-VolumeImageDependencyTests-1592161875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_bb26cb7d-a287-477c-804e-794a8a14d451_77rh3pi1devstack@QuobyteHD /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-53cff57e-da92-493d-b055-959674fd8370 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:34:34 devstack sudo[102403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_bb26cb7d-a287-477c-804e-794a8a14d451_77rh3pi1devstack@QuobyteHD /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-53cff57e-da92-493d-b055-959674fd8370
Jul 30 20:34:34 devstack sudo[102403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:34:35 devstack sudo[102395]: pam_unix(sudo:session): session closed for user root
Jul 30 20:34:35 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2389f0fe-5d32-4d70-bf23-ebcb575ddb29 tempest-VolumesListTestJSON-432618229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-ae5ec1b2-2d2b-4d4b-8d1b-0eaf2e9eaaee 1073741824" returned: 0 in 0.849s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:34:35 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2389f0fe-5d32-4d70-bf23-ebcb575ddb29 tempest-VolumesListTestJSON-432618229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-ae5ec1b2-2d2b-4d4b-8d1b-0eaf2e9eaaee {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:34:35 devstack sudo[102411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-ae5ec1b2-2d2b-4d4b-8d1b-0eaf2e9eaaee
Jul 30 20:34:35 devstack sudo[102411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:34:35 devstack sudo[102403]: pam_unix(sudo:session): session closed for user root
Jul 30 20:34:35 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-ff1bdf77-2169-48d2-b8bb-eaa530e85d59 tempest-VolumeImageDependencyTests-1592161875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_bb26cb7d-a287-477c-804e-794a8a14d451_77rh3pi1devstack@QuobyteHD /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-53cff57e-da92-493d-b055-959674fd8370" returned: 0 in 0.745s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:34:35 devstack cinder-volume[88719]: DEBUG cinder.image.image_utils [None req-ff1bdf77-2169-48d2-b8bb-eaa530e85d59 tempest-VolumeImageDependencyTests-1592161875 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_bb26cb7d-a287-477c-804e-794a8a14d451_77rh3pi1devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-53cff57e-da92-493d-b055-959674fd8370 {{(pid=88719) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 30 20:34:35 devstack cinder-volume[88719]: INFO cinder.image.image_utils [None req-ff1bdf77-2169-48d2-b8bb-eaa530e85d59 tempest-VolumeImageDependencyTests-1592161875 None] Converted 0.00 MB image at 0.00 MB/s
Jul 30 20:34:35 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-ff1bdf77-2169-48d2-b8bb-eaa530e85d59 tempest-VolumeImageDependencyTests-1592161875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-53cff57e-da92-493d-b055-959674fd8370 1G {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:34:35 devstack sudo[102411]: pam_unix(sudo:session): session closed for user root
Jul 30 20:34:35 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2389f0fe-5d32-4d70-bf23-ebcb575ddb29 tempest-VolumesListTestJSON-432618229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-ae5ec1b2-2d2b-4d4b-8d1b-0eaf2e9eaaee" returned: 0 in 0.317s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:34:35 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-2389f0fe-5d32-4d70-bf23-ebcb575ddb29 tempest-VolumesListTestJSON-432618229 None] <== create_volume: return (1241ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:34:35 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-2389f0fe-5d32-4d70-bf23-ebcb575ddb29 tempest-VolumesListTestJSON-432618229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.246s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:34:35 devstack sudo[102414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-53cff57e-da92-493d-b055-959674fd8370 1G
Jul 30 20:34:35 devstack sudo[102414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:34:35 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2389f0fe-5d32-4d70-bf23-ebcb575ddb29 tempest-VolumesListTestJSON-432618229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (211e9684-10da-4bdd-ab4e-38bd13460b33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae5ec1b2-2d2b-4d4b-8d1b-0eaf2e9eaaee', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:34:35 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2389f0fe-5d32-4d70-bf23-ebcb575ddb29 tempest-VolumesListTestJSON-432618229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad2b3404-2d26-4c4f-b392-a64e8589ec30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:34:35 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-2389f0fe-5d32-4d70-bf23-ebcb575ddb29 tempest-VolumesListTestJSON-432618229 None] Volume volume-ae5ec1b2-2d2b-4d4b-8d1b-0eaf2e9eaaee (ae5ec1b2-2d2b-4d4b-8d1b-0eaf2e9eaaee): created successfully
Jul 30 20:34:35 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2389f0fe-5d32-4d70-bf23-ebcb575ddb29 tempest-VolumesListTestJSON-432618229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad2b3404-2d26-4c4f-b392-a64e8589ec30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:34:35 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2389f0fe-5d32-4d70-bf23-ebcb575ddb29 tempest-VolumesListTestJSON-432618229 None] Flow 'volume_create_manager' (a4eb67c6-192c-4120-8955-cfc241437fdb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:34:35 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-2389f0fe-5d32-4d70-bf23-ebcb575ddb29 tempest-VolumesListTestJSON-432618229 None] Created volume successfully.
Jul 30 20:34:35 devstack sudo[102414]: pam_unix(sudo:session): session closed for user root
Jul 30 20:34:35 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-ff1bdf77-2169-48d2-b8bb-eaa530e85d59 tempest-VolumeImageDependencyTests-1592161875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-53cff57e-da92-493d-b055-959674fd8370 1G" returned: 0 in 0.400s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:34:35 devstack cinder-volume[88719]: DEBUG cinder.volume.volume_utils [None req-ff1bdf77-2169-48d2-b8bb-eaa530e85d59 tempest-VolumeImageDependencyTests-1592161875 None] Downloaded image bb26cb7d-a287-477c-804e-794a8a14d451 ((None, [{'url': 'file:///opt/stack/data/glance/images/bb26cb7d-a287-477c-804e-794a8a14d451', 'metadata': {}}])) to volume 53cff57e-da92-493d-b055-959674fd8370 successfully. {{(pid=88719) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 30 20:34:35 devstack cinder-volume[88719]: DEBUG cinder.image.image_utils [None req-ff1bdf77-2169-48d2-b8bb-eaa530e85d59 tempest-VolumeImageDependencyTests-1592161875 None] Temporary image bb26cb7d-a287-477c-804e-794a8a14d451 for user 21bd6208ef4442e386c34608f3b58a46 is deleted. {{(pid=88719) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 30 20:34:35 devstack cinder-volume[88719]: DEBUG cinder.volume.volume_utils [None req-ff1bdf77-2169-48d2-b8bb-eaa530e85d59 tempest-VolumeImageDependencyTests-1592161875 None] Marking volume 53cff57e-da92-493d-b055-959674fd8370 as bootable. {{(pid=88719) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 30 20:34:35 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff1bdf77-2169-48d2-b8bb-eaa530e85d59 tempest-VolumeImageDependencyTests-1592161875 None] Copying metadata from image bb26cb7d-a287-477c-804e-794a8a14d451 to 53cff57e-da92-493d-b055-959674fd8370. {{(pid=88719) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 30 20:34:35 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff1bdf77-2169-48d2-b8bb-eaa530e85d59 tempest-VolumeImageDependencyTests-1592161875 None] Creating volume glance metadata for volume 53cff57e-da92-493d-b055-959674fd8370 backed by image bb26cb7d-a287-477c-804e-794a8a14d451 with: {'image_id': 'bb26cb7d-a287-477c-804e-794a8a14d451', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '71d62fcda988f6288e7b693901cfcb13', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88719) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 30 20:34:35 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-ff1bdf77-2169-48d2-b8bb-eaa530e85d59 tempest-VolumeImageDependencyTests-1592161875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2269465b-0e79-49a7-b287-4ea9c0a11ab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53cff57e-da92-493d-b055-959674fd8370', 'volume_size': 1, 'image_id': 'bb26cb7d-a287-477c-804e-794a8a14d451', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bb26cb7d-a287-477c-804e-794a8a14d451', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '71d62fcda988f6288e7b693901cfcb13', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ca8606988742416eab8b28f7bea0452c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e6960dab11a64eeb4b5bda9457060f02b0136121665610ab930c5620925986a06bb93eb5c5dec3fa5243d3c9d0607c18626d6f8bc7aeb688880d3043cdd24516', 'id': 'bb26cb7d-a287-477c-804e-794a8a14d451', 'created_at': datetime.datetime(2026, 7, 30, 18, 34, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 18, 34, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bb26cb7d-a287-477c-804e-794a8a14d451/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x78688482bf20>}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:34:35 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-ff1bdf77-2169-48d2-b8bb-eaa530e85d59 tempest-VolumeImageDependencyTests-1592161875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (480a8d42-9343-4630-8374-e3b9bf0b62ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:34:36 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-ff1bdf77-2169-48d2-b8bb-eaa530e85d59 tempest-VolumeImageDependencyTests-1592161875 None] Volume volume-53cff57e-da92-493d-b055-959674fd8370 (53cff57e-da92-493d-b055-959674fd8370): created successfully
Jul 30 20:34:36 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-ff1bdf77-2169-48d2-b8bb-eaa530e85d59 tempest-VolumeImageDependencyTests-1592161875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (480a8d42-9343-4630-8374-e3b9bf0b62ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:34:36 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-ff1bdf77-2169-48d2-b8bb-eaa530e85d59 tempest-VolumeImageDependencyTests-1592161875 None] Flow 'volume_create_manager' (a39b34b8-eb38-4c1b-b607-82c4e506e712) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:34:36 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-ff1bdf77-2169-48d2-b8bb-eaa530e85d59 tempest-VolumeImageDependencyTests-1592161875 None] Created volume successfully.
Jul 30 20:34:36 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-5b5b0d0d-04e8-4149-b63e-c44757e7a555 tempest-VolumeImageDependencyTests-1592161875 None] Acquiring lock "cinder-53cff57e-da92-493d-b055-959674fd8370-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:34:36 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-5b5b0d0d-04e8-4149-b63e-c44757e7a555 tempest-VolumeImageDependencyTests-1592161875 None] Lock "cinder-53cff57e-da92-493d-b055-959674fd8370-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:34:36 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-5b5b0d0d-04e8-4149-b63e-c44757e7a555 tempest-VolumeImageDependencyTests-1592161875 None] Acquiring lock "cinder-quobyte-53cff57e-da92-493d-b055-959674fd8370" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:34:36 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-5b5b0d0d-04e8-4149-b63e-c44757e7a555 tempest-VolumeImageDependencyTests-1592161875 None] Lock "cinder-quobyte-53cff57e-da92-493d-b055-959674fd8370" acquired by "delete_volume" :: waited 0.025s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:34:36 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfda6a9b-db1f-494b-8d00-7c6ad9da5342]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:34:36 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-5b5b0d0d-04e8-4149-b63e-c44757e7a555 tempest-VolumeImageDependencyTests-1592161875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-53cff57e-da92-493d-b055-959674fd8370 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:34:36 devstack sudo[102420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-53cff57e-da92-493d-b055-959674fd8370
Jul 30 20:34:36 devstack sudo[102420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:34:37 devstack sudo[102420]: pam_unix(sudo:session): session closed for user root
Jul 30 20:34:37 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-5b5b0d0d-04e8-4149-b63e-c44757e7a555 tempest-VolumeImageDependencyTests-1592161875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-53cff57e-da92-493d-b055-959674fd8370" returned: 0 in 0.568s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:34:37 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-5b5b0d0d-04e8-4149-b63e-c44757e7a555 tempest-VolumeImageDependencyTests-1592161875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-53cff57e-da92-493d-b055-959674fd8370 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:34:37 devstack sudo[102425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-53cff57e-da92-493d-b055-959674fd8370
Jul 30 20:34:37 devstack sudo[102425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:34:37 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-5df6974a-bc15-473d-b642-445440333ed2 tempest-VolumesListTestJSON-432618229 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:34:37 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5df6974a-bc15-473d-b642-445440333ed2 tempest-VolumesListTestJSON-432618229 None] Flow 'volume_create_manager' (e06e59c7-64b0-4988-9a69-9de04ad5add0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:34:37 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5df6974a-bc15-473d-b642-445440333ed2 tempest-VolumesListTestJSON-432618229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1418717e-d30d-4e41-ab6f-e9b52e4370ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:34:37 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5df6974a-bc15-473d-b642-445440333ed2 tempest-VolumesListTestJSON-432618229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1418717e-d30d-4e41-ab6f-e9b52e4370ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:34:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-373347976',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4714ad5-767a-461e-bc55-2df00dc629a4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='55da8186f6644c328138d551913d0659',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:34:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:34:37Z,use_quota=True,user_id='75b53d8e05dc45129ed5ab4ae384e0ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:34:37 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5df6974a-bc15-473d-b642-445440333ed2 tempest-VolumesListTestJSON-432618229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4db02aa7-518d-4f40-82d3-56c0ca701bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:34:37 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5df6974a-bc15-473d-b642-445440333ed2 tempest-VolumesListTestJSON-432618229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4db02aa7-518d-4f40-82d3-56c0ca701bb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:34:37 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5df6974a-bc15-473d-b642-445440333ed2 tempest-VolumesListTestJSON-432618229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49e212b5-a1b5-4937-ad18-752e100f4635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:34:37 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5df6974a-bc15-473d-b642-445440333ed2 tempest-VolumesListTestJSON-432618229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49e212b5-a1b5-4937-ad18-752e100f4635) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4714ad5-767a-461e-bc55-2df00dc629a4', 'volume_name': 'volume-d4714ad5-767a-461e-bc55-2df00dc629a4', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:34:37 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5df6974a-bc15-473d-b642-445440333ed2 tempest-VolumesListTestJSON-432618229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (822cdb52-39ef-4736-9d5b-ad34a9ea8116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:34:37 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5df6974a-bc15-473d-b642-445440333ed2 tempest-VolumesListTestJSON-432618229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (822cdb52-39ef-4736-9d5b-ad34a9ea8116) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:34:37 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5df6974a-bc15-473d-b642-445440333ed2 tempest-VolumesListTestJSON-432618229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9deccfde-e46b-4eb1-8d7b-d3fd482311cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:34:37 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-5df6974a-bc15-473d-b642-445440333ed2 tempest-VolumesListTestJSON-432618229 None] Volume d4714ad5-767a-461e-bc55-2df00dc629a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4714ad5-767a-461e-bc55-2df00dc629a4', 'volume_size': 1}
Jul 30 20:34:37 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-5df6974a-bc15-473d-b642-445440333ed2 tempest-VolumesListTestJSON-432618229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:34:37 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-5df6974a-bc15-473d-b642-445440333ed2 tempest-VolumesListTestJSON-432618229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:34:37 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-5df6974a-bc15-473d-b642-445440333ed2 tempest-VolumesListTestJSON-432618229 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:34:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-373347976',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4714ad5-767a-461e-bc55-2df00dc629a4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='55da8186f6644c328138d551913d0659',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:34:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:34:37Z,use_quota=True,user_id='75b53d8e05dc45129ed5ab4ae384e0ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:34:37 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-5df6974a-bc15-473d-b642-445440333ed2 tempest-VolumesListTestJSON-432618229 None] Creating volume d4714ad5-767a-461e-bc55-2df00dc629a4 {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:34:37 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-5df6974a-bc15-473d-b642-445440333ed2 tempest-VolumesListTestJSON-432618229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:34:37 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-5df6974a-bc15-473d-b642-445440333ed2 tempest-VolumesListTestJSON-432618229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:34:37 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-5df6974a-bc15-473d-b642-445440333ed2 tempest-VolumesListTestJSON-432618229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:34:37 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-5df6974a-bc15-473d-b642-445440333ed2 tempest-VolumesListTestJSON-432618229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:34:37 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-5df6974a-bc15-473d-b642-445440333ed2 tempest-VolumesListTestJSON-432618229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:34:37 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-5df6974a-bc15-473d-b642-445440333ed2 tempest-VolumesListTestJSON-432618229 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:34:37 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-5df6974a-bc15-473d-b642-445440333ed2 tempest-VolumesListTestJSON-432618229 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:34:37 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-5df6974a-bc15-473d-b642-445440333ed2 tempest-VolumesListTestJSON-432618229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d4714ad5-767a-461e-bc55-2df00dc629a4 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:34:37 devstack sudo[102428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d4714ad5-767a-461e-bc55-2df00dc629a4 1073741824
Jul 30 20:34:37 devstack sudo[102428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:34:37 devstack sudo[102425]: pam_unix(sudo:session): session closed for user root
Jul 30 20:34:37 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-5b5b0d0d-04e8-4149-b63e-c44757e7a555 tempest-VolumeImageDependencyTests-1592161875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-53cff57e-da92-493d-b055-959674fd8370" returned: 0 in 0.385s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:34:37 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-5b5b0d0d-04e8-4149-b63e-c44757e7a555 tempest-VolumeImageDependencyTests-1592161875 None] Lock "cinder-quobyte-53cff57e-da92-493d-b055-959674fd8370" released by "delete_volume" :: held 1.013s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:34:37 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-5b5b0d0d-04e8-4149-b63e-c44757e7a555 tempest-VolumeImageDependencyTests-1592161875 None] Created reservations ['3e07e5ce-382e-40f5-b76f-99681db95682', '37928f69-3f21-4082-a7f3-62d696e92883', '22d07d9f-0fd9-411b-8619-84777f2e05f4', 'c05342db-0222-4a6e-90d1-9533bb83c572'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:34:37 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-5b5b0d0d-04e8-4149-b63e-c44757e7a555 tempest-VolumeImageDependencyTests-1592161875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:34:37 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-5b5b0d0d-04e8-4149-b63e-c44757e7a555 tempest-VolumeImageDependencyTests-1592161875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:34:37 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-5b5b0d0d-04e8-4149-b63e-c44757e7a555 tempest-VolumeImageDependencyTests-1592161875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:34:37 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-5b5b0d0d-04e8-4149-b63e-c44757e7a555 tempest-VolumeImageDependencyTests-1592161875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:34:37 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-5b5b0d0d-04e8-4149-b63e-c44757e7a555 tempest-VolumeImageDependencyTests-1592161875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:34:37 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-5b5b0d0d-04e8-4149-b63e-c44757e7a555 tempest-VolumeImageDependencyTests-1592161875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:34:37 devstack sudo[102432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:34:37 devstack sudo[102432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:34:37 devstack sudo[102428]: pam_unix(sudo:session): session closed for user root
Jul 30 20:34:37 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-5df6974a-bc15-473d-b642-445440333ed2 tempest-VolumesListTestJSON-432618229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d4714ad5-767a-461e-bc55-2df00dc629a4 1073741824" returned: 0 in 0.508s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:34:37 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-5df6974a-bc15-473d-b642-445440333ed2 tempest-VolumesListTestJSON-432618229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d4714ad5-767a-461e-bc55-2df00dc629a4 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:34:37 devstack sudo[102432]: pam_unix(sudo:session): session closed for user root
Jul 30 20:34:37 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-5b5b0d0d-04e8-4149-b63e-c44757e7a555 tempest-VolumeImageDependencyTests-1592161875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.323s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:34:37 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-5b5b0d0d-04e8-4149-b63e-c44757e7a555 tempest-VolumeImageDependencyTests-1592161875 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:34:37 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-5b5b0d0d-04e8-4149-b63e-c44757e7a555 tempest-VolumeImageDependencyTests-1592161875 None] Deleted volume successfully.
Jul 30 20:34:38 devstack sudo[102463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d4714ad5-767a-461e-bc55-2df00dc629a4
Jul 30 20:34:38 devstack sudo[102463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:34:38 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-5b5b0d0d-04e8-4149-b63e-c44757e7a555 tempest-VolumeImageDependencyTests-1592161875 None] Lock "cinder-53cff57e-da92-493d-b055-959674fd8370-delete_volume" released by "delete_volume" :: held 1.707s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:34:38 devstack sudo[102463]: pam_unix(sudo:session): session closed for user root
Jul 30 20:34:38 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-5df6974a-bc15-473d-b642-445440333ed2 tempest-VolumesListTestJSON-432618229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d4714ad5-767a-461e-bc55-2df00dc629a4" returned: 0 in 0.392s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:34:38 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-5df6974a-bc15-473d-b642-445440333ed2 tempest-VolumesListTestJSON-432618229 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:34:38 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-5df6974a-bc15-473d-b642-445440333ed2 tempest-VolumesListTestJSON-432618229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:34:38 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5df6974a-bc15-473d-b642-445440333ed2 tempest-VolumesListTestJSON-432618229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9deccfde-e46b-4eb1-8d7b-d3fd482311cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4714ad5-767a-461e-bc55-2df00dc629a4', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:34:38 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5df6974a-bc15-473d-b642-445440333ed2 tempest-VolumesListTestJSON-432618229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97cbc6ce-d203-4cc6-9642-4b8bd6749f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:34:38 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-5df6974a-bc15-473d-b642-445440333ed2 tempest-VolumesListTestJSON-432618229 None] Volume volume-d4714ad5-767a-461e-bc55-2df00dc629a4 (d4714ad5-767a-461e-bc55-2df00dc629a4): created successfully
Jul 30 20:34:38 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5df6974a-bc15-473d-b642-445440333ed2 tempest-VolumesListTestJSON-432618229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97cbc6ce-d203-4cc6-9642-4b8bd6749f5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:34:38 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5df6974a-bc15-473d-b642-445440333ed2 tempest-VolumesListTestJSON-432618229 None] Flow 'volume_create_manager' (e06e59c7-64b0-4988-9a69-9de04ad5add0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:34:38 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-5df6974a-bc15-473d-b642-445440333ed2 tempest-VolumesListTestJSON-432618229 None] Created volume successfully.
Jul 30 20:34:39 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e1e32f2-0771-4460-9071-e8629b52370a tempest-VolumesListTestJSON-432618229 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:34:39 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5e1e32f2-0771-4460-9071-e8629b52370a tempest-VolumesListTestJSON-432618229 None] Flow 'volume_create_manager' (1310f945-4e7a-4363-85dd-a97213010250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:34:39 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5e1e32f2-0771-4460-9071-e8629b52370a tempest-VolumesListTestJSON-432618229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee42bd1a-d939-4707-a797-044c96562829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:34:39 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5e1e32f2-0771-4460-9071-e8629b52370a tempest-VolumesListTestJSON-432618229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee42bd1a-d939-4707-a797-044c96562829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:34:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1433598199',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82b94672-c671-4276-9844-4029b0670f29,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='55da8186f6644c328138d551913d0659',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:34:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:34:40Z,use_quota=True,user_id='75b53d8e05dc45129ed5ab4ae384e0ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:34:39 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5e1e32f2-0771-4460-9071-e8629b52370a tempest-VolumesListTestJSON-432618229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a737e2f-58bb-439c-a0bd-0d8effeb095e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:34:39 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5e1e32f2-0771-4460-9071-e8629b52370a tempest-VolumesListTestJSON-432618229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a737e2f-58bb-439c-a0bd-0d8effeb095e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:34:39 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5e1e32f2-0771-4460-9071-e8629b52370a tempest-VolumesListTestJSON-432618229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45cf0756-1468-4b83-8098-068a1a2ea873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:34:39 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5e1e32f2-0771-4460-9071-e8629b52370a tempest-VolumesListTestJSON-432618229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45cf0756-1468-4b83-8098-068a1a2ea873) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82b94672-c671-4276-9844-4029b0670f29', 'volume_name': 'volume-82b94672-c671-4276-9844-4029b0670f29', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:34:39 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5e1e32f2-0771-4460-9071-e8629b52370a tempest-VolumesListTestJSON-432618229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (760cacf9-ab8e-491a-84c7-76e81fcd497f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:34:39 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5e1e32f2-0771-4460-9071-e8629b52370a tempest-VolumesListTestJSON-432618229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (760cacf9-ab8e-491a-84c7-76e81fcd497f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:34:39 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5e1e32f2-0771-4460-9071-e8629b52370a tempest-VolumesListTestJSON-432618229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a7cf632-a70c-4d74-be43-1ea9af7fa0c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:34:39 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-5e1e32f2-0771-4460-9071-e8629b52370a tempest-VolumesListTestJSON-432618229 None] Volume 82b94672-c671-4276-9844-4029b0670f29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82b94672-c671-4276-9844-4029b0670f29', 'volume_size': 1}
Jul 30 20:34:39 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-5e1e32f2-0771-4460-9071-e8629b52370a tempest-VolumesListTestJSON-432618229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:34:39 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-5e1e32f2-0771-4460-9071-e8629b52370a tempest-VolumesListTestJSON-432618229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:34:39 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-5e1e32f2-0771-4460-9071-e8629b52370a tempest-VolumesListTestJSON-432618229 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:34:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1433598199',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82b94672-c671-4276-9844-4029b0670f29,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='55da8186f6644c328138d551913d0659',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:34:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:34:40Z,use_quota=True,user_id='75b53d8e05dc45129ed5ab4ae384e0ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:34:39 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-5e1e32f2-0771-4460-9071-e8629b52370a tempest-VolumesListTestJSON-432618229 None] Creating volume 82b94672-c671-4276-9844-4029b0670f29 {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:34:39 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-5e1e32f2-0771-4460-9071-e8629b52370a tempest-VolumesListTestJSON-432618229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:34:39 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-5e1e32f2-0771-4460-9071-e8629b52370a tempest-VolumesListTestJSON-432618229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:34:39 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-5e1e32f2-0771-4460-9071-e8629b52370a tempest-VolumesListTestJSON-432618229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:34:39 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-5e1e32f2-0771-4460-9071-e8629b52370a tempest-VolumesListTestJSON-432618229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:34:39 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-5e1e32f2-0771-4460-9071-e8629b52370a tempest-VolumesListTestJSON-432618229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:34:39 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-5e1e32f2-0771-4460-9071-e8629b52370a tempest-VolumesListTestJSON-432618229 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:34:39 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-5e1e32f2-0771-4460-9071-e8629b52370a tempest-VolumesListTestJSON-432618229 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:34:39 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-5e1e32f2-0771-4460-9071-e8629b52370a tempest-VolumesListTestJSON-432618229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-82b94672-c671-4276-9844-4029b0670f29 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:34:39 devstack sudo[102475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-82b94672-c671-4276-9844-4029b0670f29 1073741824
Jul 30 20:34:39 devstack sudo[102475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:34:40 devstack sudo[102475]: pam_unix(sudo:session): session closed for user root
Jul 30 20:34:40 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-5e1e32f2-0771-4460-9071-e8629b52370a tempest-VolumesListTestJSON-432618229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-82b94672-c671-4276-9844-4029b0670f29 1073741824" returned: 0 in 0.609s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:34:40 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-5e1e32f2-0771-4460-9071-e8629b52370a tempest-VolumesListTestJSON-432618229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-82b94672-c671-4276-9844-4029b0670f29 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:34:40 devstack sudo[102492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-82b94672-c671-4276-9844-4029b0670f29
Jul 30 20:34:40 devstack sudo[102492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:34:40 devstack sudo[102492]: pam_unix(sudo:session): session closed for user root
Jul 30 20:34:40 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-5e1e32f2-0771-4460-9071-e8629b52370a tempest-VolumesListTestJSON-432618229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-82b94672-c671-4276-9844-4029b0670f29" returned: 0 in 0.349s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:34:40 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-5e1e32f2-0771-4460-9071-e8629b52370a tempest-VolumesListTestJSON-432618229 None] <== create_volume: return (1033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:34:40 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-5e1e32f2-0771-4460-9071-e8629b52370a tempest-VolumesListTestJSON-432618229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:34:40 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5e1e32f2-0771-4460-9071-e8629b52370a tempest-VolumesListTestJSON-432618229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a7cf632-a70c-4d74-be43-1ea9af7fa0c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82b94672-c671-4276-9844-4029b0670f29', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:34:40 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5e1e32f2-0771-4460-9071-e8629b52370a tempest-VolumesListTestJSON-432618229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60a10e71-1671-4508-865f-b5aaad51d576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:34:40 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-5e1e32f2-0771-4460-9071-e8629b52370a tempest-VolumesListTestJSON-432618229 None] Volume volume-82b94672-c671-4276-9844-4029b0670f29 (82b94672-c671-4276-9844-4029b0670f29): created successfully
Jul 30 20:34:41 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5e1e32f2-0771-4460-9071-e8629b52370a tempest-VolumesListTestJSON-432618229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60a10e71-1671-4508-865f-b5aaad51d576) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:34:41 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5e1e32f2-0771-4460-9071-e8629b52370a tempest-VolumesListTestJSON-432618229 None] Flow 'volume_create_manager' (1310f945-4e7a-4363-85dd-a97213010250) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:34:41 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-5e1e32f2-0771-4460-9071-e8629b52370a tempest-VolumesListTestJSON-432618229 None] Created volume successfully.
Jul 30 20:34:42 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-784c38c4-3079-48c4-b9af-2fd9cf67758e tempest-CinderUnicodeTest-832608117 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:34:43 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-784c38c4-3079-48c4-b9af-2fd9cf67758e tempest-CinderUnicodeTest-832608117 None] Flow 'volume_create_manager' (05adee4c-e137-4290-9bf7-2ae8bc322d71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:34:43 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-784c38c4-3079-48c4-b9af-2fd9cf67758e tempest-CinderUnicodeTest-832608117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df2f29d8-79df-491d-b30e-3d58147b7958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:34:43 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-784c38c4-3079-48c4-b9af-2fd9cf67758e tempest-CinderUnicodeTest-832608117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df2f29d8-79df-491d-b30e-3d58147b7958) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:34:42Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=177c3b75-1797-4e16-a141-f87950f57afd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='842e84edf852433681c51790e9312bf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:34:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:34:43Z,use_quota=True,user_id='319671c31f5543998e69a9620899623e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:34:43 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-784c38c4-3079-48c4-b9af-2fd9cf67758e tempest-CinderUnicodeTest-832608117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecfb86fc-d4f8-4cfc-8c4b-1b2606cf24ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:34:43 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-784c38c4-3079-48c4-b9af-2fd9cf67758e tempest-CinderUnicodeTest-832608117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecfb86fc-d4f8-4cfc-8c4b-1b2606cf24ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:34:43 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-784c38c4-3079-48c4-b9af-2fd9cf67758e tempest-CinderUnicodeTest-832608117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (689e9804-3e32-4623-b37b-942fd1ddd9c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:34:43 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-784c38c4-3079-48c4-b9af-2fd9cf67758e tempest-CinderUnicodeTest-832608117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (689e9804-3e32-4623-b37b-942fd1ddd9c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '177c3b75-1797-4e16-a141-f87950f57afd', 'volume_name': 'volume-177c3b75-1797-4e16-a141-f87950f57afd', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:34:43 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-784c38c4-3079-48c4-b9af-2fd9cf67758e tempest-CinderUnicodeTest-832608117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dea842ab-23b0-41e6-b8be-3b57fe8aacf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:34:43 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-784c38c4-3079-48c4-b9af-2fd9cf67758e tempest-CinderUnicodeTest-832608117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dea842ab-23b0-41e6-b8be-3b57fe8aacf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:34:43 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-784c38c4-3079-48c4-b9af-2fd9cf67758e tempest-CinderUnicodeTest-832608117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d29713dc-6b8f-4294-823b-69a8ea61050c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:34:43 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-784c38c4-3079-48c4-b9af-2fd9cf67758e tempest-CinderUnicodeTest-832608117 None] Volume 177c3b75-1797-4e16-a141-f87950f57afd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-177c3b75-1797-4e16-a141-f87950f57afd', 'volume_size': 1}
Jul 30 20:34:43 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-784c38c4-3079-48c4-b9af-2fd9cf67758e tempest-CinderUnicodeTest-832608117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:34:43 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-784c38c4-3079-48c4-b9af-2fd9cf67758e tempest-CinderUnicodeTest-832608117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.010s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:34:43 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-784c38c4-3079-48c4-b9af-2fd9cf67758e tempest-CinderUnicodeTest-832608117 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:34:42Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=177c3b75-1797-4e16-a141-f87950f57afd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='842e84edf852433681c51790e9312bf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:34:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:34:43Z,use_quota=True,user_id='319671c31f5543998e69a9620899623e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:34:43 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-784c38c4-3079-48c4-b9af-2fd9cf67758e tempest-CinderUnicodeTest-832608117 None] Creating volume 177c3b75-1797-4e16-a141-f87950f57afd {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:34:43 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-784c38c4-3079-48c4-b9af-2fd9cf67758e tempest-CinderUnicodeTest-832608117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:34:43 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-784c38c4-3079-48c4-b9af-2fd9cf67758e tempest-CinderUnicodeTest-832608117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:34:43 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-784c38c4-3079-48c4-b9af-2fd9cf67758e tempest-CinderUnicodeTest-832608117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:34:43 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-784c38c4-3079-48c4-b9af-2fd9cf67758e tempest-CinderUnicodeTest-832608117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:34:43 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-784c38c4-3079-48c4-b9af-2fd9cf67758e tempest-CinderUnicodeTest-832608117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:34:43 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-784c38c4-3079-48c4-b9af-2fd9cf67758e tempest-CinderUnicodeTest-832608117 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:34:43 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-784c38c4-3079-48c4-b9af-2fd9cf67758e tempest-CinderUnicodeTest-832608117 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:34:43 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-784c38c4-3079-48c4-b9af-2fd9cf67758e tempest-CinderUnicodeTest-832608117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-177c3b75-1797-4e16-a141-f87950f57afd 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:34:43 devstack sudo[102521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-177c3b75-1797-4e16-a141-f87950f57afd 1073741824
Jul 30 20:34:43 devstack sudo[102521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:34:43 devstack sudo[102521]: pam_unix(sudo:session): session closed for user root
Jul 30 20:34:43 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-784c38c4-3079-48c4-b9af-2fd9cf67758e tempest-CinderUnicodeTest-832608117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-177c3b75-1797-4e16-a141-f87950f57afd 1073741824" returned: 0 in 0.670s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:34:43 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-784c38c4-3079-48c4-b9af-2fd9cf67758e tempest-CinderUnicodeTest-832608117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-177c3b75-1797-4e16-a141-f87950f57afd {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:34:43 devstack sudo[102528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-177c3b75-1797-4e16-a141-f87950f57afd
Jul 30 20:34:43 devstack sudo[102528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:34:44 devstack sudo[102528]: pam_unix(sudo:session): session closed for user root
Jul 30 20:34:44 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-784c38c4-3079-48c4-b9af-2fd9cf67758e tempest-CinderUnicodeTest-832608117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-177c3b75-1797-4e16-a141-f87950f57afd" returned: 0 in 0.453s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:34:44 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-784c38c4-3079-48c4-b9af-2fd9cf67758e tempest-CinderUnicodeTest-832608117 None] <== create_volume: return (1190ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:34:44 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-784c38c4-3079-48c4-b9af-2fd9cf67758e tempest-CinderUnicodeTest-832608117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.194s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:34:44 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-784c38c4-3079-48c4-b9af-2fd9cf67758e tempest-CinderUnicodeTest-832608117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d29713dc-6b8f-4294-823b-69a8ea61050c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-177c3b75-1797-4e16-a141-f87950f57afd', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:34:44 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-784c38c4-3079-48c4-b9af-2fd9cf67758e tempest-CinderUnicodeTest-832608117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a0ae529-07f0-411c-8b4e-22649f72a9f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:34:44 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-784c38c4-3079-48c4-b9af-2fd9cf67758e tempest-CinderUnicodeTest-832608117 None] Volume volume-177c3b75-1797-4e16-a141-f87950f57afd (177c3b75-1797-4e16-a141-f87950f57afd): created successfully
Jul 30 20:34:44 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-784c38c4-3079-48c4-b9af-2fd9cf67758e tempest-CinderUnicodeTest-832608117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a0ae529-07f0-411c-8b4e-22649f72a9f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:34:44 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-784c38c4-3079-48c4-b9af-2fd9cf67758e tempest-CinderUnicodeTest-832608117 None] Flow 'volume_create_manager' (05adee4c-e137-4290-9bf7-2ae8bc322d71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:34:44 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-784c38c4-3079-48c4-b9af-2fd9cf67758e tempest-CinderUnicodeTest-832608117 None] Created volume successfully.
Jul 30 20:34:45 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-12f808d6-a79d-4755-b6c2-3c266164511f tempest-VolumesListTestJSON-432618229 None] Acquiring lock "cinder-82b94672-c671-4276-9844-4029b0670f29-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:34:45 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-12f808d6-a79d-4755-b6c2-3c266164511f tempest-VolumesListTestJSON-432618229 None] Lock "cinder-82b94672-c671-4276-9844-4029b0670f29-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:34:45 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-12f808d6-a79d-4755-b6c2-3c266164511f tempest-VolumesListTestJSON-432618229 None] Acquiring lock "cinder-quobyte-82b94672-c671-4276-9844-4029b0670f29" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:34:45 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-12f808d6-a79d-4755-b6c2-3c266164511f tempest-VolumesListTestJSON-432618229 None] Lock "cinder-quobyte-82b94672-c671-4276-9844-4029b0670f29" acquired by "delete_volume" :: waited 0.029s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:34:45 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[daf59140-439e-4ed3-ae53-ae72f7db8d29]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:34:45 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-12f808d6-a79d-4755-b6c2-3c266164511f tempest-VolumesListTestJSON-432618229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-82b94672-c671-4276-9844-4029b0670f29 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:34:45 devstack sudo[102532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-82b94672-c671-4276-9844-4029b0670f29
Jul 30 20:34:45 devstack sudo[102532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:34:45 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e873d45-8a8d-4dac-9fd9-709bf4fde519 tempest-CinderUnicodeTest-832608117 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:34:45 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2e873d45-8a8d-4dac-9fd9-709bf4fde519 tempest-CinderUnicodeTest-832608117 None] Flow 'volume_create_manager' (f0dae3ff-2c9c-40db-a14b-0040e1c149a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:34:45 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2e873d45-8a8d-4dac-9fd9-709bf4fde519 tempest-CinderUnicodeTest-832608117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abf30809-2ff6-483d-be62-578154ebde26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:34:45 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2e873d45-8a8d-4dac-9fd9-709bf4fde519 tempest-CinderUnicodeTest-832608117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abf30809-2ff6-483d-be62-578154ebde26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:34:45Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-842668098',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=409f368c-1529-4817-8561-bdce256ecad8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='842e84edf852433681c51790e9312bf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:34:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:34:46Z,use_quota=True,user_id='319671c31f5543998e69a9620899623e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:34:45 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2e873d45-8a8d-4dac-9fd9-709bf4fde519 tempest-CinderUnicodeTest-832608117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54211cd6-01f9-42c7-a9a6-4c450373007f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:34:45 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2e873d45-8a8d-4dac-9fd9-709bf4fde519 tempest-CinderUnicodeTest-832608117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54211cd6-01f9-42c7-a9a6-4c450373007f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:34:45 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2e873d45-8a8d-4dac-9fd9-709bf4fde519 tempest-CinderUnicodeTest-832608117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (523eb252-8efb-4c9e-842f-79e26eb98a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:34:45 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2e873d45-8a8d-4dac-9fd9-709bf4fde519 tempest-CinderUnicodeTest-832608117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (523eb252-8efb-4c9e-842f-79e26eb98a6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '409f368c-1529-4817-8561-bdce256ecad8', 'volume_name': 'volume-409f368c-1529-4817-8561-bdce256ecad8', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:34:45 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2e873d45-8a8d-4dac-9fd9-709bf4fde519 tempest-CinderUnicodeTest-832608117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acd39ea2-a354-489e-859f-b36706ca3735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:34:45 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2e873d45-8a8d-4dac-9fd9-709bf4fde519 tempest-CinderUnicodeTest-832608117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acd39ea2-a354-489e-859f-b36706ca3735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:34:45 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2e873d45-8a8d-4dac-9fd9-709bf4fde519 tempest-CinderUnicodeTest-832608117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb242435-48bc-4f2e-97fd-5bf162cb9a28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:34:45 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-2e873d45-8a8d-4dac-9fd9-709bf4fde519 tempest-CinderUnicodeTest-832608117 None] Volume 409f368c-1529-4817-8561-bdce256ecad8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-409f368c-1529-4817-8561-bdce256ecad8', 'volume_size': 1}
Jul 30 20:34:45 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-2e873d45-8a8d-4dac-9fd9-709bf4fde519 tempest-CinderUnicodeTest-832608117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:34:45 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-2e873d45-8a8d-4dac-9fd9-709bf4fde519 tempest-CinderUnicodeTest-832608117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:34:45 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-2e873d45-8a8d-4dac-9fd9-709bf4fde519 tempest-CinderUnicodeTest-832608117 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:34:45Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-842668098',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=409f368c-1529-4817-8561-bdce256ecad8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='842e84edf852433681c51790e9312bf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:34:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:34:46Z,use_quota=True,user_id='319671c31f5543998e69a9620899623e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:34:45 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-2e873d45-8a8d-4dac-9fd9-709bf4fde519 tempest-CinderUnicodeTest-832608117 None] Creating volume 409f368c-1529-4817-8561-bdce256ecad8 {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:34:45 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-2e873d45-8a8d-4dac-9fd9-709bf4fde519 tempest-CinderUnicodeTest-832608117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:34:45 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-2e873d45-8a8d-4dac-9fd9-709bf4fde519 tempest-CinderUnicodeTest-832608117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:34:45 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-2e873d45-8a8d-4dac-9fd9-709bf4fde519 tempest-CinderUnicodeTest-832608117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:34:45 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-2e873d45-8a8d-4dac-9fd9-709bf4fde519 tempest-CinderUnicodeTest-832608117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:34:45 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-2e873d45-8a8d-4dac-9fd9-709bf4fde519 tempest-CinderUnicodeTest-832608117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:34:45 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-2e873d45-8a8d-4dac-9fd9-709bf4fde519 tempest-CinderUnicodeTest-832608117 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:34:45 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-2e873d45-8a8d-4dac-9fd9-709bf4fde519 tempest-CinderUnicodeTest-832608117 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:34:45 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2e873d45-8a8d-4dac-9fd9-709bf4fde519 tempest-CinderUnicodeTest-832608117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-409f368c-1529-4817-8561-bdce256ecad8 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:34:45 devstack sudo[102532]: pam_unix(sudo:session): session closed for user root
Jul 30 20:34:45 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-12f808d6-a79d-4755-b6c2-3c266164511f tempest-VolumesListTestJSON-432618229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-82b94672-c671-4276-9844-4029b0670f29" returned: 0 in 0.485s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:34:45 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-12f808d6-a79d-4755-b6c2-3c266164511f tempest-VolumesListTestJSON-432618229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-82b94672-c671-4276-9844-4029b0670f29 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:34:45 devstack sudo[102537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-409f368c-1529-4817-8561-bdce256ecad8 1073741824
Jul 30 20:34:45 devstack sudo[102537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:34:45 devstack sudo[102538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-82b94672-c671-4276-9844-4029b0670f29
Jul 30 20:34:45 devstack sudo[102538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:34:46 devstack sudo[102538]: pam_unix(sudo:session): session closed for user root
Jul 30 20:34:46 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-12f808d6-a79d-4755-b6c2-3c266164511f tempest-VolumesListTestJSON-432618229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-82b94672-c671-4276-9844-4029b0670f29" returned: 0 in 0.303s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:34:46 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-12f808d6-a79d-4755-b6c2-3c266164511f tempest-VolumesListTestJSON-432618229 None] Lock "cinder-quobyte-82b94672-c671-4276-9844-4029b0670f29" released by "delete_volume" :: held 0.846s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:34:46 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-12f808d6-a79d-4755-b6c2-3c266164511f tempest-VolumesListTestJSON-432618229 None] Created reservations ['f9c759cb-7a87-40d8-bb08-fd28007fb448', '6050e9a5-5ccf-4f73-8558-05fbc0a079eb', '1d0aa84b-31aa-4192-a4da-2e468e5da698', '6030fb0f-dc64-4043-834c-3c525f54c4f8'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:34:46 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-12f808d6-a79d-4755-b6c2-3c266164511f tempest-VolumesListTestJSON-432618229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:34:46 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-12f808d6-a79d-4755-b6c2-3c266164511f tempest-VolumesListTestJSON-432618229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:34:46 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-12f808d6-a79d-4755-b6c2-3c266164511f tempest-VolumesListTestJSON-432618229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:34:46 devstack sudo[102537]: pam_unix(sudo:session): session closed for user root
Jul 30 20:34:46 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-12f808d6-a79d-4755-b6c2-3c266164511f tempest-VolumesListTestJSON-432618229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:34:46 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-12f808d6-a79d-4755-b6c2-3c266164511f tempest-VolumesListTestJSON-432618229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:34:46 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-12f808d6-a79d-4755-b6c2-3c266164511f tempest-VolumesListTestJSON-432618229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:34:46 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2e873d45-8a8d-4dac-9fd9-709bf4fde519 tempest-CinderUnicodeTest-832608117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-409f368c-1529-4817-8561-bdce256ecad8 1073741824" returned: 0 in 0.806s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:34:46 devstack sudo[102546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:34:46 devstack sudo[102546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:34:46 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2e873d45-8a8d-4dac-9fd9-709bf4fde519 tempest-CinderUnicodeTest-832608117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-409f368c-1529-4817-8561-bdce256ecad8 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:34:46 devstack sudo[102548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-409f368c-1529-4817-8561-bdce256ecad8
Jul 30 20:34:46 devstack sudo[102548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:34:46 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-39867db8-7b31-4389-9fa4-ee69176e30d1 tempest-VolumesListTestJSON-432618229 None] Acquiring lock "cinder-d4714ad5-767a-461e-bc55-2df00dc629a4-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:34:47 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-39867db8-7b31-4389-9fa4-ee69176e30d1 tempest-VolumesListTestJSON-432618229 None] Lock "cinder-d4714ad5-767a-461e-bc55-2df00dc629a4-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:34:47 devstack sudo[102546]: pam_unix(sudo:session): session closed for user root
Jul 30 20:34:47 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-12f808d6-a79d-4755-b6c2-3c266164511f tempest-VolumesListTestJSON-432618229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.395s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:34:47 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-12f808d6-a79d-4755-b6c2-3c266164511f tempest-VolumesListTestJSON-432618229 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:34:47 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-12f808d6-a79d-4755-b6c2-3c266164511f tempest-VolumesListTestJSON-432618229 None] Deleted volume successfully.
Jul 30 20:34:47 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-39867db8-7b31-4389-9fa4-ee69176e30d1 tempest-VolumesListTestJSON-432618229 None] Acquiring lock "cinder-quobyte-d4714ad5-767a-461e-bc55-2df00dc629a4" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:34:47 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-12f808d6-a79d-4755-b6c2-3c266164511f tempest-VolumesListTestJSON-432618229 None] Lock "cinder-82b94672-c671-4276-9844-4029b0670f29-delete_volume" released by "delete_volume" :: held 1.859s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:34:47 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-39867db8-7b31-4389-9fa4-ee69176e30d1 tempest-VolumesListTestJSON-432618229 None] Lock "cinder-quobyte-d4714ad5-767a-461e-bc55-2df00dc629a4" acquired by "delete_volume" :: waited 0.054s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:34:47 devstack sudo[102548]: pam_unix(sudo:session): session closed for user root
Jul 30 20:34:47 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2e873d45-8a8d-4dac-9fd9-709bf4fde519 tempest-CinderUnicodeTest-832608117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-409f368c-1529-4817-8561-bdce256ecad8" returned: 0 in 0.454s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:34:47 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-2e873d45-8a8d-4dac-9fd9-709bf4fde519 tempest-CinderUnicodeTest-832608117 None] <== create_volume: return (1326ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:34:47 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-2e873d45-8a8d-4dac-9fd9-709bf4fde519 tempest-CinderUnicodeTest-832608117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.332s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:34:47 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1c24530-0140-4e6d-adf0-a3f348293449]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:34:47 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-39867db8-7b31-4389-9fa4-ee69176e30d1 tempest-VolumesListTestJSON-432618229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d4714ad5-767a-461e-bc55-2df00dc629a4 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:34:47 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2e873d45-8a8d-4dac-9fd9-709bf4fde519 tempest-CinderUnicodeTest-832608117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb242435-48bc-4f2e-97fd-5bf162cb9a28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-409f368c-1529-4817-8561-bdce256ecad8', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:34:47 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2e873d45-8a8d-4dac-9fd9-709bf4fde519 tempest-CinderUnicodeTest-832608117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29c761f0-08a1-45c4-9ec1-074657aeb109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:34:47 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-2e873d45-8a8d-4dac-9fd9-709bf4fde519 tempest-CinderUnicodeTest-832608117 None] Volume volume-409f368c-1529-4817-8561-bdce256ecad8 (409f368c-1529-4817-8561-bdce256ecad8): created successfully
Jul 30 20:34:47 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2e873d45-8a8d-4dac-9fd9-709bf4fde519 tempest-CinderUnicodeTest-832608117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29c761f0-08a1-45c4-9ec1-074657aeb109) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:34:47 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2e873d45-8a8d-4dac-9fd9-709bf4fde519 tempest-CinderUnicodeTest-832608117 None] Flow 'volume_create_manager' (f0dae3ff-2c9c-40db-a14b-0040e1c149a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:34:47 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-2e873d45-8a8d-4dac-9fd9-709bf4fde519 tempest-CinderUnicodeTest-832608117 None] Created volume successfully.
Jul 30 20:34:47 devstack sudo[102552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d4714ad5-767a-461e-bc55-2df00dc629a4
Jul 30 20:34:47 devstack sudo[102552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:34:47 devstack sudo[102552]: pam_unix(sudo:session): session closed for user root
Jul 30 20:34:47 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-39867db8-7b31-4389-9fa4-ee69176e30d1 tempest-VolumesListTestJSON-432618229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d4714ad5-767a-461e-bc55-2df00dc629a4" returned: 0 in 0.425s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:34:47 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-39867db8-7b31-4389-9fa4-ee69176e30d1 tempest-VolumesListTestJSON-432618229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d4714ad5-767a-461e-bc55-2df00dc629a4 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:34:47 devstack sudo[102557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d4714ad5-767a-461e-bc55-2df00dc629a4
Jul 30 20:34:47 devstack sudo[102557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:34:48 devstack sudo[102557]: pam_unix(sudo:session): session closed for user root
Jul 30 20:34:48 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-39867db8-7b31-4389-9fa4-ee69176e30d1 tempest-VolumesListTestJSON-432618229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d4714ad5-767a-461e-bc55-2df00dc629a4" returned: 0 in 0.352s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:34:48 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-39867db8-7b31-4389-9fa4-ee69176e30d1 tempest-VolumesListTestJSON-432618229 None] Lock "cinder-quobyte-d4714ad5-767a-461e-bc55-2df00dc629a4" released by "delete_volume" :: held 0.853s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:34:48 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-39867db8-7b31-4389-9fa4-ee69176e30d1 tempest-VolumesListTestJSON-432618229 None] Created reservations ['d2120523-dc8f-466c-a200-4e230da4e47d', 'b37a891f-a990-4e14-8698-61aa674a4b08', '1b6a2056-26f4-429d-85ac-44f94b259807', '4b5d1673-e735-4993-bd91-f15765d718fc'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:34:48 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-39867db8-7b31-4389-9fa4-ee69176e30d1 tempest-VolumesListTestJSON-432618229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:34:48 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-39867db8-7b31-4389-9fa4-ee69176e30d1 tempest-VolumesListTestJSON-432618229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:34:48 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-39867db8-7b31-4389-9fa4-ee69176e30d1 tempest-VolumesListTestJSON-432618229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:34:48 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-39867db8-7b31-4389-9fa4-ee69176e30d1 tempest-VolumesListTestJSON-432618229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:34:48 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-39867db8-7b31-4389-9fa4-ee69176e30d1 tempest-VolumesListTestJSON-432618229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:34:48 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-39867db8-7b31-4389-9fa4-ee69176e30d1 tempest-VolumesListTestJSON-432618229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:34:48 devstack sudo[102560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:34:48 devstack sudo[102560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:34:48 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-2d214171-3029-4e54-a33a-e4d010c45c56 tempest-CinderUnicodeTest-832608117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:34:48 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-2d214171-3029-4e54-a33a-e4d010c45c56 tempest-CinderUnicodeTest-832608117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:34:48 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-2d214171-3029-4e54-a33a-e4d010c45c56 tempest-CinderUnicodeTest-832608117 None] Creating offline snapshot f8e8e119-905f-4b76-bfa9-e8402ec2f40d of volume 409f368c-1529-4817-8561-bdce256ecad8 {{(pid=88719) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 30 20:34:48 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8afb26c-c560-4c83-ad34-1bff08e378e8]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:34:48 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2d214171-3029-4e54-a33a-e4d010c45c56 tempest-CinderUnicodeTest-832608117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-409f368c-1529-4817-8561-bdce256ecad8 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:34:48 devstack sudo[102562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-409f368c-1529-4817-8561-bdce256ecad8
Jul 30 20:34:48 devstack sudo[102562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:34:48 devstack sudo[102560]: pam_unix(sudo:session): session closed for user root
Jul 30 20:34:48 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-39867db8-7b31-4389-9fa4-ee69176e30d1 tempest-VolumesListTestJSON-432618229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.403s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:34:48 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-39867db8-7b31-4389-9fa4-ee69176e30d1 tempest-VolumesListTestJSON-432618229 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:34:48 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-39867db8-7b31-4389-9fa4-ee69176e30d1 tempest-VolumesListTestJSON-432618229 None] Deleted volume successfully.
Jul 30 20:34:48 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-39867db8-7b31-4389-9fa4-ee69176e30d1 tempest-VolumesListTestJSON-432618229 None] Lock "cinder-d4714ad5-767a-461e-bc55-2df00dc629a4-delete_volume" released by "delete_volume" :: held 1.715s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:34:48 devstack sudo[102562]: pam_unix(sudo:session): session closed for user root
Jul 30 20:34:49 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2d214171-3029-4e54-a33a-e4d010c45c56 tempest-CinderUnicodeTest-832608117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-409f368c-1529-4817-8561-bdce256ecad8" returned: 0 in 0.501s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:34:49 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2d214171-3029-4e54-a33a-e4d010c45c56 tempest-CinderUnicodeTest-832608117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-409f368c-1529-4817-8561-bdce256ecad8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-409f368c-1529-4817-8561-bdce256ecad8.f8e8e119-905f-4b76-bfa9-e8402ec2f40d 1G {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:34:49 devstack sudo[102568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-409f368c-1529-4817-8561-bdce256ecad8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-409f368c-1529-4817-8561-bdce256ecad8.f8e8e119-905f-4b76-bfa9-e8402ec2f40d 1G
Jul 30 20:34:49 devstack sudo[102568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:34:49 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-62d5d389-e958-4430-b937-b9c9fd96e307 tempest-VolumesListTestJSON-432618229 None] Acquiring lock "cinder-ae5ec1b2-2d2b-4d4b-8d1b-0eaf2e9eaaee-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:34:49 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-62d5d389-e958-4430-b937-b9c9fd96e307 tempest-VolumesListTestJSON-432618229 None] Lock "cinder-ae5ec1b2-2d2b-4d4b-8d1b-0eaf2e9eaaee-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:34:49 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-62d5d389-e958-4430-b937-b9c9fd96e307 tempest-VolumesListTestJSON-432618229 None] Acquiring lock "cinder-quobyte-ae5ec1b2-2d2b-4d4b-8d1b-0eaf2e9eaaee" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:34:49 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-62d5d389-e958-4430-b937-b9c9fd96e307 tempest-VolumesListTestJSON-432618229 None] Lock "cinder-quobyte-ae5ec1b2-2d2b-4d4b-8d1b-0eaf2e9eaaee" acquired by "delete_volume" :: waited 0.020s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:34:49 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[0997625e-4d70-423f-8eb5-28732243b928]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:34:49 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-62d5d389-e958-4430-b937-b9c9fd96e307 tempest-VolumesListTestJSON-432618229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-ae5ec1b2-2d2b-4d4b-8d1b-0eaf2e9eaaee {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:34:49 devstack sudo[102568]: pam_unix(sudo:session): session closed for user root
Jul 30 20:34:49 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2d214171-3029-4e54-a33a-e4d010c45c56 tempest-CinderUnicodeTest-832608117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-409f368c-1529-4817-8561-bdce256ecad8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-409f368c-1529-4817-8561-bdce256ecad8.f8e8e119-905f-4b76-bfa9-e8402ec2f40d 1G" returned: 0 in 0.665s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:34:49 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2d214171-3029-4e54-a33a-e4d010c45c56 tempest-CinderUnicodeTest-832608117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-409f368c-1529-4817-8561-bdce256ecad8 -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-409f368c-1529-4817-8561-bdce256ecad8.f8e8e119-905f-4b76-bfa9-e8402ec2f40d {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:34:49 devstack sudo[102575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-409f368c-1529-4817-8561-bdce256ecad8 -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-409f368c-1529-4817-8561-bdce256ecad8.f8e8e119-905f-4b76-bfa9-e8402ec2f40d
Jul 30 20:34:49 devstack sudo[102575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:34:49 devstack sudo[102574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-ae5ec1b2-2d2b-4d4b-8d1b-0eaf2e9eaaee
Jul 30 20:34:49 devstack sudo[102574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:34:50 devstack sudo[102575]: pam_unix(sudo:session): session closed for user root
Jul 30 20:34:50 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2d214171-3029-4e54-a33a-e4d010c45c56 tempest-CinderUnicodeTest-832608117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-409f368c-1529-4817-8561-bdce256ecad8 -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-409f368c-1529-4817-8561-bdce256ecad8.f8e8e119-905f-4b76-bfa9-e8402ec2f40d" returned: 0 in 0.410s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:34:50 devstack cinder-volume[88719]: WARNING cinder.volume.drivers.remotefs [None req-2d214171-3029-4e54-a33a-e4d010c45c56 tempest-CinderUnicodeTest-832608117 None] /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-409f368c-1529-4817-8561-bdce256ecad8.f8e8e119-905f-4b76-bfa9-e8402ec2f40d is being set with open permissions: ugo+rw
Jul 30 20:34:50 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2d214171-3029-4e54-a33a-e4d010c45c56 tempest-CinderUnicodeTest-832608117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-409f368c-1529-4817-8561-bdce256ecad8.f8e8e119-905f-4b76-bfa9-e8402ec2f40d {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:34:50 devstack sudo[102582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-409f368c-1529-4817-8561-bdce256ecad8.f8e8e119-905f-4b76-bfa9-e8402ec2f40d
Jul 30 20:34:50 devstack sudo[102582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:34:50 devstack sudo[102574]: pam_unix(sudo:session): session closed for user root
Jul 30 20:34:50 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-62d5d389-e958-4430-b937-b9c9fd96e307 tempest-VolumesListTestJSON-432618229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-ae5ec1b2-2d2b-4d4b-8d1b-0eaf2e9eaaee" returned: 0 in 0.537s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:34:50 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-62d5d389-e958-4430-b937-b9c9fd96e307 tempest-VolumesListTestJSON-432618229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-ae5ec1b2-2d2b-4d4b-8d1b-0eaf2e9eaaee {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:34:50 devstack sudo[102586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-ae5ec1b2-2d2b-4d4b-8d1b-0eaf2e9eaaee
Jul 30 20:34:50 devstack sudo[102586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:34:50 devstack sudo[102582]: pam_unix(sudo:session): session closed for user root
Jul 30 20:34:50 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2d214171-3029-4e54-a33a-e4d010c45c56 tempest-CinderUnicodeTest-832608117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-409f368c-1529-4817-8561-bdce256ecad8.f8e8e119-905f-4b76-bfa9-e8402ec2f40d" returned: 0 in 0.361s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:34:50 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2d214171-3029-4e54-a33a-e4d010c45c56 tempest-CinderUnicodeTest-832608117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-409f368c-1529-4817-8561-bdce256ecad8.info {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:34:50 devstack sudo[102590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-409f368c-1529-4817-8561-bdce256ecad8.info
Jul 30 20:34:50 devstack sudo[102590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:34:50 devstack sudo[102586]: pam_unix(sudo:session): session closed for user root
Jul 30 20:34:50 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-62d5d389-e958-4430-b937-b9c9fd96e307 tempest-VolumesListTestJSON-432618229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-ae5ec1b2-2d2b-4d4b-8d1b-0eaf2e9eaaee" returned: 0 in 0.396s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:34:50 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-62d5d389-e958-4430-b937-b9c9fd96e307 tempest-VolumesListTestJSON-432618229 None] Lock "cinder-quobyte-ae5ec1b2-2d2b-4d4b-8d1b-0eaf2e9eaaee" released by "delete_volume" :: held 1.001s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:34:50 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-62d5d389-e958-4430-b937-b9c9fd96e307 tempest-VolumesListTestJSON-432618229 None] Created reservations ['80a7c535-9731-4648-96d9-e16e2822ab5e', '8d586e68-609d-4082-9a13-01d9020f1a4a', '416d80b2-0194-4d7c-947f-38a1862b3a07', 'ad5e24fd-56cd-4ebc-a6cf-e770519a845a'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:34:50 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-62d5d389-e958-4430-b937-b9c9fd96e307 tempest-VolumesListTestJSON-432618229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:34:50 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-62d5d389-e958-4430-b937-b9c9fd96e307 tempest-VolumesListTestJSON-432618229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:34:50 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-62d5d389-e958-4430-b937-b9c9fd96e307 tempest-VolumesListTestJSON-432618229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:34:50 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-62d5d389-e958-4430-b937-b9c9fd96e307 tempest-VolumesListTestJSON-432618229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:34:50 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-62d5d389-e958-4430-b937-b9c9fd96e307 tempest-VolumesListTestJSON-432618229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:34:50 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-62d5d389-e958-4430-b937-b9c9fd96e307 tempest-VolumesListTestJSON-432618229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:34:50 devstack sudo[102592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:34:50 devstack sudo[102592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:34:50 devstack sudo[102590]: pam_unix(sudo:session): session closed for user root
Jul 30 20:34:50 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2d214171-3029-4e54-a33a-e4d010c45c56 tempest-CinderUnicodeTest-832608117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-409f368c-1529-4817-8561-bdce256ecad8.info" returned: 0 in 0.458s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:34:50 devstack cinder-volume[88719]: WARNING cinder.volume.drivers.remotefs [None req-2d214171-3029-4e54-a33a-e4d010c45c56 tempest-CinderUnicodeTest-832608117 None] /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-409f368c-1529-4817-8561-bdce256ecad8.info is being set with open permissions: ugo+rw
Jul 30 20:34:50 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2d214171-3029-4e54-a33a-e4d010c45c56 tempest-CinderUnicodeTest-832608117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-409f368c-1529-4817-8561-bdce256ecad8.info {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:34:51 devstack sudo[102595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-409f368c-1529-4817-8561-bdce256ecad8.info
Jul 30 20:34:51 devstack sudo[102595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:34:51 devstack sudo[102592]: pam_unix(sudo:session): session closed for user root
Jul 30 20:34:51 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-62d5d389-e958-4430-b937-b9c9fd96e307 tempest-VolumesListTestJSON-432618229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.413s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:34:51 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-62d5d389-e958-4430-b937-b9c9fd96e307 tempest-VolumesListTestJSON-432618229 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:34:51 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-62d5d389-e958-4430-b937-b9c9fd96e307 tempest-VolumesListTestJSON-432618229 None] Deleted volume successfully.
Jul 30 20:34:51 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-62d5d389-e958-4430-b937-b9c9fd96e307 tempest-VolumesListTestJSON-432618229 None] Lock "cinder-ae5ec1b2-2d2b-4d4b-8d1b-0eaf2e9eaaee-delete_volume" released by "delete_volume" :: held 1.756s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:34:51 devstack sudo[102595]: pam_unix(sudo:session): session closed for user root
Jul 30 20:34:51 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2d214171-3029-4e54-a33a-e4d010c45c56 tempest-CinderUnicodeTest-832608117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-409f368c-1529-4817-8561-bdce256ecad8.info" returned: 0 in 0.354s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:34:51 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-2d214171-3029-4e54-a33a-e4d010c45c56 tempest-CinderUnicodeTest-832608117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.876s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:34:51 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-2d214171-3029-4e54-a33a-e4d010c45c56 tempest-CinderUnicodeTest-832608117 None] Create snapshot completed successfully
Jul 30 20:34:51 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-3a7b00ff-c0f4-4a97-8997-f2580aa68ab9 tempest-CinderUnicodeTest-832608117 None] Acquiring lock "cinder-f8e8e119-905f-4b76-bfa9-e8402ec2f40d-delete_snapshot" by "delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:34:51 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-3a7b00ff-c0f4-4a97-8997-f2580aa68ab9 tempest-CinderUnicodeTest-832608117 None] Lock "cinder-f8e8e119-905f-4b76-bfa9-e8402ec2f40d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:34:51 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-3a7b00ff-c0f4-4a97-8997-f2580aa68ab9 tempest-CinderUnicodeTest-832608117 None] Acquiring lock "cinder-quobyte-409f368c-1529-4817-8561-bdce256ecad8" by "delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:34:51 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-3a7b00ff-c0f4-4a97-8997-f2580aa68ab9 tempest-CinderUnicodeTest-832608117 None] Lock "cinder-quobyte-409f368c-1529-4817-8561-bdce256ecad8" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:34:51 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-3a7b00ff-c0f4-4a97-8997-f2580aa68ab9 tempest-CinderUnicodeTest-832608117 None] Acquiring lock "cinder-quobyte-f8e8e119-905f-4b76-bfa9-e8402ec2f40d" by "_delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:34:51 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-3a7b00ff-c0f4-4a97-8997-f2580aa68ab9 tempest-CinderUnicodeTest-832608117 None] Lock "cinder-quobyte-f8e8e119-905f-4b76-bfa9-e8402ec2f40d" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:34:51 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-3a7b00ff-c0f4-4a97-8997-f2580aa68ab9 tempest-CinderUnicodeTest-832608117 None] Deleting offline snapshot f8e8e119-905f-4b76-bfa9-e8402ec2f40d of volume 409f368c-1529-4817-8561-bdce256ecad8 {{(pid=88719) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 30 20:34:51 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-3a7b00ff-c0f4-4a97-8997-f2580aa68ab9 tempest-CinderUnicodeTest-832608117 None] snapshot_file for this snap is: volume-409f368c-1529-4817-8561-bdce256ecad8.f8e8e119-905f-4b76-bfa9-e8402ec2f40d {{(pid=88719) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 30 20:34:51 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aad1fdd-0c07-4b0c-a043-7026cc8ebd9a]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:34:51 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3a7b00ff-c0f4-4a97-8997-f2580aa68ab9 tempest-CinderUnicodeTest-832608117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-409f368c-1529-4817-8561-bdce256ecad8.f8e8e119-905f-4b76-bfa9-e8402ec2f40d {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:34:52 devstack sudo[102599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-409f368c-1529-4817-8561-bdce256ecad8.f8e8e119-905f-4b76-bfa9-e8402ec2f40d
Jul 30 20:34:52 devstack sudo[102599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:34:52 devstack sudo[102599]: pam_unix(sudo:session): session closed for user root
Jul 30 20:34:52 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3a7b00ff-c0f4-4a97-8997-f2580aa68ab9 tempest-CinderUnicodeTest-832608117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-409f368c-1529-4817-8561-bdce256ecad8.f8e8e119-905f-4b76-bfa9-e8402ec2f40d" returned: 0 in 0.589s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:34:52 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-3a7b00ff-c0f4-4a97-8997-f2580aa68ab9 tempest-CinderUnicodeTest-832608117 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-409f368c-1529-4817-8561-bdce256ecad8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88719) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 30 20:34:52 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[8593a2c7-84a6-4a62-acfa-d1738f821991]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:34:52 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3a7b00ff-c0f4-4a97-8997-f2580aa68ab9 tempest-CinderUnicodeTest-832608117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-409f368c-1529-4817-8561-bdce256ecad8 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:34:52 devstack sudo[102604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-409f368c-1529-4817-8561-bdce256ecad8
Jul 30 20:34:52 devstack sudo[102604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:34:53 devstack sudo[102604]: pam_unix(sudo:session): session closed for user root
Jul 30 20:34:53 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3a7b00ff-c0f4-4a97-8997-f2580aa68ab9 tempest-CinderUnicodeTest-832608117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-409f368c-1529-4817-8561-bdce256ecad8" returned: 0 in 0.525s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:34:53 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3a7b00ff-c0f4-4a97-8997-f2580aa68ab9 tempest-CinderUnicodeTest-832608117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-409f368c-1529-4817-8561-bdce256ecad8.f8e8e119-905f-4b76-bfa9-e8402ec2f40d {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:34:53 devstack sudo[102609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-409f368c-1529-4817-8561-bdce256ecad8.f8e8e119-905f-4b76-bfa9-e8402ec2f40d
Jul 30 20:34:53 devstack sudo[102609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:34:53 devstack sudo[102609]: pam_unix(sudo:session): session closed for user root
Jul 30 20:34:53 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3a7b00ff-c0f4-4a97-8997-f2580aa68ab9 tempest-CinderUnicodeTest-832608117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-409f368c-1529-4817-8561-bdce256ecad8.f8e8e119-905f-4b76-bfa9-e8402ec2f40d" returned: 0 in 0.589s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:34:53 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3a7b00ff-c0f4-4a97-8997-f2580aa68ab9 tempest-CinderUnicodeTest-832608117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-409f368c-1529-4817-8561-bdce256ecad8.f8e8e119-905f-4b76-bfa9-e8402ec2f40d {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:34:53 devstack sudo[102615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-409f368c-1529-4817-8561-bdce256ecad8.f8e8e119-905f-4b76-bfa9-e8402ec2f40d
Jul 30 20:34:53 devstack sudo[102615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:34:54 devstack sudo[102615]: pam_unix(sudo:session): session closed for user root
Jul 30 20:34:54 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3a7b00ff-c0f4-4a97-8997-f2580aa68ab9 tempest-CinderUnicodeTest-832608117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-409f368c-1529-4817-8561-bdce256ecad8.f8e8e119-905f-4b76-bfa9-e8402ec2f40d" returned: 0 in 0.398s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:34:54 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-3a7b00ff-c0f4-4a97-8997-f2580aa68ab9 tempest-CinderUnicodeTest-832608117 None] Lock "cinder-quobyte-f8e8e119-905f-4b76-bfa9-e8402ec2f40d" released by "_delete_snapshot" :: held 2.278s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:34:54 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-3a7b00ff-c0f4-4a97-8997-f2580aa68ab9 tempest-CinderUnicodeTest-832608117 None] Lock "cinder-quobyte-409f368c-1529-4817-8561-bdce256ecad8" released by "delete_snapshot" :: held 2.331s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:34:54 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-3a7b00ff-c0f4-4a97-8997-f2580aa68ab9 tempest-CinderUnicodeTest-832608117 None] Created reservations ['cdf3c9e5-3ce3-4e8b-a0b4-1a36dbaa828a', 'e8d7a142-aac2-4eb4-b72b-31244ece836b', 'cfb668cf-5b3d-49b3-b955-a6662c1887a8', '96a64d04-f70c-4285-af1c-f6a62bea23d1'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:34:54 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-3a7b00ff-c0f4-4a97-8997-f2580aa68ab9 tempest-CinderUnicodeTest-832608117 None] Delete snapshot completed successfully.
Jul 30 20:34:54 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-3a7b00ff-c0f4-4a97-8997-f2580aa68ab9 tempest-CinderUnicodeTest-832608117 None] Lock "cinder-f8e8e119-905f-4b76-bfa9-e8402ec2f40d-delete_snapshot" released by "delete_snapshot" :: held 2.662s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:34:55 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-8403f4fa-4c92-4cb8-88b7-f1f93a9aedfa tempest-CinderUnicodeTest-832608117 None] Acquiring lock "cinder-409f368c-1529-4817-8561-bdce256ecad8-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:34:55 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-8403f4fa-4c92-4cb8-88b7-f1f93a9aedfa tempest-CinderUnicodeTest-832608117 None] Lock "cinder-409f368c-1529-4817-8561-bdce256ecad8-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:34:55 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-8403f4fa-4c92-4cb8-88b7-f1f93a9aedfa tempest-CinderUnicodeTest-832608117 None] Acquiring lock "cinder-quobyte-409f368c-1529-4817-8561-bdce256ecad8" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:34:55 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-8403f4fa-4c92-4cb8-88b7-f1f93a9aedfa tempest-CinderUnicodeTest-832608117 None] Lock "cinder-quobyte-409f368c-1529-4817-8561-bdce256ecad8" acquired by "delete_volume" :: waited 0.018s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:34:55 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[042c0a3e-cee9-4b30-b660-578b20b88342]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:34:55 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8403f4fa-4c92-4cb8-88b7-f1f93a9aedfa tempest-CinderUnicodeTest-832608117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-409f368c-1529-4817-8561-bdce256ecad8 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:34:55 devstack sudo[102621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-409f368c-1529-4817-8561-bdce256ecad8
Jul 30 20:34:55 devstack sudo[102621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:34:55 devstack sudo[102621]: pam_unix(sudo:session): session closed for user root
Jul 30 20:34:55 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8403f4fa-4c92-4cb8-88b7-f1f93a9aedfa tempest-CinderUnicodeTest-832608117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-409f368c-1529-4817-8561-bdce256ecad8" returned: 0 in 0.549s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:34:55 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8403f4fa-4c92-4cb8-88b7-f1f93a9aedfa tempest-CinderUnicodeTest-832608117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-409f368c-1529-4817-8561-bdce256ecad8 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:34:55 devstack sudo[102626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-409f368c-1529-4817-8561-bdce256ecad8
Jul 30 20:34:55 devstack sudo[102626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:34:56 devstack sudo[102626]: pam_unix(sudo:session): session closed for user root
Jul 30 20:34:56 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8403f4fa-4c92-4cb8-88b7-f1f93a9aedfa tempest-CinderUnicodeTest-832608117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-409f368c-1529-4817-8561-bdce256ecad8" returned: 0 in 0.360s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:34:56 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-8403f4fa-4c92-4cb8-88b7-f1f93a9aedfa tempest-CinderUnicodeTest-832608117 None] Lock "cinder-quobyte-409f368c-1529-4817-8561-bdce256ecad8" released by "delete_volume" :: held 0.987s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:34:56 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-8403f4fa-4c92-4cb8-88b7-f1f93a9aedfa tempest-CinderUnicodeTest-832608117 None] Created reservations ['c08b0146-3eb0-41c2-8468-5bd988b470ab', 'c77dbdf1-7938-42d2-98dd-0e4db0b36e0b', '1b328c10-d839-47d1-82b7-ca5f76127408', '13d01fbd-7db5-4fdd-90ac-e72a9bc648cd'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:34:56 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-8403f4fa-4c92-4cb8-88b7-f1f93a9aedfa tempest-CinderUnicodeTest-832608117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:34:56 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-8403f4fa-4c92-4cb8-88b7-f1f93a9aedfa tempest-CinderUnicodeTest-832608117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:34:56 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-8403f4fa-4c92-4cb8-88b7-f1f93a9aedfa tempest-CinderUnicodeTest-832608117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:34:56 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-8403f4fa-4c92-4cb8-88b7-f1f93a9aedfa tempest-CinderUnicodeTest-832608117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:34:56 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-8403f4fa-4c92-4cb8-88b7-f1f93a9aedfa tempest-CinderUnicodeTest-832608117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:34:56 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8403f4fa-4c92-4cb8-88b7-f1f93a9aedfa tempest-CinderUnicodeTest-832608117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:34:56 devstack sudo[102629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:34:56 devstack sudo[102629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:34:56 devstack sudo[102629]: pam_unix(sudo:session): session closed for user root
Jul 30 20:34:56 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8403f4fa-4c92-4cb8-88b7-f1f93a9aedfa tempest-CinderUnicodeTest-832608117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.301s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:34:56 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-8403f4fa-4c92-4cb8-88b7-f1f93a9aedfa tempest-CinderUnicodeTest-832608117 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:34:56 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-8403f4fa-4c92-4cb8-88b7-f1f93a9aedfa tempest-CinderUnicodeTest-832608117 None] Deleted volume successfully.
Jul 30 20:34:56 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-8403f4fa-4c92-4cb8-88b7-f1f93a9aedfa tempest-CinderUnicodeTest-832608117 None] Lock "cinder-409f368c-1529-4817-8561-bdce256ecad8-delete_volume" released by "delete_volume" :: held 1.577s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:34:57 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-2bd91e1d-bd4e-4a8e-a342-42211452def5 tempest-CinderUnicodeTest-832608117 None] Acquiring lock "cinder-177c3b75-1797-4e16-a141-f87950f57afd-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:34:57 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-2bd91e1d-bd4e-4a8e-a342-42211452def5 tempest-CinderUnicodeTest-832608117 None] Lock "cinder-177c3b75-1797-4e16-a141-f87950f57afd-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:34:57 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-2bd91e1d-bd4e-4a8e-a342-42211452def5 tempest-CinderUnicodeTest-832608117 None] Acquiring lock "cinder-quobyte-177c3b75-1797-4e16-a141-f87950f57afd" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:34:57 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-2bd91e1d-bd4e-4a8e-a342-42211452def5 tempest-CinderUnicodeTest-832608117 None] Lock "cinder-quobyte-177c3b75-1797-4e16-a141-f87950f57afd" acquired by "delete_volume" :: waited 0.029s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:34:57 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[d21d3373-66eb-428d-b55b-87f1abfab62b]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:34:57 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2bd91e1d-bd4e-4a8e-a342-42211452def5 tempest-CinderUnicodeTest-832608117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-177c3b75-1797-4e16-a141-f87950f57afd {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:34:57 devstack sudo[102632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-177c3b75-1797-4e16-a141-f87950f57afd
Jul 30 20:34:57 devstack sudo[102632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:34:57 devstack sudo[102632]: pam_unix(sudo:session): session closed for user root
Jul 30 20:34:57 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2bd91e1d-bd4e-4a8e-a342-42211452def5 tempest-CinderUnicodeTest-832608117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-177c3b75-1797-4e16-a141-f87950f57afd" returned: 0 in 0.460s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:34:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2bd91e1d-bd4e-4a8e-a342-42211452def5 tempest-CinderUnicodeTest-832608117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-177c3b75-1797-4e16-a141-f87950f57afd {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:34:58 devstack sudo[102638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-177c3b75-1797-4e16-a141-f87950f57afd
Jul 30 20:34:58 devstack sudo[102638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:34:58 devstack sudo[102638]: pam_unix(sudo:session): session closed for user root
Jul 30 20:34:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2bd91e1d-bd4e-4a8e-a342-42211452def5 tempest-CinderUnicodeTest-832608117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-177c3b75-1797-4e16-a141-f87950f57afd" returned: 0 in 0.275s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:34:58 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-2bd91e1d-bd4e-4a8e-a342-42211452def5 tempest-CinderUnicodeTest-832608117 None] Lock "cinder-quobyte-177c3b75-1797-4e16-a141-f87950f57afd" released by "delete_volume" :: held 0.793s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:34:58 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-2bd91e1d-bd4e-4a8e-a342-42211452def5 tempest-CinderUnicodeTest-832608117 None] Created reservations ['9d0f336c-7a93-4a3c-ac10-28f25d3ad6de', 'cda7aca6-128c-43ed-a32f-62a1b13d7c12', '51dd8396-16ab-4e4a-b551-3f1679eb3b81', '8042d0aa-eb6d-4709-a3df-ed396f0bfec5'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:34:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-2bd91e1d-bd4e-4a8e-a342-42211452def5 tempest-CinderUnicodeTest-832608117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:34:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-2bd91e1d-bd4e-4a8e-a342-42211452def5 tempest-CinderUnicodeTest-832608117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:34:58 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-2bd91e1d-bd4e-4a8e-a342-42211452def5 tempest-CinderUnicodeTest-832608117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:34:58 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-2bd91e1d-bd4e-4a8e-a342-42211452def5 tempest-CinderUnicodeTest-832608117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:34:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-2bd91e1d-bd4e-4a8e-a342-42211452def5 tempest-CinderUnicodeTest-832608117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:34:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2bd91e1d-bd4e-4a8e-a342-42211452def5 tempest-CinderUnicodeTest-832608117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:34:58 devstack sudo[102641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:34:58 devstack sudo[102641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:34:58 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-907f946a-faf8-408c-94a0-1c7681c82e9e tempest-TestStampPattern-75201989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:34:58 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-907f946a-faf8-408c-94a0-1c7681c82e9e tempest-TestStampPattern-75201989 None] Flow 'volume_create_manager' (3959a899-e7ed-47ae-85de-e3f40b5e1643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:34:58 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-907f946a-faf8-408c-94a0-1c7681c82e9e tempest-TestStampPattern-75201989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e42d259d-f434-47cf-8177-e77f1a9d3794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:34:58 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-907f946a-faf8-408c-94a0-1c7681c82e9e tempest-TestStampPattern-75201989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e42d259d-f434-47cf-8177-e77f1a9d3794) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:34:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1247692023',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0883c285-cc2b-4727-af60-5bb30a001719,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e71b8ca9bfa4acc8482988b1de5ed83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:34:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:34:59Z,use_quota=True,user_id='854ef3b7611a42809aa153cf7f08b32e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:34:58 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-907f946a-faf8-408c-94a0-1c7681c82e9e tempest-TestStampPattern-75201989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59146dd1-8d9b-4b63-8c4b-4f6c928db48c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:34:58 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-907f946a-faf8-408c-94a0-1c7681c82e9e tempest-TestStampPattern-75201989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59146dd1-8d9b-4b63-8c4b-4f6c928db48c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:34:58 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-907f946a-faf8-408c-94a0-1c7681c82e9e tempest-TestStampPattern-75201989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c76164e9-6b10-4a0d-863c-060c7bc05aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:34:58 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-907f946a-faf8-408c-94a0-1c7681c82e9e tempest-TestStampPattern-75201989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c76164e9-6b10-4a0d-863c-060c7bc05aa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0883c285-cc2b-4727-af60-5bb30a001719', 'volume_name': 'volume-0883c285-cc2b-4727-af60-5bb30a001719', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:34:58 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-907f946a-faf8-408c-94a0-1c7681c82e9e tempest-TestStampPattern-75201989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aefd95ca-78eb-4a2c-9d09-92079d81ca6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:34:58 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-907f946a-faf8-408c-94a0-1c7681c82e9e tempest-TestStampPattern-75201989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aefd95ca-78eb-4a2c-9d09-92079d81ca6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:34:58 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-907f946a-faf8-408c-94a0-1c7681c82e9e tempest-TestStampPattern-75201989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f17c34c-b8f3-4a13-a81a-159e635aada5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:34:58 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-907f946a-faf8-408c-94a0-1c7681c82e9e tempest-TestStampPattern-75201989 None] Volume 0883c285-cc2b-4727-af60-5bb30a001719: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0883c285-cc2b-4727-af60-5bb30a001719', 'volume_size': 1}
Jul 30 20:34:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-907f946a-faf8-408c-94a0-1c7681c82e9e tempest-TestStampPattern-75201989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:34:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-907f946a-faf8-408c-94a0-1c7681c82e9e tempest-TestStampPattern-75201989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:34:58 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-907f946a-faf8-408c-94a0-1c7681c82e9e tempest-TestStampPattern-75201989 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:34:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1247692023',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0883c285-cc2b-4727-af60-5bb30a001719,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e71b8ca9bfa4acc8482988b1de5ed83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:34:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:34:59Z,use_quota=True,user_id='854ef3b7611a42809aa153cf7f08b32e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:34:58 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-907f946a-faf8-408c-94a0-1c7681c82e9e tempest-TestStampPattern-75201989 None] Creating volume 0883c285-cc2b-4727-af60-5bb30a001719 {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:34:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-907f946a-faf8-408c-94a0-1c7681c82e9e tempest-TestStampPattern-75201989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:34:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-907f946a-faf8-408c-94a0-1c7681c82e9e tempest-TestStampPattern-75201989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:34:58 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-907f946a-faf8-408c-94a0-1c7681c82e9e tempest-TestStampPattern-75201989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:34:58 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-907f946a-faf8-408c-94a0-1c7681c82e9e tempest-TestStampPattern-75201989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:34:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-907f946a-faf8-408c-94a0-1c7681c82e9e tempest-TestStampPattern-75201989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:34:58 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-907f946a-faf8-408c-94a0-1c7681c82e9e tempest-TestStampPattern-75201989 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:34:58 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-907f946a-faf8-408c-94a0-1c7681c82e9e tempest-TestStampPattern-75201989 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:34:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-907f946a-faf8-408c-94a0-1c7681c82e9e tempest-TestStampPattern-75201989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0883c285-cc2b-4727-af60-5bb30a001719 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:34:58 devstack sudo[102641]: pam_unix(sudo:session): session closed for user root
Jul 30 20:34:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2bd91e1d-bd4e-4a8e-a342-42211452def5 tempest-CinderUnicodeTest-832608117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.350s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:34:58 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-2bd91e1d-bd4e-4a8e-a342-42211452def5 tempest-CinderUnicodeTest-832608117 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:34:58 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-2bd91e1d-bd4e-4a8e-a342-42211452def5 tempest-CinderUnicodeTest-832608117 None] Deleted volume successfully.
Jul 30 20:34:58 devstack sudo[102644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0883c285-cc2b-4727-af60-5bb30a001719 1073741824
Jul 30 20:34:58 devstack sudo[102644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:34:58 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-2bd91e1d-bd4e-4a8e-a342-42211452def5 tempest-CinderUnicodeTest-832608117 None] Lock "cinder-177c3b75-1797-4e16-a141-f87950f57afd-delete_volume" released by "delete_volume" :: held 1.434s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:34:59 devstack sudo[102644]: pam_unix(sudo:session): session closed for user root
Jul 30 20:34:59 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-907f946a-faf8-408c-94a0-1c7681c82e9e tempest-TestStampPattern-75201989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0883c285-cc2b-4727-af60-5bb30a001719 1073741824" returned: 0 in 0.713s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:34:59 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-907f946a-faf8-408c-94a0-1c7681c82e9e tempest-TestStampPattern-75201989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0883c285-cc2b-4727-af60-5bb30a001719 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:34:59 devstack sudo[102661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0883c285-cc2b-4727-af60-5bb30a001719
Jul 30 20:34:59 devstack sudo[102661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:34:59 devstack sudo[102661]: pam_unix(sudo:session): session closed for user root
Jul 30 20:34:59 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-907f946a-faf8-408c-94a0-1c7681c82e9e tempest-TestStampPattern-75201989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0883c285-cc2b-4727-af60-5bb30a001719" returned: 0 in 0.339s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:34:59 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-907f946a-faf8-408c-94a0-1c7681c82e9e tempest-TestStampPattern-75201989 None] <== create_volume: return (1121ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:34:59 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-907f946a-faf8-408c-94a0-1c7681c82e9e tempest-TestStampPattern-75201989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.124s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:34:59 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-907f946a-faf8-408c-94a0-1c7681c82e9e tempest-TestStampPattern-75201989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f17c34c-b8f3-4a13-a81a-159e635aada5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0883c285-cc2b-4727-af60-5bb30a001719', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:34:59 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-907f946a-faf8-408c-94a0-1c7681c82e9e tempest-TestStampPattern-75201989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a37524e-3d44-4849-9dee-bbf55b122370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:34:59 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-907f946a-faf8-408c-94a0-1c7681c82e9e tempest-TestStampPattern-75201989 None] Volume volume-0883c285-cc2b-4727-af60-5bb30a001719 (0883c285-cc2b-4727-af60-5bb30a001719): created successfully
Jul 30 20:34:59 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-907f946a-faf8-408c-94a0-1c7681c82e9e tempest-TestStampPattern-75201989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a37524e-3d44-4849-9dee-bbf55b122370) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:34:59 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-907f946a-faf8-408c-94a0-1c7681c82e9e tempest-TestStampPattern-75201989 None] Flow 'volume_create_manager' (3959a899-e7ed-47ae-85de-e3f40b5e1643) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:34:59 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-907f946a-faf8-408c-94a0-1c7681c82e9e tempest-TestStampPattern-75201989 None] Created volume successfully.
Jul 30 20:35:04 devstack cinder-volume[88719]: DEBUG dbcounter [-] [88719] Writing DB stats cinder:SELECT=94,cinder:UPDATE=129,cinder:DELETE=13,cinder:INSERT=43 {{(pid=88719) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 30 20:35:04 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae9cbfcd-615b-4082-a26c-bf837bdb94aa tempest-ProjectReaderTests-1678794570 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:35:04 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-ae9cbfcd-615b-4082-a26c-bf837bdb94aa tempest-ProjectReaderTests-1678794570 None] Flow 'volume_create_manager' (c21a9275-b830-4926-8542-47201ba71f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:35:04 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-ae9cbfcd-615b-4082-a26c-bf837bdb94aa tempest-ProjectReaderTests-1678794570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0b58e70-2331-4197-8f4d-10608389ba28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:35:04 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-ae9cbfcd-615b-4082-a26c-bf837bdb94aa tempest-ProjectReaderTests-1678794570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0b58e70-2331-4197-8f4d-10608389ba28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:35:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-447044577',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e1473af-a140-47a4-856b-9462c23d103e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c312b3916a84681800229f4dbad5ed8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:35:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:35:04Z,use_quota=True,user_id='1772aff9b9fd4d4bb9ce25f6b8f41b31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:35:04 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-ae9cbfcd-615b-4082-a26c-bf837bdb94aa tempest-ProjectReaderTests-1678794570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82d262da-de31-49ae-a455-d79fbe9d0c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:35:04 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-ae9cbfcd-615b-4082-a26c-bf837bdb94aa tempest-ProjectReaderTests-1678794570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82d262da-de31-49ae-a455-d79fbe9d0c1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:35:04 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-ae9cbfcd-615b-4082-a26c-bf837bdb94aa tempest-ProjectReaderTests-1678794570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7b5da5b-fb07-4d47-a6d6-bd872a44e651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:35:04 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-ae9cbfcd-615b-4082-a26c-bf837bdb94aa tempest-ProjectReaderTests-1678794570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7b5da5b-fb07-4d47-a6d6-bd872a44e651) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e1473af-a140-47a4-856b-9462c23d103e', 'volume_name': 'volume-4e1473af-a140-47a4-856b-9462c23d103e', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:35:04 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-ae9cbfcd-615b-4082-a26c-bf837bdb94aa tempest-ProjectReaderTests-1678794570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2a289b8-f50a-4c70-9150-81e5eb21d416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:35:04 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-ae9cbfcd-615b-4082-a26c-bf837bdb94aa tempest-ProjectReaderTests-1678794570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2a289b8-f50a-4c70-9150-81e5eb21d416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:35:04 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-ae9cbfcd-615b-4082-a26c-bf837bdb94aa tempest-ProjectReaderTests-1678794570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd09d217-f939-41e5-912b-e9b6529a900a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:35:04 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-ae9cbfcd-615b-4082-a26c-bf837bdb94aa tempest-ProjectReaderTests-1678794570 None] Volume 4e1473af-a140-47a4-856b-9462c23d103e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e1473af-a140-47a4-856b-9462c23d103e', 'volume_size': 1}
Jul 30 20:35:04 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-ae9cbfcd-615b-4082-a26c-bf837bdb94aa tempest-ProjectReaderTests-1678794570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:35:04 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-ae9cbfcd-615b-4082-a26c-bf837bdb94aa tempest-ProjectReaderTests-1678794570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:35:04 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-ae9cbfcd-615b-4082-a26c-bf837bdb94aa tempest-ProjectReaderTests-1678794570 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:35:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-447044577',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e1473af-a140-47a4-856b-9462c23d103e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c312b3916a84681800229f4dbad5ed8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:35:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:35:04Z,use_quota=True,user_id='1772aff9b9fd4d4bb9ce25f6b8f41b31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:35:04 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-ae9cbfcd-615b-4082-a26c-bf837bdb94aa tempest-ProjectReaderTests-1678794570 None] Creating volume 4e1473af-a140-47a4-856b-9462c23d103e {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:35:04 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-ae9cbfcd-615b-4082-a26c-bf837bdb94aa tempest-ProjectReaderTests-1678794570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:35:04 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-ae9cbfcd-615b-4082-a26c-bf837bdb94aa tempest-ProjectReaderTests-1678794570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:35:04 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-ae9cbfcd-615b-4082-a26c-bf837bdb94aa tempest-ProjectReaderTests-1678794570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:35:04 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-ae9cbfcd-615b-4082-a26c-bf837bdb94aa tempest-ProjectReaderTests-1678794570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:35:04 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-ae9cbfcd-615b-4082-a26c-bf837bdb94aa tempest-ProjectReaderTests-1678794570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:35:04 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-ae9cbfcd-615b-4082-a26c-bf837bdb94aa tempest-ProjectReaderTests-1678794570 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:35:04 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-ae9cbfcd-615b-4082-a26c-bf837bdb94aa tempest-ProjectReaderTests-1678794570 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:35:04 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-ae9cbfcd-615b-4082-a26c-bf837bdb94aa tempest-ProjectReaderTests-1678794570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-4e1473af-a140-47a4-856b-9462c23d103e 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:35:04 devstack sudo[102723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-4e1473af-a140-47a4-856b-9462c23d103e 1073741824
Jul 30 20:35:04 devstack sudo[102723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:35:04 devstack sudo[102723]: pam_unix(sudo:session): session closed for user root
Jul 30 20:35:04 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-ae9cbfcd-615b-4082-a26c-bf837bdb94aa tempest-ProjectReaderTests-1678794570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-4e1473af-a140-47a4-856b-9462c23d103e 1073741824" returned: 0 in 0.562s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:35:04 devstack cinder-volume[88719]: DEBUG dbcounter [-] [88719] Writing DB stats cinder:UPDATE=134,cinder:INSERT=36,cinder:SELECT=120,cinder:DELETE=10 {{(pid=88719) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 30 20:35:04 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-ae9cbfcd-615b-4082-a26c-bf837bdb94aa tempest-ProjectReaderTests-1678794570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-4e1473af-a140-47a4-856b-9462c23d103e {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:35:04 devstack sudo[102729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-4e1473af-a140-47a4-856b-9462c23d103e
Jul 30 20:35:04 devstack sudo[102729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:35:05 devstack sudo[102729]: pam_unix(sudo:session): session closed for user root
Jul 30 20:35:05 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-ae9cbfcd-615b-4082-a26c-bf837bdb94aa tempest-ProjectReaderTests-1678794570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-4e1473af-a140-47a4-856b-9462c23d103e" returned: 0 in 0.286s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:35:05 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-ae9cbfcd-615b-4082-a26c-bf837bdb94aa tempest-ProjectReaderTests-1678794570 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:35:05 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-ae9cbfcd-615b-4082-a26c-bf837bdb94aa tempest-ProjectReaderTests-1678794570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:35:05 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-ae9cbfcd-615b-4082-a26c-bf837bdb94aa tempest-ProjectReaderTests-1678794570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd09d217-f939-41e5-912b-e9b6529a900a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e1473af-a140-47a4-856b-9462c23d103e', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:35:05 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-ae9cbfcd-615b-4082-a26c-bf837bdb94aa tempest-ProjectReaderTests-1678794570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cc0f46f-99b3-44be-8c1d-413c76ffae5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:35:05 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-ae9cbfcd-615b-4082-a26c-bf837bdb94aa tempest-ProjectReaderTests-1678794570 None] Volume volume-4e1473af-a140-47a4-856b-9462c23d103e (4e1473af-a140-47a4-856b-9462c23d103e): created successfully
Jul 30 20:35:05 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-ae9cbfcd-615b-4082-a26c-bf837bdb94aa tempest-ProjectReaderTests-1678794570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cc0f46f-99b3-44be-8c1d-413c76ffae5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:35:05 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-ae9cbfcd-615b-4082-a26c-bf837bdb94aa tempest-ProjectReaderTests-1678794570 None] Flow 'volume_create_manager' (c21a9275-b830-4926-8542-47201ba71f46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:35:05 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-ae9cbfcd-615b-4082-a26c-bf837bdb94aa tempest-ProjectReaderTests-1678794570 None] Created volume successfully.
Jul 30 20:35:06 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-0794f3f4-74ad-4c96-814b-d8ac9ca51807 tempest-ProjectReaderTests-1678794570 None] Acquiring lock "cinder-4e1473af-a140-47a4-856b-9462c23d103e-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:35:06 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-0794f3f4-74ad-4c96-814b-d8ac9ca51807 tempest-ProjectReaderTests-1678794570 None] Lock "cinder-4e1473af-a140-47a4-856b-9462c23d103e-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:35:06 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-0794f3f4-74ad-4c96-814b-d8ac9ca51807 tempest-ProjectReaderTests-1678794570 None] Acquiring lock "cinder-quobyte-4e1473af-a140-47a4-856b-9462c23d103e" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:35:06 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-0794f3f4-74ad-4c96-814b-d8ac9ca51807 tempest-ProjectReaderTests-1678794570 None] Lock "cinder-quobyte-4e1473af-a140-47a4-856b-9462c23d103e" acquired by "delete_volume" :: waited 0.033s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:35:07 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[30b8b224-85cb-4f82-aabd-32806a1a0776]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:35:07 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-0794f3f4-74ad-4c96-814b-d8ac9ca51807 tempest-ProjectReaderTests-1678794570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-4e1473af-a140-47a4-856b-9462c23d103e {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:35:07 devstack sudo[102780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-4e1473af-a140-47a4-856b-9462c23d103e
Jul 30 20:35:07 devstack sudo[102780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:35:07 devstack sudo[102780]: pam_unix(sudo:session): session closed for user root
Jul 30 20:35:07 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-0794f3f4-74ad-4c96-814b-d8ac9ca51807 tempest-ProjectReaderTests-1678794570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-4e1473af-a140-47a4-856b-9462c23d103e" returned: 0 in 0.540s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:35:07 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-0794f3f4-74ad-4c96-814b-d8ac9ca51807 tempest-ProjectReaderTests-1678794570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-4e1473af-a140-47a4-856b-9462c23d103e {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:35:07 devstack sudo[102805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-4e1473af-a140-47a4-856b-9462c23d103e
Jul 30 20:35:07 devstack sudo[102805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:35:07 devstack sudo[102805]: pam_unix(sudo:session): session closed for user root
Jul 30 20:35:07 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-0794f3f4-74ad-4c96-814b-d8ac9ca51807 tempest-ProjectReaderTests-1678794570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-4e1473af-a140-47a4-856b-9462c23d103e" returned: 0 in 0.344s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:35:07 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-0794f3f4-74ad-4c96-814b-d8ac9ca51807 tempest-ProjectReaderTests-1678794570 None] Lock "cinder-quobyte-4e1473af-a140-47a4-856b-9462c23d103e" released by "delete_volume" :: held 1.011s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:35:08 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-0794f3f4-74ad-4c96-814b-d8ac9ca51807 tempest-ProjectReaderTests-1678794570 None] Created reservations ['35e125e3-5441-4f74-8d98-43cdd0def84d', '96a0b190-6ea3-4641-b724-4c752fe165b8', '19eae24e-e9f7-439b-bd64-bf23189448fe', 'd049f443-1242-4550-a19e-6d7927e4da27'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:35:08 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-0794f3f4-74ad-4c96-814b-d8ac9ca51807 tempest-ProjectReaderTests-1678794570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:35:08 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-0794f3f4-74ad-4c96-814b-d8ac9ca51807 tempest-ProjectReaderTests-1678794570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:35:08 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-0794f3f4-74ad-4c96-814b-d8ac9ca51807 tempest-ProjectReaderTests-1678794570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:35:08 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-0794f3f4-74ad-4c96-814b-d8ac9ca51807 tempest-ProjectReaderTests-1678794570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:35:08 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-0794f3f4-74ad-4c96-814b-d8ac9ca51807 tempest-ProjectReaderTests-1678794570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:35:08 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-0794f3f4-74ad-4c96-814b-d8ac9ca51807 tempest-ProjectReaderTests-1678794570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:35:08 devstack sudo[102831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:35:08 devstack sudo[102831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:35:08 devstack sudo[102831]: pam_unix(sudo:session): session closed for user root
Jul 30 20:35:08 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-0794f3f4-74ad-4c96-814b-d8ac9ca51807 tempest-ProjectReaderTests-1678794570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.420s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:35:08 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-0794f3f4-74ad-4c96-814b-d8ac9ca51807 tempest-ProjectReaderTests-1678794570 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:35:08 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-0794f3f4-74ad-4c96-814b-d8ac9ca51807 tempest-ProjectReaderTests-1678794570 None] Deleted volume successfully.
Jul 30 20:35:08 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-0794f3f4-74ad-4c96-814b-d8ac9ca51807 tempest-ProjectReaderTests-1678794570 None] Lock "cinder-4e1473af-a140-47a4-856b-9462c23d103e-delete_volume" released by "delete_volume" :: held 1.802s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:35:10 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d36a81f-cd25-4ec0-8897-c2428a1872c7 tempest-ProjectReaderTests-1678794570 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:35:10 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2d36a81f-cd25-4ec0-8897-c2428a1872c7 tempest-ProjectReaderTests-1678794570 None] Flow 'volume_create_manager' (6825a48f-1551-427a-9a9a-41f36c9950fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:35:10 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2d36a81f-cd25-4ec0-8897-c2428a1872c7 tempest-ProjectReaderTests-1678794570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c799e041-11fc-407f-b472-81f6adcc11f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:35:10 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2d36a81f-cd25-4ec0-8897-c2428a1872c7 tempest-ProjectReaderTests-1678794570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c799e041-11fc-407f-b472-81f6adcc11f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:35:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2005176723',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08cb8419-8c2f-4ed3-89bc-2bc968bd6132,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c312b3916a84681800229f4dbad5ed8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:35:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:35:10Z,use_quota=True,user_id='1772aff9b9fd4d4bb9ce25f6b8f41b31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:35:10 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2d36a81f-cd25-4ec0-8897-c2428a1872c7 tempest-ProjectReaderTests-1678794570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80b3ce00-ed9a-4c1a-897c-a46ee66d26d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:35:10 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2d36a81f-cd25-4ec0-8897-c2428a1872c7 tempest-ProjectReaderTests-1678794570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80b3ce00-ed9a-4c1a-897c-a46ee66d26d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:35:10 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2d36a81f-cd25-4ec0-8897-c2428a1872c7 tempest-ProjectReaderTests-1678794570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bffc8d68-4e2e-4cca-9c02-55b5c120d854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:35:10 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2d36a81f-cd25-4ec0-8897-c2428a1872c7 tempest-ProjectReaderTests-1678794570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bffc8d68-4e2e-4cca-9c02-55b5c120d854) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08cb8419-8c2f-4ed3-89bc-2bc968bd6132', 'volume_name': 'volume-08cb8419-8c2f-4ed3-89bc-2bc968bd6132', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:35:10 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2d36a81f-cd25-4ec0-8897-c2428a1872c7 tempest-ProjectReaderTests-1678794570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (615ae454-727d-4b20-9ddc-e59003f566e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:35:10 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2d36a81f-cd25-4ec0-8897-c2428a1872c7 tempest-ProjectReaderTests-1678794570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (615ae454-727d-4b20-9ddc-e59003f566e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:35:10 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2d36a81f-cd25-4ec0-8897-c2428a1872c7 tempest-ProjectReaderTests-1678794570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d4da167-6f3d-45c4-8876-bacdf785ffca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:35:10 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-2d36a81f-cd25-4ec0-8897-c2428a1872c7 tempest-ProjectReaderTests-1678794570 None] Volume 08cb8419-8c2f-4ed3-89bc-2bc968bd6132: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08cb8419-8c2f-4ed3-89bc-2bc968bd6132', 'volume_size': 1}
Jul 30 20:35:10 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-2d36a81f-cd25-4ec0-8897-c2428a1872c7 tempest-ProjectReaderTests-1678794570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:35:10 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-2d36a81f-cd25-4ec0-8897-c2428a1872c7 tempest-ProjectReaderTests-1678794570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:35:10 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-2d36a81f-cd25-4ec0-8897-c2428a1872c7 tempest-ProjectReaderTests-1678794570 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:35:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2005176723',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08cb8419-8c2f-4ed3-89bc-2bc968bd6132,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c312b3916a84681800229f4dbad5ed8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:35:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:35:10Z,use_quota=True,user_id='1772aff9b9fd4d4bb9ce25f6b8f41b31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:35:10 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-2d36a81f-cd25-4ec0-8897-c2428a1872c7 tempest-ProjectReaderTests-1678794570 None] Creating volume 08cb8419-8c2f-4ed3-89bc-2bc968bd6132 {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:35:10 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-2d36a81f-cd25-4ec0-8897-c2428a1872c7 tempest-ProjectReaderTests-1678794570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:35:10 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-2d36a81f-cd25-4ec0-8897-c2428a1872c7 tempest-ProjectReaderTests-1678794570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:35:10 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-2d36a81f-cd25-4ec0-8897-c2428a1872c7 tempest-ProjectReaderTests-1678794570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:35:10 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-2d36a81f-cd25-4ec0-8897-c2428a1872c7 tempest-ProjectReaderTests-1678794570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:35:10 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-2d36a81f-cd25-4ec0-8897-c2428a1872c7 tempest-ProjectReaderTests-1678794570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:35:10 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-2d36a81f-cd25-4ec0-8897-c2428a1872c7 tempest-ProjectReaderTests-1678794570 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:35:10 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-2d36a81f-cd25-4ec0-8897-c2428a1872c7 tempest-ProjectReaderTests-1678794570 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:35:10 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2d36a81f-cd25-4ec0-8897-c2428a1872c7 tempest-ProjectReaderTests-1678794570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-08cb8419-8c2f-4ed3-89bc-2bc968bd6132 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:35:10 devstack sudo[102838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-08cb8419-8c2f-4ed3-89bc-2bc968bd6132 1073741824
Jul 30 20:35:10 devstack sudo[102838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:35:11 devstack sudo[102838]: pam_unix(sudo:session): session closed for user root
Jul 30 20:35:11 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2d36a81f-cd25-4ec0-8897-c2428a1872c7 tempest-ProjectReaderTests-1678794570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-08cb8419-8c2f-4ed3-89bc-2bc968bd6132 1073741824" returned: 0 in 1.002s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:35:11 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2d36a81f-cd25-4ec0-8897-c2428a1872c7 tempest-ProjectReaderTests-1678794570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-08cb8419-8c2f-4ed3-89bc-2bc968bd6132 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:35:11 devstack sudo[102846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-08cb8419-8c2f-4ed3-89bc-2bc968bd6132
Jul 30 20:35:11 devstack sudo[102846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:35:11 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-b20b811a-073f-4db3-94e2-c7fde9bd4ae0 tempest-VolumesSnapshotTestJSON-153537947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:35:11 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-b20b811a-073f-4db3-94e2-c7fde9bd4ae0 tempest-VolumesSnapshotTestJSON-153537947 None] Flow 'volume_create_manager' (564395fa-e094-4b68-b848-7ef81ce60c65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:35:11 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-b20b811a-073f-4db3-94e2-c7fde9bd4ae0 tempest-VolumesSnapshotTestJSON-153537947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ece57338-d92b-4d12-923b-78ec139217dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:35:12 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-b20b811a-073f-4db3-94e2-c7fde9bd4ae0 tempest-VolumesSnapshotTestJSON-153537947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ece57338-d92b-4d12-923b-78ec139217dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:35:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1125801063',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d81db8c5-08e1-4d1a-a9c4-ab770f1c9fb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4db6b3c17c704eb591bba88684c77cbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:35:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:35:12Z,use_quota=True,user_id='de69dd69544b4eb7af712d3a4bfb8c4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:35:12 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-b20b811a-073f-4db3-94e2-c7fde9bd4ae0 tempest-VolumesSnapshotTestJSON-153537947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a05a2e9-8878-483e-911d-71242bb54e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:35:12 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-b20b811a-073f-4db3-94e2-c7fde9bd4ae0 tempest-VolumesSnapshotTestJSON-153537947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a05a2e9-8878-483e-911d-71242bb54e3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:35:12 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-b20b811a-073f-4db3-94e2-c7fde9bd4ae0 tempest-VolumesSnapshotTestJSON-153537947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edbc3436-4fcf-47a8-928d-e353b9f63986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:35:12 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-b20b811a-073f-4db3-94e2-c7fde9bd4ae0 tempest-VolumesSnapshotTestJSON-153537947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edbc3436-4fcf-47a8-928d-e353b9f63986) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd81db8c5-08e1-4d1a-a9c4-ab770f1c9fb0', 'volume_name': 'volume-d81db8c5-08e1-4d1a-a9c4-ab770f1c9fb0', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:35:12 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-b20b811a-073f-4db3-94e2-c7fde9bd4ae0 tempest-VolumesSnapshotTestJSON-153537947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69d80078-5f48-442b-adf3-649a52307ac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:35:12 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-b20b811a-073f-4db3-94e2-c7fde9bd4ae0 tempest-VolumesSnapshotTestJSON-153537947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69d80078-5f48-442b-adf3-649a52307ac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:35:12 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-b20b811a-073f-4db3-94e2-c7fde9bd4ae0 tempest-VolumesSnapshotTestJSON-153537947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1d038db-037d-468e-bd75-860ed433567e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:35:12 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-b20b811a-073f-4db3-94e2-c7fde9bd4ae0 tempest-VolumesSnapshotTestJSON-153537947 None] Volume d81db8c5-08e1-4d1a-a9c4-ab770f1c9fb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d81db8c5-08e1-4d1a-a9c4-ab770f1c9fb0', 'volume_size': 1}
Jul 30 20:35:12 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-b20b811a-073f-4db3-94e2-c7fde9bd4ae0 tempest-VolumesSnapshotTestJSON-153537947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:35:12 devstack sudo[102846]: pam_unix(sudo:session): session closed for user root
Jul 30 20:35:12 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2d36a81f-cd25-4ec0-8897-c2428a1872c7 tempest-ProjectReaderTests-1678794570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-08cb8419-8c2f-4ed3-89bc-2bc968bd6132" returned: 0 in 0.689s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:35:12 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-2d36a81f-cd25-4ec0-8897-c2428a1872c7 tempest-ProjectReaderTests-1678794570 None] <== create_volume: return (1792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:35:12 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-2d36a81f-cd25-4ec0-8897-c2428a1872c7 tempest-ProjectReaderTests-1678794570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.801s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:35:12 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-b20b811a-073f-4db3-94e2-c7fde9bd4ae0 tempest-VolumesSnapshotTestJSON-153537947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.019s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:35:12 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-b20b811a-073f-4db3-94e2-c7fde9bd4ae0 tempest-VolumesSnapshotTestJSON-153537947 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:35:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1125801063',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d81db8c5-08e1-4d1a-a9c4-ab770f1c9fb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4db6b3c17c704eb591bba88684c77cbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:35:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:35:12Z,use_quota=True,user_id='de69dd69544b4eb7af712d3a4bfb8c4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:35:12 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-b20b811a-073f-4db3-94e2-c7fde9bd4ae0 tempest-VolumesSnapshotTestJSON-153537947 None] Creating volume d81db8c5-08e1-4d1a-a9c4-ab770f1c9fb0 {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:35:12 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-b20b811a-073f-4db3-94e2-c7fde9bd4ae0 tempest-VolumesSnapshotTestJSON-153537947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:35:12 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-b20b811a-073f-4db3-94e2-c7fde9bd4ae0 tempest-VolumesSnapshotTestJSON-153537947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:35:12 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-b20b811a-073f-4db3-94e2-c7fde9bd4ae0 tempest-VolumesSnapshotTestJSON-153537947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:35:12 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-b20b811a-073f-4db3-94e2-c7fde9bd4ae0 tempest-VolumesSnapshotTestJSON-153537947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:35:12 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-b20b811a-073f-4db3-94e2-c7fde9bd4ae0 tempest-VolumesSnapshotTestJSON-153537947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:35:12 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-b20b811a-073f-4db3-94e2-c7fde9bd4ae0 tempest-VolumesSnapshotTestJSON-153537947 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:35:12 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-b20b811a-073f-4db3-94e2-c7fde9bd4ae0 tempest-VolumesSnapshotTestJSON-153537947 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:35:12 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-b20b811a-073f-4db3-94e2-c7fde9bd4ae0 tempest-VolumesSnapshotTestJSON-153537947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d81db8c5-08e1-4d1a-a9c4-ab770f1c9fb0 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:35:12 devstack sudo[102849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d81db8c5-08e1-4d1a-a9c4-ab770f1c9fb0 1073741824
Jul 30 20:35:12 devstack sudo[102849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:35:12 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2d36a81f-cd25-4ec0-8897-c2428a1872c7 tempest-ProjectReaderTests-1678794570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d4da167-6f3d-45c4-8876-bacdf785ffca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08cb8419-8c2f-4ed3-89bc-2bc968bd6132', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:35:12 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2d36a81f-cd25-4ec0-8897-c2428a1872c7 tempest-ProjectReaderTests-1678794570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (240326da-71ea-48a7-9bfb-2dc43424c0af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:35:12 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-2d36a81f-cd25-4ec0-8897-c2428a1872c7 tempest-ProjectReaderTests-1678794570 None] Volume volume-08cb8419-8c2f-4ed3-89bc-2bc968bd6132 (08cb8419-8c2f-4ed3-89bc-2bc968bd6132): created successfully
Jul 30 20:35:12 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2d36a81f-cd25-4ec0-8897-c2428a1872c7 tempest-ProjectReaderTests-1678794570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (240326da-71ea-48a7-9bfb-2dc43424c0af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:35:12 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2d36a81f-cd25-4ec0-8897-c2428a1872c7 tempest-ProjectReaderTests-1678794570 None] Flow 'volume_create_manager' (6825a48f-1551-427a-9a9a-41f36c9950fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:35:12 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-2d36a81f-cd25-4ec0-8897-c2428a1872c7 tempest-ProjectReaderTests-1678794570 None] Created volume successfully.
Jul 30 20:35:12 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-e2dd7e52-9426-4b27-b932-3e3abfe1160a tempest-ProjectReaderTests-1678794570 None] Acquiring lock "cinder-08cb8419-8c2f-4ed3-89bc-2bc968bd6132-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:35:12 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-e2dd7e52-9426-4b27-b932-3e3abfe1160a tempest-ProjectReaderTests-1678794570 None] Lock "cinder-08cb8419-8c2f-4ed3-89bc-2bc968bd6132-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:35:12 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-e2dd7e52-9426-4b27-b932-3e3abfe1160a tempest-ProjectReaderTests-1678794570 None] Acquiring lock "cinder-quobyte-08cb8419-8c2f-4ed3-89bc-2bc968bd6132" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:35:12 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-e2dd7e52-9426-4b27-b932-3e3abfe1160a tempest-ProjectReaderTests-1678794570 None] Lock "cinder-quobyte-08cb8419-8c2f-4ed3-89bc-2bc968bd6132" acquired by "delete_volume" :: waited 0.037s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:35:12 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[854c830e-5607-43c8-acfd-767562606b1c]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:35:12 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-e2dd7e52-9426-4b27-b932-3e3abfe1160a tempest-ProjectReaderTests-1678794570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-08cb8419-8c2f-4ed3-89bc-2bc968bd6132 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:35:13 devstack sudo[102860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-08cb8419-8c2f-4ed3-89bc-2bc968bd6132
Jul 30 20:35:13 devstack sudo[102860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:35:13 devstack cinder-volume[88719]: INFO cinder.volume.manager [req-d8a010c5-9190-407f-9ddd-64745051535d req-9c39e390-c54f-4060-96a3-3e0049bc0a5a tempest-TestMinimumBasicScenario-570690969 None] Terminate volume connection completed successfully.
Jul 30 20:35:13 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [req-d8a010c5-9190-407f-9ddd-64745051535d req-9c39e390-c54f-4060-96a3-3e0049bc0a5a tempest-TestMinimumBasicScenario-570690969 None] Deleting attachment f94fae35-0c58-4a12-8861-3a8b82fdfbd3. {{(pid=88719) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 30 20:35:13 devstack sudo[102849]: pam_unix(sudo:session): session closed for user root
Jul 30 20:35:13 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-b20b811a-073f-4db3-94e2-c7fde9bd4ae0 tempest-VolumesSnapshotTestJSON-153537947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d81db8c5-08e1-4d1a-a9c4-ab770f1c9fb0 1073741824" returned: 0 in 1.122s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:35:13 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-b20b811a-073f-4db3-94e2-c7fde9bd4ae0 tempest-VolumesSnapshotTestJSON-153537947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d81db8c5-08e1-4d1a-a9c4-ab770f1c9fb0 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:35:13 devstack sudo[102862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d81db8c5-08e1-4d1a-a9c4-ab770f1c9fb0
Jul 30 20:35:13 devstack sudo[102862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:35:13 devstack sudo[102860]: pam_unix(sudo:session): session closed for user root
Jul 30 20:35:13 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-e2dd7e52-9426-4b27-b932-3e3abfe1160a tempest-ProjectReaderTests-1678794570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-08cb8419-8c2f-4ed3-89bc-2bc968bd6132" returned: 0 in 0.730s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:35:13 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-e2dd7e52-9426-4b27-b932-3e3abfe1160a tempest-ProjectReaderTests-1678794570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-08cb8419-8c2f-4ed3-89bc-2bc968bd6132 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:35:13 devstack sudo[102867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-08cb8419-8c2f-4ed3-89bc-2bc968bd6132
Jul 30 20:35:13 devstack sudo[102867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:35:14 devstack sudo[102862]: pam_unix(sudo:session): session closed for user root
Jul 30 20:35:14 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-b20b811a-073f-4db3-94e2-c7fde9bd4ae0 tempest-VolumesSnapshotTestJSON-153537947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d81db8c5-08e1-4d1a-a9c4-ab770f1c9fb0" returned: 0 in 0.788s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:35:14 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-b20b811a-073f-4db3-94e2-c7fde9bd4ae0 tempest-VolumesSnapshotTestJSON-153537947 None] <== create_volume: return (2079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:35:14 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-b20b811a-073f-4db3-94e2-c7fde9bd4ae0 tempest-VolumesSnapshotTestJSON-153537947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.087s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:35:14 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-b20b811a-073f-4db3-94e2-c7fde9bd4ae0 tempest-VolumesSnapshotTestJSON-153537947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1d038db-037d-468e-bd75-860ed433567e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d81db8c5-08e1-4d1a-a9c4-ab770f1c9fb0', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:35:14 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-b20b811a-073f-4db3-94e2-c7fde9bd4ae0 tempest-VolumesSnapshotTestJSON-153537947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (072f2562-c62e-448b-9f62-a7b067a0b684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:35:14 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-b20b811a-073f-4db3-94e2-c7fde9bd4ae0 tempest-VolumesSnapshotTestJSON-153537947 None] Volume volume-d81db8c5-08e1-4d1a-a9c4-ab770f1c9fb0 (d81db8c5-08e1-4d1a-a9c4-ab770f1c9fb0): created successfully
Jul 30 20:35:14 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-b20b811a-073f-4db3-94e2-c7fde9bd4ae0 tempest-VolumesSnapshotTestJSON-153537947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (072f2562-c62e-448b-9f62-a7b067a0b684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:35:14 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-b20b811a-073f-4db3-94e2-c7fde9bd4ae0 tempest-VolumesSnapshotTestJSON-153537947 None] Flow 'volume_create_manager' (564395fa-e094-4b68-b848-7ef81ce60c65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:35:14 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-b20b811a-073f-4db3-94e2-c7fde9bd4ae0 tempest-VolumesSnapshotTestJSON-153537947 None] Created volume successfully.
Jul 30 20:35:14 devstack sudo[102867]: pam_unix(sudo:session): session closed for user root
Jul 30 20:35:14 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-e2dd7e52-9426-4b27-b932-3e3abfe1160a tempest-ProjectReaderTests-1678794570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-08cb8419-8c2f-4ed3-89bc-2bc968bd6132" returned: 0 in 0.755s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:35:14 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-e2dd7e52-9426-4b27-b932-3e3abfe1160a tempest-ProjectReaderTests-1678794570 None] Lock "cinder-quobyte-08cb8419-8c2f-4ed3-89bc-2bc968bd6132" released by "delete_volume" :: held 1.596s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:35:14 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-e2dd7e52-9426-4b27-b932-3e3abfe1160a tempest-ProjectReaderTests-1678794570 None] Created reservations ['1b008a3d-9dc3-4888-9fa5-e91e6e35406b', '5ad16bf8-e6c6-40fa-b980-21f8f6ebe7b0', '338dae27-624a-4108-960f-44f88256cd0e', '789138ed-1331-4bb4-b75a-42ac9cc4640a'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:35:14 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-a7fde271-06fb-4c53-9bb3-c7b5f0f38eed tempest-TestMinimumBasicScenario-570690969 None] Acquiring lock "cinder-d501bebd-a092-4699-b733-29aff8434e13-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:35:14 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-a7fde271-06fb-4c53-9bb3-c7b5f0f38eed tempest-TestMinimumBasicScenario-570690969 None] Lock "cinder-d501bebd-a092-4699-b733-29aff8434e13-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:35:14 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-e2dd7e52-9426-4b27-b932-3e3abfe1160a tempest-ProjectReaderTests-1678794570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:35:14 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-e2dd7e52-9426-4b27-b932-3e3abfe1160a tempest-ProjectReaderTests-1678794570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:35:14 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-e2dd7e52-9426-4b27-b932-3e3abfe1160a tempest-ProjectReaderTests-1678794570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:35:14 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-e2dd7e52-9426-4b27-b932-3e3abfe1160a tempest-ProjectReaderTests-1678794570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:35:14 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-e2dd7e52-9426-4b27-b932-3e3abfe1160a tempest-ProjectReaderTests-1678794570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:35:14 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-e2dd7e52-9426-4b27-b932-3e3abfe1160a tempest-ProjectReaderTests-1678794570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:35:14 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-a7fde271-06fb-4c53-9bb3-c7b5f0f38eed tempest-TestMinimumBasicScenario-570690969 None] Acquiring lock "cinder-quobyte-d501bebd-a092-4699-b733-29aff8434e13" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:35:14 devstack sudo[102873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:35:14 devstack sudo[102873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:35:14 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-a7fde271-06fb-4c53-9bb3-c7b5f0f38eed tempest-TestMinimumBasicScenario-570690969 None] Lock "cinder-quobyte-d501bebd-a092-4699-b733-29aff8434e13" acquired by "delete_volume" :: waited 0.039s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:35:15 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[e45f067f-7ab6-47b9-aac7-738880b22c71]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:35:15 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-a7fde271-06fb-4c53-9bb3-c7b5f0f38eed tempest-TestMinimumBasicScenario-570690969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d501bebd-a092-4699-b733-29aff8434e13 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:35:15 devstack sudo[102875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d501bebd-a092-4699-b733-29aff8434e13
Jul 30 20:35:15 devstack sudo[102875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:35:15 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-f3517c43-cbe4-47c4-b753-d5703c079fa4 tempest-VolumesSnapshotTestJSON-153537947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:35:15 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-f3517c43-cbe4-47c4-b753-d5703c079fa4 tempest-VolumesSnapshotTestJSON-153537947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:35:15 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-f3517c43-cbe4-47c4-b753-d5703c079fa4 tempest-VolumesSnapshotTestJSON-153537947 None] Creating offline snapshot 9b9d5509-33d0-47d8-bcc8-5fa642fb62dc of volume d81db8c5-08e1-4d1a-a9c4-ab770f1c9fb0 {{(pid=88719) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 30 20:35:15 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca99571f-c7a0-4ae3-b258-679318fb85dc]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:35:15 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f3517c43-cbe4-47c4-b753-d5703c079fa4 tempest-VolumesSnapshotTestJSON-153537947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d81db8c5-08e1-4d1a-a9c4-ab770f1c9fb0 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:35:15 devstack sudo[102873]: pam_unix(sudo:session): session closed for user root
Jul 30 20:35:15 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-e2dd7e52-9426-4b27-b932-3e3abfe1160a tempest-ProjectReaderTests-1678794570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.927s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:35:15 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-e2dd7e52-9426-4b27-b932-3e3abfe1160a tempest-ProjectReaderTests-1678794570 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:35:15 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-e2dd7e52-9426-4b27-b932-3e3abfe1160a tempest-ProjectReaderTests-1678794570 None] Deleted volume successfully.
Jul 30 20:35:15 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-e2dd7e52-9426-4b27-b932-3e3abfe1160a tempest-ProjectReaderTests-1678794570 None] Lock "cinder-08cb8419-8c2f-4ed3-89bc-2bc968bd6132-delete_volume" released by "delete_volume" :: held 3.082s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:35:15 devstack sudo[102875]: pam_unix(sudo:session): session closed for user root
Jul 30 20:35:15 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-a7fde271-06fb-4c53-9bb3-c7b5f0f38eed tempest-TestMinimumBasicScenario-570690969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d501bebd-a092-4699-b733-29aff8434e13" returned: 0 in 0.965s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:35:15 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-a7fde271-06fb-4c53-9bb3-c7b5f0f38eed tempest-TestMinimumBasicScenario-570690969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d501bebd-a092-4699-b733-29aff8434e13 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:35:16 devstack sudo[102882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d501bebd-a092-4699-b733-29aff8434e13
Jul 30 20:35:16 devstack sudo[102882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:35:16 devstack sudo[102879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d81db8c5-08e1-4d1a-a9c4-ab770f1c9fb0
Jul 30 20:35:16 devstack sudo[102879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:35:16 devstack cinder-volume[88719]: DEBUG oslo_service.periodic_task [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88719) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 30 20:35:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:35:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:35:16 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:35:16 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:35:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:35:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:35:16 devstack sudo[102879]: pam_unix(sudo:session): session closed for user root
Jul 30 20:35:16 devstack sudo[102882]: pam_unix(sudo:session): session closed for user root
Jul 30 20:35:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-a7fde271-06fb-4c53-9bb3-c7b5f0f38eed tempest-TestMinimumBasicScenario-570690969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d501bebd-a092-4699-b733-29aff8434e13" returned: 0 in 0.522s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:35:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f3517c43-cbe4-47c4-b753-d5703c079fa4 tempest-VolumesSnapshotTestJSON-153537947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d81db8c5-08e1-4d1a-a9c4-ab770f1c9fb0" returned: 0 in 0.764s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:35:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f3517c43-cbe4-47c4-b753-d5703c079fa4 tempest-VolumesSnapshotTestJSON-153537947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d81db8c5-08e1-4d1a-a9c4-ab770f1c9fb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d81db8c5-08e1-4d1a-a9c4-ab770f1c9fb0.9b9d5509-33d0-47d8-bcc8-5fa642fb62dc 1G {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:35:16 devstack sudo[102889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:35:16 devstack sudo[102889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:35:16 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-a7fde271-06fb-4c53-9bb3-c7b5f0f38eed tempest-TestMinimumBasicScenario-570690969 None] Lock "cinder-quobyte-d501bebd-a092-4699-b733-29aff8434e13" released by "delete_volume" :: held 1.610s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:35:16 devstack sudo[102891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d81db8c5-08e1-4d1a-a9c4-ab770f1c9fb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d81db8c5-08e1-4d1a-a9c4-ab770f1c9fb0.9b9d5509-33d0-47d8-bcc8-5fa642fb62dc 1G
Jul 30 20:35:16 devstack sudo[102891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:35:16 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-91c1acfb-7efe-49e1-88d2-840907b7aea7 tempest-ProjectReaderTests-1678794570 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:35:16 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-91c1acfb-7efe-49e1-88d2-840907b7aea7 tempest-ProjectReaderTests-1678794570 None] Flow 'volume_create_manager' (cea7f536-adc7-4729-93bf-78ecd95403ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:35:16 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-91c1acfb-7efe-49e1-88d2-840907b7aea7 tempest-ProjectReaderTests-1678794570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2f6042d-e97c-4d6b-85ef-2e1eea770e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:35:16 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-91c1acfb-7efe-49e1-88d2-840907b7aea7 tempest-ProjectReaderTests-1678794570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2f6042d-e97c-4d6b-85ef-2e1eea770e5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:35:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-648665222',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=192fe2bd-b829-4d1a-8206-f2b4d4dde385,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c312b3916a84681800229f4dbad5ed8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:35:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:35:16Z,use_quota=True,user_id='1772aff9b9fd4d4bb9ce25f6b8f41b31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:35:16 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-91c1acfb-7efe-49e1-88d2-840907b7aea7 tempest-ProjectReaderTests-1678794570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6a876e5-07d0-4481-9a2e-fe430ab5619f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:35:16 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-91c1acfb-7efe-49e1-88d2-840907b7aea7 tempest-ProjectReaderTests-1678794570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6a876e5-07d0-4481-9a2e-fe430ab5619f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:35:16 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-91c1acfb-7efe-49e1-88d2-840907b7aea7 tempest-ProjectReaderTests-1678794570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ae08aa4-7e43-40a3-b603-74a3c37f5a79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:35:16 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-91c1acfb-7efe-49e1-88d2-840907b7aea7 tempest-ProjectReaderTests-1678794570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ae08aa4-7e43-40a3-b603-74a3c37f5a79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '192fe2bd-b829-4d1a-8206-f2b4d4dde385', 'volume_name': 'volume-192fe2bd-b829-4d1a-8206-f2b4d4dde385', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:35:16 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-91c1acfb-7efe-49e1-88d2-840907b7aea7 tempest-ProjectReaderTests-1678794570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19035dab-a581-49ed-b708-1244ce4b2feb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:35:16 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-91c1acfb-7efe-49e1-88d2-840907b7aea7 tempest-ProjectReaderTests-1678794570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19035dab-a581-49ed-b708-1244ce4b2feb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:35:16 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-91c1acfb-7efe-49e1-88d2-840907b7aea7 tempest-ProjectReaderTests-1678794570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (755881cb-87ec-4ed2-8ce1-72c7dfe09822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:35:16 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-91c1acfb-7efe-49e1-88d2-840907b7aea7 tempest-ProjectReaderTests-1678794570 None] Volume 192fe2bd-b829-4d1a-8206-f2b4d4dde385: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-192fe2bd-b829-4d1a-8206-f2b4d4dde385', 'volume_size': 1}
Jul 30 20:35:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-91c1acfb-7efe-49e1-88d2-840907b7aea7 tempest-ProjectReaderTests-1678794570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:35:16 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-a7fde271-06fb-4c53-9bb3-c7b5f0f38eed tempest-TestMinimumBasicScenario-570690969 None] Created reservations ['2b39f785-1421-4451-9348-0c2b48ee0bef', '12557321-57ee-4098-9bdb-da46c6eecab7', '13da3f0f-18a1-4c6e-a6e4-162ad2a43ef9', '29f2cde4-3add-45ff-ba05-d984e1e013e3'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:35:17 devstack sudo[102889]: pam_unix(sudo:session): session closed for user root
Jul 30 20:35:17 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.570s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:35:17 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:35:17 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-a7fde271-06fb-4c53-9bb3-c7b5f0f38eed tempest-TestMinimumBasicScenario-570690969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:35:17 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-a7fde271-06fb-4c53-9bb3-c7b5f0f38eed tempest-TestMinimumBasicScenario-570690969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:35:17 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-a7fde271-06fb-4c53-9bb3-c7b5f0f38eed tempest-TestMinimumBasicScenario-570690969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:35:17 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-a7fde271-06fb-4c53-9bb3-c7b5f0f38eed tempest-TestMinimumBasicScenario-570690969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:35:17 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-a7fde271-06fb-4c53-9bb3-c7b5f0f38eed tempest-TestMinimumBasicScenario-570690969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:35:17 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-a7fde271-06fb-4c53-9bb3-c7b5f0f38eed tempest-TestMinimumBasicScenario-570690969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:35:17 devstack cinder-volume[88719]: DEBUG oslo_service.periodic_task [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Running periodic task VolumeManager._thread_info {{(pid=88719) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 30 20:35:17 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] thread count: 28 {{(pid=88719) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 30 20:35:17 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] thread info: [<_MainThread(MainThread, started 132390416908416)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132390306497536)>, <Thread(Thread-3 (stat_writer), started daemon 132390304471680)>, <Thread(Rabbit-heartbeat, started daemon 132390303393408)>, <Thread(Thread-5 (_runner), started daemon 132390303543168)>, <Thread(Thread-7 (_runner), started daemon 132390303563392)>, <Thread(fd_logger, started daemon 132390301344640)>, <Thread(privsep_reader, started daemon 132390301560640)>, <Thread(tpool_thread_0, started daemon 132390291470016)>, <Thread(tpool_thread_1, started daemon 132390283077312)>, <Thread(tpool_thread_2, started daemon 132390274684608)>, <Thread(tpool_thread_3, started daemon 132390266291904)>, <Thread(tpool_thread_4, started daemon 132390257899200)>, <Thread(tpool_thread_5, started daemon 132390249506496)>, <Thread(tpool_thread_6, started daemon 132390241113792)>, <Thread(tpool_thread_7, started daemon 132390232721088)>, <Thread(tpool_thread_8, started daemon 132390224328384)>, <Thread(tpool_thread_9, started daemon 132390215919296)>, <Thread(tpool_thread_10, started daemon 132390207510208)>, <Thread(tpool_thread_11, started daemon 132390199101120)>, <Thread(tpool_thread_12, started daemon 132390190692032)>, <Thread(tpool_thread_13, started daemon 132390182282944)>, <Thread(tpool_thread_14, started daemon 132390173873856)>, <Thread(tpool_thread_15, started daemon 132390165464768)>, <Thread(tpool_thread_16, started daemon 132390157055680)>, <Thread(tpool_thread_17, started daemon 132390148646592)>, <Thread(tpool_thread_18, started daemon 132390140237504)>, <Thread(tpool_thread_19, started daemon 132390131828416)>] {{(pid=88719) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 30 20:35:17 devstack sudo[102898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:35:17 devstack sudo[102898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:35:17 devstack sudo[102891]: pam_unix(sudo:session): session closed for user root
Jul 30 20:35:17 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f3517c43-cbe4-47c4-b753-d5703c079fa4 tempest-VolumesSnapshotTestJSON-153537947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d81db8c5-08e1-4d1a-a9c4-ab770f1c9fb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d81db8c5-08e1-4d1a-a9c4-ab770f1c9fb0.9b9d5509-33d0-47d8-bcc8-5fa642fb62dc 1G" returned: 0 in 0.745s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:35:17 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f3517c43-cbe4-47c4-b753-d5703c079fa4 tempest-VolumesSnapshotTestJSON-153537947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d81db8c5-08e1-4d1a-a9c4-ab770f1c9fb0 -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d81db8c5-08e1-4d1a-a9c4-ab770f1c9fb0.9b9d5509-33d0-47d8-bcc8-5fa642fb62dc {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:35:17 devstack sudo[102900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d81db8c5-08e1-4d1a-a9c4-ab770f1c9fb0 -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d81db8c5-08e1-4d1a-a9c4-ab770f1c9fb0.9b9d5509-33d0-47d8-bcc8-5fa642fb62dc
Jul 30 20:35:17 devstack sudo[102900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:35:17 devstack sudo[102898]: pam_unix(sudo:session): session closed for user root
Jul 30 20:35:17 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-a7fde271-06fb-4c53-9bb3-c7b5f0f38eed tempest-TestMinimumBasicScenario-570690969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.522s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:35:17 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-a7fde271-06fb-4c53-9bb3-c7b5f0f38eed tempest-TestMinimumBasicScenario-570690969 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:35:17 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-a7fde271-06fb-4c53-9bb3-c7b5f0f38eed tempest-TestMinimumBasicScenario-570690969 None] Deleted volume successfully.
Jul 30 20:35:17 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-a7fde271-06fb-4c53-9bb3-c7b5f0f38eed tempest-TestMinimumBasicScenario-570690969 None] Lock "cinder-d501bebd-a092-4699-b733-29aff8434e13-delete_volume" released by "delete_volume" :: held 2.925s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:35:18 devstack sudo[102900]: pam_unix(sudo:session): session closed for user root
Jul 30 20:35:18 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f3517c43-cbe4-47c4-b753-d5703c079fa4 tempest-VolumesSnapshotTestJSON-153537947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d81db8c5-08e1-4d1a-a9c4-ab770f1c9fb0 -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d81db8c5-08e1-4d1a-a9c4-ab770f1c9fb0.9b9d5509-33d0-47d8-bcc8-5fa642fb62dc" returned: 0 in 0.792s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:35:18 devstack cinder-volume[88719]: WARNING cinder.volume.drivers.remotefs [None req-f3517c43-cbe4-47c4-b753-d5703c079fa4 tempest-VolumesSnapshotTestJSON-153537947 None] /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d81db8c5-08e1-4d1a-a9c4-ab770f1c9fb0.9b9d5509-33d0-47d8-bcc8-5fa642fb62dc is being set with open permissions: ugo+rw
Jul 30 20:35:18 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f3517c43-cbe4-47c4-b753-d5703c079fa4 tempest-VolumesSnapshotTestJSON-153537947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d81db8c5-08e1-4d1a-a9c4-ab770f1c9fb0.9b9d5509-33d0-47d8-bcc8-5fa642fb62dc {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:35:18 devstack sudo[102916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d81db8c5-08e1-4d1a-a9c4-ab770f1c9fb0.9b9d5509-33d0-47d8-bcc8-5fa642fb62dc
Jul 30 20:35:18 devstack sudo[102916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:35:18 devstack sudo[102916]: pam_unix(sudo:session): session closed for user root
Jul 30 20:35:18 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f3517c43-cbe4-47c4-b753-d5703c079fa4 tempest-VolumesSnapshotTestJSON-153537947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d81db8c5-08e1-4d1a-a9c4-ab770f1c9fb0.9b9d5509-33d0-47d8-bcc8-5fa642fb62dc" returned: 0 in 0.517s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:35:18 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f3517c43-cbe4-47c4-b753-d5703c079fa4 tempest-VolumesSnapshotTestJSON-153537947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d81db8c5-08e1-4d1a-a9c4-ab770f1c9fb0.info {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:35:18 devstack sudo[102935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d81db8c5-08e1-4d1a-a9c4-ab770f1c9fb0.info
Jul 30 20:35:18 devstack sudo[102935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:35:18 devstack sudo[102935]: pam_unix(sudo:session): session closed for user root
Jul 30 20:35:19 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f3517c43-cbe4-47c4-b753-d5703c079fa4 tempest-VolumesSnapshotTestJSON-153537947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d81db8c5-08e1-4d1a-a9c4-ab770f1c9fb0.info" returned: 0 in 0.348s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:35:19 devstack cinder-volume[88719]: WARNING cinder.volume.drivers.remotefs [None req-f3517c43-cbe4-47c4-b753-d5703c079fa4 tempest-VolumesSnapshotTestJSON-153537947 None] /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d81db8c5-08e1-4d1a-a9c4-ab770f1c9fb0.info is being set with open permissions: ugo+rw
Jul 30 20:35:19 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f3517c43-cbe4-47c4-b753-d5703c079fa4 tempest-VolumesSnapshotTestJSON-153537947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d81db8c5-08e1-4d1a-a9c4-ab770f1c9fb0.info {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:35:19 devstack sudo[102938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d81db8c5-08e1-4d1a-a9c4-ab770f1c9fb0.info
Jul 30 20:35:19 devstack sudo[102938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:35:19 devstack sudo[102938]: pam_unix(sudo:session): session closed for user root
Jul 30 20:35:19 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f3517c43-cbe4-47c4-b753-d5703c079fa4 tempest-VolumesSnapshotTestJSON-153537947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d81db8c5-08e1-4d1a-a9c4-ab770f1c9fb0.info" returned: 0 in 0.397s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:35:19 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-f3517c43-cbe4-47c4-b753-d5703c079fa4 tempest-VolumesSnapshotTestJSON-153537947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.728s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:35:19 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-91c1acfb-7efe-49e1-88d2-840907b7aea7 tempest-ProjectReaderTests-1678794570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.659s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:35:19 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-91c1acfb-7efe-49e1-88d2-840907b7aea7 tempest-ProjectReaderTests-1678794570 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:35:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-648665222',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=192fe2bd-b829-4d1a-8206-f2b4d4dde385,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c312b3916a84681800229f4dbad5ed8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:35:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:35:16Z,use_quota=True,user_id='1772aff9b9fd4d4bb9ce25f6b8f41b31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:35:19 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-91c1acfb-7efe-49e1-88d2-840907b7aea7 tempest-ProjectReaderTests-1678794570 None] Creating volume 192fe2bd-b829-4d1a-8206-f2b4d4dde385 {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:35:19 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-91c1acfb-7efe-49e1-88d2-840907b7aea7 tempest-ProjectReaderTests-1678794570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:35:19 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-91c1acfb-7efe-49e1-88d2-840907b7aea7 tempest-ProjectReaderTests-1678794570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:35:19 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-91c1acfb-7efe-49e1-88d2-840907b7aea7 tempest-ProjectReaderTests-1678794570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:35:19 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-91c1acfb-7efe-49e1-88d2-840907b7aea7 tempest-ProjectReaderTests-1678794570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:35:19 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-91c1acfb-7efe-49e1-88d2-840907b7aea7 tempest-ProjectReaderTests-1678794570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:35:19 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-91c1acfb-7efe-49e1-88d2-840907b7aea7 tempest-ProjectReaderTests-1678794570 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:35:19 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-91c1acfb-7efe-49e1-88d2-840907b7aea7 tempest-ProjectReaderTests-1678794570 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:35:19 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-91c1acfb-7efe-49e1-88d2-840907b7aea7 tempest-ProjectReaderTests-1678794570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-192fe2bd-b829-4d1a-8206-f2b4d4dde385 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:35:19 devstack sudo[102943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-192fe2bd-b829-4d1a-8206-f2b4d4dde385 1073741824
Jul 30 20:35:19 devstack sudo[102943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:35:19 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-f3517c43-cbe4-47c4-b753-d5703c079fa4 tempest-VolumesSnapshotTestJSON-153537947 None] Create snapshot completed successfully
Jul 30 20:35:20 devstack sudo[102943]: pam_unix(sudo:session): session closed for user root
Jul 30 20:35:20 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-91c1acfb-7efe-49e1-88d2-840907b7aea7 tempest-ProjectReaderTests-1678794570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-192fe2bd-b829-4d1a-8206-f2b4d4dde385 1073741824" returned: 0 in 0.599s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:35:20 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-91c1acfb-7efe-49e1-88d2-840907b7aea7 tempest-ProjectReaderTests-1678794570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-192fe2bd-b829-4d1a-8206-f2b4d4dde385 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:35:20 devstack sudo[102948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-192fe2bd-b829-4d1a-8206-f2b4d4dde385
Jul 30 20:35:20 devstack sudo[102948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:35:20 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-dbf0dcf9-f6b7-4636-b7e1-e122b9d681b9 tempest-VolumesSnapshotTestJSON-153537947 None] Acquiring lock "cinder-9b9d5509-33d0-47d8-bcc8-5fa642fb62dc-delete_snapshot" by "delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:35:20 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-dbf0dcf9-f6b7-4636-b7e1-e122b9d681b9 tempest-VolumesSnapshotTestJSON-153537947 None] Lock "cinder-9b9d5509-33d0-47d8-bcc8-5fa642fb62dc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:35:20 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-dbf0dcf9-f6b7-4636-b7e1-e122b9d681b9 tempest-VolumesSnapshotTestJSON-153537947 None] Acquiring lock "cinder-quobyte-d81db8c5-08e1-4d1a-a9c4-ab770f1c9fb0" by "delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:35:20 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-dbf0dcf9-f6b7-4636-b7e1-e122b9d681b9 tempest-VolumesSnapshotTestJSON-153537947 None] Lock "cinder-quobyte-d81db8c5-08e1-4d1a-a9c4-ab770f1c9fb0" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:35:20 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-dbf0dcf9-f6b7-4636-b7e1-e122b9d681b9 tempest-VolumesSnapshotTestJSON-153537947 None] Acquiring lock "cinder-quobyte-9b9d5509-33d0-47d8-bcc8-5fa642fb62dc" by "_delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:35:20 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-dbf0dcf9-f6b7-4636-b7e1-e122b9d681b9 tempest-VolumesSnapshotTestJSON-153537947 None] Lock "cinder-quobyte-9b9d5509-33d0-47d8-bcc8-5fa642fb62dc" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:35:20 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-dbf0dcf9-f6b7-4636-b7e1-e122b9d681b9 tempest-VolumesSnapshotTestJSON-153537947 None] Deleting offline snapshot 9b9d5509-33d0-47d8-bcc8-5fa642fb62dc of volume d81db8c5-08e1-4d1a-a9c4-ab770f1c9fb0 {{(pid=88719) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 30 20:35:20 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-dbf0dcf9-f6b7-4636-b7e1-e122b9d681b9 tempest-VolumesSnapshotTestJSON-153537947 None] snapshot_file for this snap is: volume-d81db8c5-08e1-4d1a-a9c4-ab770f1c9fb0.9b9d5509-33d0-47d8-bcc8-5fa642fb62dc {{(pid=88719) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 30 20:35:20 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[23479965-16d8-4a0d-928a-b60d085669df]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:35:20 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-dbf0dcf9-f6b7-4636-b7e1-e122b9d681b9 tempest-VolumesSnapshotTestJSON-153537947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d81db8c5-08e1-4d1a-a9c4-ab770f1c9fb0.9b9d5509-33d0-47d8-bcc8-5fa642fb62dc {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:35:20 devstack sudo[102948]: pam_unix(sudo:session): session closed for user root
Jul 30 20:35:20 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-91c1acfb-7efe-49e1-88d2-840907b7aea7 tempest-ProjectReaderTests-1678794570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-192fe2bd-b829-4d1a-8206-f2b4d4dde385" returned: 0 in 0.336s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:35:20 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-91c1acfb-7efe-49e1-88d2-840907b7aea7 tempest-ProjectReaderTests-1678794570 None] <== create_volume: return (991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:35:20 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-91c1acfb-7efe-49e1-88d2-840907b7aea7 tempest-ProjectReaderTests-1678794570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.993s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:35:20 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-91c1acfb-7efe-49e1-88d2-840907b7aea7 tempest-ProjectReaderTests-1678794570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (755881cb-87ec-4ed2-8ce1-72c7dfe09822) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-192fe2bd-b829-4d1a-8206-f2b4d4dde385', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:35:20 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-91c1acfb-7efe-49e1-88d2-840907b7aea7 tempest-ProjectReaderTests-1678794570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b2b645a-098f-4488-8710-444205eafa4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:35:20 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-91c1acfb-7efe-49e1-88d2-840907b7aea7 tempest-ProjectReaderTests-1678794570 None] Volume volume-192fe2bd-b829-4d1a-8206-f2b4d4dde385 (192fe2bd-b829-4d1a-8206-f2b4d4dde385): created successfully
Jul 30 20:35:20 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-91c1acfb-7efe-49e1-88d2-840907b7aea7 tempest-ProjectReaderTests-1678794570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b2b645a-098f-4488-8710-444205eafa4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:35:20 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-91c1acfb-7efe-49e1-88d2-840907b7aea7 tempest-ProjectReaderTests-1678794570 None] Flow 'volume_create_manager' (cea7f536-adc7-4729-93bf-78ecd95403ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:35:20 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-91c1acfb-7efe-49e1-88d2-840907b7aea7 tempest-ProjectReaderTests-1678794570 None] Created volume successfully.
Jul 30 20:35:20 devstack sudo[102951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d81db8c5-08e1-4d1a-a9c4-ab770f1c9fb0.9b9d5509-33d0-47d8-bcc8-5fa642fb62dc
Jul 30 20:35:20 devstack sudo[102951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:35:20 devstack sudo[102951]: pam_unix(sudo:session): session closed for user root
Jul 30 20:35:20 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-dbf0dcf9-f6b7-4636-b7e1-e122b9d681b9 tempest-VolumesSnapshotTestJSON-153537947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d81db8c5-08e1-4d1a-a9c4-ab770f1c9fb0.9b9d5509-33d0-47d8-bcc8-5fa642fb62dc" returned: 0 in 0.518s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:35:20 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-dbf0dcf9-f6b7-4636-b7e1-e122b9d681b9 tempest-VolumesSnapshotTestJSON-153537947 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d81db8c5-08e1-4d1a-a9c4-ab770f1c9fb0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88719) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 30 20:35:20 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[3da18430-7f6e-4040-8be7-246450d1b32b]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:35:20 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-dbf0dcf9-f6b7-4636-b7e1-e122b9d681b9 tempest-VolumesSnapshotTestJSON-153537947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d81db8c5-08e1-4d1a-a9c4-ab770f1c9fb0 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:35:20 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-f6972949-b720-4058-af61-ed857d26df34 tempest-ProjectReaderTests-1678794570 None] Acquiring lock "cinder-192fe2bd-b829-4d1a-8206-f2b4d4dde385-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:35:21 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-f6972949-b720-4058-af61-ed857d26df34 tempest-ProjectReaderTests-1678794570 None] Lock "cinder-192fe2bd-b829-4d1a-8206-f2b4d4dde385-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:35:21 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-f6972949-b720-4058-af61-ed857d26df34 tempest-ProjectReaderTests-1678794570 None] Acquiring lock "cinder-quobyte-192fe2bd-b829-4d1a-8206-f2b4d4dde385" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:35:21 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-f6972949-b720-4058-af61-ed857d26df34 tempest-ProjectReaderTests-1678794570 None] Lock "cinder-quobyte-192fe2bd-b829-4d1a-8206-f2b4d4dde385" acquired by "delete_volume" :: waited 0.026s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:35:21 devstack sudo[102956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d81db8c5-08e1-4d1a-a9c4-ab770f1c9fb0
Jul 30 20:35:21 devstack sudo[102956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:35:21 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eae62d8-2f51-45c9-98e8-b04f3cba3583]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:35:21 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f6972949-b720-4058-af61-ed857d26df34 tempest-ProjectReaderTests-1678794570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-192fe2bd-b829-4d1a-8206-f2b4d4dde385 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:35:21 devstack sudo[102958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-192fe2bd-b829-4d1a-8206-f2b4d4dde385
Jul 30 20:35:21 devstack sudo[102958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:35:21 devstack sudo[102956]: pam_unix(sudo:session): session closed for user root
Jul 30 20:35:21 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-dbf0dcf9-f6b7-4636-b7e1-e122b9d681b9 tempest-VolumesSnapshotTestJSON-153537947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d81db8c5-08e1-4d1a-a9c4-ab770f1c9fb0" returned: 0 in 0.536s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:35:21 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-dbf0dcf9-f6b7-4636-b7e1-e122b9d681b9 tempest-VolumesSnapshotTestJSON-153537947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d81db8c5-08e1-4d1a-a9c4-ab770f1c9fb0.9b9d5509-33d0-47d8-bcc8-5fa642fb62dc {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:35:21 devstack sudo[102963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d81db8c5-08e1-4d1a-a9c4-ab770f1c9fb0.9b9d5509-33d0-47d8-bcc8-5fa642fb62dc
Jul 30 20:35:21 devstack sudo[102963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:35:21 devstack sudo[102958]: pam_unix(sudo:session): session closed for user root
Jul 30 20:35:21 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f6972949-b720-4058-af61-ed857d26df34 tempest-ProjectReaderTests-1678794570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-192fe2bd-b829-4d1a-8206-f2b4d4dde385" returned: 0 in 0.456s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:35:21 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f6972949-b720-4058-af61-ed857d26df34 tempest-ProjectReaderTests-1678794570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-192fe2bd-b829-4d1a-8206-f2b4d4dde385 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:35:21 devstack sudo[102969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-192fe2bd-b829-4d1a-8206-f2b4d4dde385
Jul 30 20:35:21 devstack sudo[102969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:35:21 devstack sudo[102963]: pam_unix(sudo:session): session closed for user root
Jul 30 20:35:21 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-dbf0dcf9-f6b7-4636-b7e1-e122b9d681b9 tempest-VolumesSnapshotTestJSON-153537947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d81db8c5-08e1-4d1a-a9c4-ab770f1c9fb0.9b9d5509-33d0-47d8-bcc8-5fa642fb62dc" returned: 0 in 0.412s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:35:21 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-dbf0dcf9-f6b7-4636-b7e1-e122b9d681b9 tempest-VolumesSnapshotTestJSON-153537947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d81db8c5-08e1-4d1a-a9c4-ab770f1c9fb0.9b9d5509-33d0-47d8-bcc8-5fa642fb62dc {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:35:21 devstack sudo[102975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d81db8c5-08e1-4d1a-a9c4-ab770f1c9fb0.9b9d5509-33d0-47d8-bcc8-5fa642fb62dc
Jul 30 20:35:21 devstack sudo[102975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:35:22 devstack sudo[102969]: pam_unix(sudo:session): session closed for user root
Jul 30 20:35:22 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f6972949-b720-4058-af61-ed857d26df34 tempest-ProjectReaderTests-1678794570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-192fe2bd-b829-4d1a-8206-f2b4d4dde385" returned: 0 in 0.449s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:35:22 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-f6972949-b720-4058-af61-ed857d26df34 tempest-ProjectReaderTests-1678794570 None] Lock "cinder-quobyte-192fe2bd-b829-4d1a-8206-f2b4d4dde385" released by "delete_volume" :: held 0.957s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:35:22 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-f6972949-b720-4058-af61-ed857d26df34 tempest-ProjectReaderTests-1678794570 None] Created reservations ['89f7074c-33b1-4c17-a9e8-51a2dbf7d24a', 'd57ee154-6223-4ad3-b61a-40817749305a', 'f60334a8-39fa-4784-98fd-f682486402ad', 'be81d9be-9fcc-4788-8582-31d9877c5bd6'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:35:22 devstack sudo[102975]: pam_unix(sudo:session): session closed for user root
Jul 30 20:35:22 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-dbf0dcf9-f6b7-4636-b7e1-e122b9d681b9 tempest-VolumesSnapshotTestJSON-153537947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d81db8c5-08e1-4d1a-a9c4-ab770f1c9fb0.9b9d5509-33d0-47d8-bcc8-5fa642fb62dc" returned: 0 in 0.351s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:35:22 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-dbf0dcf9-f6b7-4636-b7e1-e122b9d681b9 tempest-VolumesSnapshotTestJSON-153537947 None] Lock "cinder-quobyte-9b9d5509-33d0-47d8-bcc8-5fa642fb62dc" released by "_delete_snapshot" :: held 1.977s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:35:22 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-f6972949-b720-4058-af61-ed857d26df34 tempest-ProjectReaderTests-1678794570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:35:22 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-f6972949-b720-4058-af61-ed857d26df34 tempest-ProjectReaderTests-1678794570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:35:22 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-f6972949-b720-4058-af61-ed857d26df34 tempest-ProjectReaderTests-1678794570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:35:22 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-f6972949-b720-4058-af61-ed857d26df34 tempest-ProjectReaderTests-1678794570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:35:22 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-f6972949-b720-4058-af61-ed857d26df34 tempest-ProjectReaderTests-1678794570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:35:22 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f6972949-b720-4058-af61-ed857d26df34 tempest-ProjectReaderTests-1678794570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:35:22 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-dbf0dcf9-f6b7-4636-b7e1-e122b9d681b9 tempest-VolumesSnapshotTestJSON-153537947 None] Lock "cinder-quobyte-d81db8c5-08e1-4d1a-a9c4-ab770f1c9fb0" released by "delete_snapshot" :: held 2.024s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:35:22 devstack sudo[102996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:35:22 devstack sudo[102996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:35:22 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-dbf0dcf9-f6b7-4636-b7e1-e122b9d681b9 tempest-VolumesSnapshotTestJSON-153537947 None] Created reservations ['0a321d80-da6a-49a9-9e0c-c1aeaeef8094', '3f04690d-8900-4524-9074-254e1016c751', 'c8b26fd2-44d0-4132-bc02-03145794648a', '75c470de-9db0-4db6-b400-54fae81a007d'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:35:22 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-dbf0dcf9-f6b7-4636-b7e1-e122b9d681b9 tempest-VolumesSnapshotTestJSON-153537947 None] Delete snapshot completed successfully.
Jul 30 20:35:22 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-dbf0dcf9-f6b7-4636-b7e1-e122b9d681b9 tempest-VolumesSnapshotTestJSON-153537947 None] Lock "cinder-9b9d5509-33d0-47d8-bcc8-5fa642fb62dc-delete_snapshot" released by "delete_snapshot" :: held 2.293s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:35:22 devstack sudo[102996]: pam_unix(sudo:session): session closed for user root
Jul 30 20:35:22 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f6972949-b720-4058-af61-ed857d26df34 tempest-ProjectReaderTests-1678794570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.294s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:35:22 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-f6972949-b720-4058-af61-ed857d26df34 tempest-ProjectReaderTests-1678794570 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:35:22 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-f6972949-b720-4058-af61-ed857d26df34 tempest-ProjectReaderTests-1678794570 None] Deleted volume successfully.
Jul 30 20:35:22 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-f6972949-b720-4058-af61-ed857d26df34 tempest-ProjectReaderTests-1678794570 None] Lock "cinder-192fe2bd-b829-4d1a-8206-f2b4d4dde385-delete_volume" released by "delete_volume" :: held 1.629s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:35:23 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8e82885-6846-4f8c-9b3a-6bfda02140c7 tempest-ProjectReaderTests-1678794570 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:35:23 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-b8e82885-6846-4f8c-9b3a-6bfda02140c7 tempest-ProjectReaderTests-1678794570 None] Flow 'volume_create_manager' (bc3341ed-a6e5-4d97-a96d-2148d86db7f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:35:23 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-b8e82885-6846-4f8c-9b3a-6bfda02140c7 tempest-ProjectReaderTests-1678794570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37354144-9db7-4a0a-90e6-d295ff3947f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:35:23 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-b8e82885-6846-4f8c-9b3a-6bfda02140c7 tempest-ProjectReaderTests-1678794570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37354144-9db7-4a0a-90e6-d295ff3947f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:35:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1960036192',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3208f76b-1517-47b6-b3a8-50e84fad2341,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c312b3916a84681800229f4dbad5ed8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:35:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:35:24Z,use_quota=True,user_id='1772aff9b9fd4d4bb9ce25f6b8f41b31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:35:23 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-b8e82885-6846-4f8c-9b3a-6bfda02140c7 tempest-ProjectReaderTests-1678794570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce4d91df-9906-4404-b533-ceb5ef144ee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:35:23 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-b8e82885-6846-4f8c-9b3a-6bfda02140c7 tempest-ProjectReaderTests-1678794570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce4d91df-9906-4404-b533-ceb5ef144ee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:35:23 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-b8e82885-6846-4f8c-9b3a-6bfda02140c7 tempest-ProjectReaderTests-1678794570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (434009b6-2e00-4eaf-9982-d9137fb4a1ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:35:23 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-b8e82885-6846-4f8c-9b3a-6bfda02140c7 tempest-ProjectReaderTests-1678794570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (434009b6-2e00-4eaf-9982-d9137fb4a1ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3208f76b-1517-47b6-b3a8-50e84fad2341', 'volume_name': 'volume-3208f76b-1517-47b6-b3a8-50e84fad2341', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:35:23 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-b8e82885-6846-4f8c-9b3a-6bfda02140c7 tempest-ProjectReaderTests-1678794570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b595276-6ff7-449f-aae5-f224113b2b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:35:23 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-b8e82885-6846-4f8c-9b3a-6bfda02140c7 tempest-ProjectReaderTests-1678794570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b595276-6ff7-449f-aae5-f224113b2b76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:35:23 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-b8e82885-6846-4f8c-9b3a-6bfda02140c7 tempest-ProjectReaderTests-1678794570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ceb55f8-8cb1-4094-8c8c-e4506a3bebce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:35:23 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-b8e82885-6846-4f8c-9b3a-6bfda02140c7 tempest-ProjectReaderTests-1678794570 None] Volume 3208f76b-1517-47b6-b3a8-50e84fad2341: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3208f76b-1517-47b6-b3a8-50e84fad2341', 'volume_size': 1}
Jul 30 20:35:23 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-b8e82885-6846-4f8c-9b3a-6bfda02140c7 tempest-ProjectReaderTests-1678794570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:35:23 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-b8e82885-6846-4f8c-9b3a-6bfda02140c7 tempest-ProjectReaderTests-1678794570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:35:23 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-b8e82885-6846-4f8c-9b3a-6bfda02140c7 tempest-ProjectReaderTests-1678794570 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:35:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1960036192',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3208f76b-1517-47b6-b3a8-50e84fad2341,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c312b3916a84681800229f4dbad5ed8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:35:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:35:24Z,use_quota=True,user_id='1772aff9b9fd4d4bb9ce25f6b8f41b31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:35:23 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-b8e82885-6846-4f8c-9b3a-6bfda02140c7 tempest-ProjectReaderTests-1678794570 None] Creating volume 3208f76b-1517-47b6-b3a8-50e84fad2341 {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:35:23 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-b8e82885-6846-4f8c-9b3a-6bfda02140c7 tempest-ProjectReaderTests-1678794570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:35:23 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-b8e82885-6846-4f8c-9b3a-6bfda02140c7 tempest-ProjectReaderTests-1678794570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:35:23 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-b8e82885-6846-4f8c-9b3a-6bfda02140c7 tempest-ProjectReaderTests-1678794570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:35:23 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-b8e82885-6846-4f8c-9b3a-6bfda02140c7 tempest-ProjectReaderTests-1678794570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:35:23 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-b8e82885-6846-4f8c-9b3a-6bfda02140c7 tempest-ProjectReaderTests-1678794570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:35:23 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-b8e82885-6846-4f8c-9b3a-6bfda02140c7 tempest-ProjectReaderTests-1678794570 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:35:23 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-b8e82885-6846-4f8c-9b3a-6bfda02140c7 tempest-ProjectReaderTests-1678794570 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:35:23 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-b8e82885-6846-4f8c-9b3a-6bfda02140c7 tempest-ProjectReaderTests-1678794570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3208f76b-1517-47b6-b3a8-50e84fad2341 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:35:23 devstack sudo[103000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3208f76b-1517-47b6-b3a8-50e84fad2341 1073741824
Jul 30 20:35:23 devstack sudo[103000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:35:24 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-19dead7b-e583-4a00-8e09-4b4d9fb14bd7 tempest-VolumesSnapshotTestJSON-153537947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:35:24 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-19dead7b-e583-4a00-8e09-4b4d9fb14bd7 tempest-VolumesSnapshotTestJSON-153537947 None] Flow 'volume_create_manager' (2120b0cd-3586-429a-a22d-98feff6f6541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:35:24 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-19dead7b-e583-4a00-8e09-4b4d9fb14bd7 tempest-VolumesSnapshotTestJSON-153537947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd020a6a-52df-4e20-8e9b-549b1512d897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:35:24 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-19dead7b-e583-4a00-8e09-4b4d9fb14bd7 tempest-VolumesSnapshotTestJSON-153537947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd020a6a-52df-4e20-8e9b-549b1512d897) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:35:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-437693420',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3244c8c6-c46a-4200-8c23-9bedb61ad324,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4db6b3c17c704eb591bba88684c77cbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:35:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:35:24Z,use_quota=True,user_id='de69dd69544b4eb7af712d3a4bfb8c4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:35:24 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-19dead7b-e583-4a00-8e09-4b4d9fb14bd7 tempest-VolumesSnapshotTestJSON-153537947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d37c87b7-3a22-4487-885b-eef2aa4d5f58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:35:24 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-19dead7b-e583-4a00-8e09-4b4d9fb14bd7 tempest-VolumesSnapshotTestJSON-153537947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d37c87b7-3a22-4487-885b-eef2aa4d5f58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:35:24 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-19dead7b-e583-4a00-8e09-4b4d9fb14bd7 tempest-VolumesSnapshotTestJSON-153537947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (763d8f39-cce4-47d3-b7eb-61ad239f9e05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:35:24 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-19dead7b-e583-4a00-8e09-4b4d9fb14bd7 tempest-VolumesSnapshotTestJSON-153537947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (763d8f39-cce4-47d3-b7eb-61ad239f9e05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3244c8c6-c46a-4200-8c23-9bedb61ad324', 'volume_name': 'volume-3244c8c6-c46a-4200-8c23-9bedb61ad324', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:35:24 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-19dead7b-e583-4a00-8e09-4b4d9fb14bd7 tempest-VolumesSnapshotTestJSON-153537947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9df69ed5-2110-4570-bf4f-746749b7b9b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:35:24 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-19dead7b-e583-4a00-8e09-4b4d9fb14bd7 tempest-VolumesSnapshotTestJSON-153537947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9df69ed5-2110-4570-bf4f-746749b7b9b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:35:24 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-19dead7b-e583-4a00-8e09-4b4d9fb14bd7 tempest-VolumesSnapshotTestJSON-153537947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9287f453-da20-4ef3-9254-7327e89d273a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:35:24 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-19dead7b-e583-4a00-8e09-4b4d9fb14bd7 tempest-VolumesSnapshotTestJSON-153537947 None] Volume 3244c8c6-c46a-4200-8c23-9bedb61ad324: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3244c8c6-c46a-4200-8c23-9bedb61ad324', 'volume_size': 1}
Jul 30 20:35:24 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-19dead7b-e583-4a00-8e09-4b4d9fb14bd7 tempest-VolumesSnapshotTestJSON-153537947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:35:24 devstack sudo[103000]: pam_unix(sudo:session): session closed for user root
Jul 30 20:35:24 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-b8e82885-6846-4f8c-9b3a-6bfda02140c7 tempest-ProjectReaderTests-1678794570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3208f76b-1517-47b6-b3a8-50e84fad2341 1073741824" returned: 0 in 0.597s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:35:24 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-b8e82885-6846-4f8c-9b3a-6bfda02140c7 tempest-ProjectReaderTests-1678794570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3208f76b-1517-47b6-b3a8-50e84fad2341 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:35:24 devstack sudo[103006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3208f76b-1517-47b6-b3a8-50e84fad2341
Jul 30 20:35:24 devstack sudo[103006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:35:24 devstack sudo[103006]: pam_unix(sudo:session): session closed for user root
Jul 30 20:35:24 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-b8e82885-6846-4f8c-9b3a-6bfda02140c7 tempest-ProjectReaderTests-1678794570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3208f76b-1517-47b6-b3a8-50e84fad2341" returned: 0 in 0.277s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:35:24 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-b8e82885-6846-4f8c-9b3a-6bfda02140c7 tempest-ProjectReaderTests-1678794570 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:35:24 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-b8e82885-6846-4f8c-9b3a-6bfda02140c7 tempest-ProjectReaderTests-1678794570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:35:24 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-19dead7b-e583-4a00-8e09-4b4d9fb14bd7 tempest-VolumesSnapshotTestJSON-153537947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.468s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:35:24 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-19dead7b-e583-4a00-8e09-4b4d9fb14bd7 tempest-VolumesSnapshotTestJSON-153537947 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:35:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-437693420',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3244c8c6-c46a-4200-8c23-9bedb61ad324,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4db6b3c17c704eb591bba88684c77cbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:35:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:35:24Z,use_quota=True,user_id='de69dd69544b4eb7af712d3a4bfb8c4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:35:24 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-19dead7b-e583-4a00-8e09-4b4d9fb14bd7 tempest-VolumesSnapshotTestJSON-153537947 None] Creating volume 3244c8c6-c46a-4200-8c23-9bedb61ad324 {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:35:24 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-19dead7b-e583-4a00-8e09-4b4d9fb14bd7 tempest-VolumesSnapshotTestJSON-153537947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:35:24 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-19dead7b-e583-4a00-8e09-4b4d9fb14bd7 tempest-VolumesSnapshotTestJSON-153537947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:35:24 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-19dead7b-e583-4a00-8e09-4b4d9fb14bd7 tempest-VolumesSnapshotTestJSON-153537947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:35:24 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-19dead7b-e583-4a00-8e09-4b4d9fb14bd7 tempest-VolumesSnapshotTestJSON-153537947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:35:24 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-19dead7b-e583-4a00-8e09-4b4d9fb14bd7 tempest-VolumesSnapshotTestJSON-153537947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:35:24 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-19dead7b-e583-4a00-8e09-4b4d9fb14bd7 tempest-VolumesSnapshotTestJSON-153537947 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:35:24 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-19dead7b-e583-4a00-8e09-4b4d9fb14bd7 tempest-VolumesSnapshotTestJSON-153537947 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:35:24 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-19dead7b-e583-4a00-8e09-4b4d9fb14bd7 tempest-VolumesSnapshotTestJSON-153537947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3244c8c6-c46a-4200-8c23-9bedb61ad324 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:35:24 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-b8e82885-6846-4f8c-9b3a-6bfda02140c7 tempest-ProjectReaderTests-1678794570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ceb55f8-8cb1-4094-8c8c-e4506a3bebce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3208f76b-1517-47b6-b3a8-50e84fad2341', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:35:24 devstack sudo[103010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3244c8c6-c46a-4200-8c23-9bedb61ad324 1073741824
Jul 30 20:35:24 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-b8e82885-6846-4f8c-9b3a-6bfda02140c7 tempest-ProjectReaderTests-1678794570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6f06c95-a5bd-4033-bea4-dc026ee0b8c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:35:24 devstack sudo[103010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:35:24 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-b8e82885-6846-4f8c-9b3a-6bfda02140c7 tempest-ProjectReaderTests-1678794570 None] Volume volume-3208f76b-1517-47b6-b3a8-50e84fad2341 (3208f76b-1517-47b6-b3a8-50e84fad2341): created successfully
Jul 30 20:35:24 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-b8e82885-6846-4f8c-9b3a-6bfda02140c7 tempest-ProjectReaderTests-1678794570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6f06c95-a5bd-4033-bea4-dc026ee0b8c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:35:24 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-b8e82885-6846-4f8c-9b3a-6bfda02140c7 tempest-ProjectReaderTests-1678794570 None] Flow 'volume_create_manager' (bc3341ed-a6e5-4d97-a96d-2148d86db7f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:35:24 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-b8e82885-6846-4f8c-9b3a-6bfda02140c7 tempest-ProjectReaderTests-1678794570 None] Created volume successfully.
Jul 30 20:35:25 devstack sudo[103010]: pam_unix(sudo:session): session closed for user root
Jul 30 20:35:25 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-19dead7b-e583-4a00-8e09-4b4d9fb14bd7 tempest-VolumesSnapshotTestJSON-153537947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3244c8c6-c46a-4200-8c23-9bedb61ad324 1073741824" returned: 0 in 0.486s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:35:25 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-19dead7b-e583-4a00-8e09-4b4d9fb14bd7 tempest-VolumesSnapshotTestJSON-153537947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3244c8c6-c46a-4200-8c23-9bedb61ad324 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:35:25 devstack sudo[103017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3244c8c6-c46a-4200-8c23-9bedb61ad324
Jul 30 20:35:25 devstack sudo[103017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:35:25 devstack sudo[103017]: pam_unix(sudo:session): session closed for user root
Jul 30 20:35:25 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-19dead7b-e583-4a00-8e09-4b4d9fb14bd7 tempest-VolumesSnapshotTestJSON-153537947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3244c8c6-c46a-4200-8c23-9bedb61ad324" returned: 0 in 0.243s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:35:25 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-19dead7b-e583-4a00-8e09-4b4d9fb14bd7 tempest-VolumesSnapshotTestJSON-153537947 None] <== create_volume: return (769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:35:25 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-19dead7b-e583-4a00-8e09-4b4d9fb14bd7 tempest-VolumesSnapshotTestJSON-153537947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.771s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:35:25 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-19dead7b-e583-4a00-8e09-4b4d9fb14bd7 tempest-VolumesSnapshotTestJSON-153537947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9287f453-da20-4ef3-9254-7327e89d273a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3244c8c6-c46a-4200-8c23-9bedb61ad324', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:35:25 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-19dead7b-e583-4a00-8e09-4b4d9fb14bd7 tempest-VolumesSnapshotTestJSON-153537947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77ce6bad-a3ab-4de1-b5f2-b517f02293ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:35:25 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-19dead7b-e583-4a00-8e09-4b4d9fb14bd7 tempest-VolumesSnapshotTestJSON-153537947 None] Volume volume-3244c8c6-c46a-4200-8c23-9bedb61ad324 (3244c8c6-c46a-4200-8c23-9bedb61ad324): created successfully
Jul 30 20:35:25 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-19dead7b-e583-4a00-8e09-4b4d9fb14bd7 tempest-VolumesSnapshotTestJSON-153537947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77ce6bad-a3ab-4de1-b5f2-b517f02293ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:35:25 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-19dead7b-e583-4a00-8e09-4b4d9fb14bd7 tempest-VolumesSnapshotTestJSON-153537947 None] Flow 'volume_create_manager' (2120b0cd-3586-429a-a22d-98feff6f6541) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:35:25 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-19dead7b-e583-4a00-8e09-4b4d9fb14bd7 tempest-VolumesSnapshotTestJSON-153537947 None] Created volume successfully.
Jul 30 20:35:25 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-21b43c36-029f-48fc-93ed-ba346afcd3b2 tempest-ProjectReaderTests-1678794570 None] Acquiring lock "cinder-3208f76b-1517-47b6-b3a8-50e84fad2341-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:35:25 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-21b43c36-029f-48fc-93ed-ba346afcd3b2 tempest-ProjectReaderTests-1678794570 None] Lock "cinder-3208f76b-1517-47b6-b3a8-50e84fad2341-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:35:25 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-21b43c36-029f-48fc-93ed-ba346afcd3b2 tempest-ProjectReaderTests-1678794570 None] Acquiring lock "cinder-quobyte-3208f76b-1517-47b6-b3a8-50e84fad2341" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:35:26 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-21b43c36-029f-48fc-93ed-ba346afcd3b2 tempest-ProjectReaderTests-1678794570 None] Lock "cinder-quobyte-3208f76b-1517-47b6-b3a8-50e84fad2341" acquired by "delete_volume" :: waited 0.016s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:35:26 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c40367e-3b17-495c-a36a-6ffb7ed1d1cd]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:35:26 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-21b43c36-029f-48fc-93ed-ba346afcd3b2 tempest-ProjectReaderTests-1678794570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3208f76b-1517-47b6-b3a8-50e84fad2341 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:35:26 devstack sudo[103020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3208f76b-1517-47b6-b3a8-50e84fad2341
Jul 30 20:35:26 devstack sudo[103020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:35:26 devstack sudo[103020]: pam_unix(sudo:session): session closed for user root
Jul 30 20:35:26 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-21b43c36-029f-48fc-93ed-ba346afcd3b2 tempest-ProjectReaderTests-1678794570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3208f76b-1517-47b6-b3a8-50e84fad2341" returned: 0 in 0.429s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:35:26 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-21b43c36-029f-48fc-93ed-ba346afcd3b2 tempest-ProjectReaderTests-1678794570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3208f76b-1517-47b6-b3a8-50e84fad2341 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:35:26 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-85a3b854-5bc3-4bad-86bc-c2eccb91b76b tempest-VolumesSnapshotTestJSON-153537947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:35:26 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-85a3b854-5bc3-4bad-86bc-c2eccb91b76b tempest-VolumesSnapshotTestJSON-153537947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:35:26 devstack sudo[103026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3208f76b-1517-47b6-b3a8-50e84fad2341
Jul 30 20:35:26 devstack sudo[103026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:35:26 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-85a3b854-5bc3-4bad-86bc-c2eccb91b76b tempest-VolumesSnapshotTestJSON-153537947 None] Creating offline snapshot b21f7edd-ba2f-44b7-8065-8aa59fab3611 of volume 3244c8c6-c46a-4200-8c23-9bedb61ad324 {{(pid=88719) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 30 20:35:26 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d0d0d9f-48f7-4a63-a03b-50c461f8511a]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:35:26 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-85a3b854-5bc3-4bad-86bc-c2eccb91b76b tempest-VolumesSnapshotTestJSON-153537947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3244c8c6-c46a-4200-8c23-9bedb61ad324 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:35:26 devstack sudo[103028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3244c8c6-c46a-4200-8c23-9bedb61ad324
Jul 30 20:35:26 devstack sudo[103028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:35:26 devstack sudo[103026]: pam_unix(sudo:session): session closed for user root
Jul 30 20:35:26 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-21b43c36-029f-48fc-93ed-ba346afcd3b2 tempest-ProjectReaderTests-1678794570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3208f76b-1517-47b6-b3a8-50e84fad2341" returned: 0 in 0.267s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:35:26 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-21b43c36-029f-48fc-93ed-ba346afcd3b2 tempest-ProjectReaderTests-1678794570 None] Lock "cinder-quobyte-3208f76b-1517-47b6-b3a8-50e84fad2341" released by "delete_volume" :: held 0.739s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:35:26 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-21b43c36-029f-48fc-93ed-ba346afcd3b2 tempest-ProjectReaderTests-1678794570 None] Created reservations ['587be220-e27b-420e-a3e6-6615de9e8673', 'a00d23bd-9681-4288-8a37-2ce1bafff0e9', '7eea29b5-46ca-4214-a2f0-2503be0945f4', 'fe8f33cd-4f46-4a1c-9654-6097451af2a9'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:35:26 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-21b43c36-029f-48fc-93ed-ba346afcd3b2 tempest-ProjectReaderTests-1678794570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:35:26 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-21b43c36-029f-48fc-93ed-ba346afcd3b2 tempest-ProjectReaderTests-1678794570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:35:26 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-21b43c36-029f-48fc-93ed-ba346afcd3b2 tempest-ProjectReaderTests-1678794570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:35:26 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-21b43c36-029f-48fc-93ed-ba346afcd3b2 tempest-ProjectReaderTests-1678794570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:35:26 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-21b43c36-029f-48fc-93ed-ba346afcd3b2 tempest-ProjectReaderTests-1678794570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:35:26 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-21b43c36-029f-48fc-93ed-ba346afcd3b2 tempest-ProjectReaderTests-1678794570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:35:26 devstack sudo[103033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:35:26 devstack sudo[103033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:35:26 devstack sudo[103028]: pam_unix(sudo:session): session closed for user root
Jul 30 20:35:26 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-85a3b854-5bc3-4bad-86bc-c2eccb91b76b tempest-VolumesSnapshotTestJSON-153537947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3244c8c6-c46a-4200-8c23-9bedb61ad324" returned: 0 in 0.399s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:35:26 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-85a3b854-5bc3-4bad-86bc-c2eccb91b76b tempest-VolumesSnapshotTestJSON-153537947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3244c8c6-c46a-4200-8c23-9bedb61ad324,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3244c8c6-c46a-4200-8c23-9bedb61ad324.b21f7edd-ba2f-44b7-8065-8aa59fab3611 1G {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:35:26 devstack sudo[103036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3244c8c6-c46a-4200-8c23-9bedb61ad324,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3244c8c6-c46a-4200-8c23-9bedb61ad324.b21f7edd-ba2f-44b7-8065-8aa59fab3611 1G
Jul 30 20:35:26 devstack sudo[103036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:35:27 devstack sudo[103033]: pam_unix(sudo:session): session closed for user root
Jul 30 20:35:27 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-21b43c36-029f-48fc-93ed-ba346afcd3b2 tempest-ProjectReaderTests-1678794570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.289s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:35:27 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-21b43c36-029f-48fc-93ed-ba346afcd3b2 tempest-ProjectReaderTests-1678794570 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:35:27 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-21b43c36-029f-48fc-93ed-ba346afcd3b2 tempest-ProjectReaderTests-1678794570 None] Deleted volume successfully.
Jul 30 20:35:27 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-21b43c36-029f-48fc-93ed-ba346afcd3b2 tempest-ProjectReaderTests-1678794570 None] Lock "cinder-3208f76b-1517-47b6-b3a8-50e84fad2341-delete_volume" released by "delete_volume" :: held 1.279s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:35:27 devstack sudo[103036]: pam_unix(sudo:session): session closed for user root
Jul 30 20:35:27 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-85a3b854-5bc3-4bad-86bc-c2eccb91b76b tempest-VolumesSnapshotTestJSON-153537947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3244c8c6-c46a-4200-8c23-9bedb61ad324,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3244c8c6-c46a-4200-8c23-9bedb61ad324.b21f7edd-ba2f-44b7-8065-8aa59fab3611 1G" returned: 0 in 0.540s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:35:27 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-85a3b854-5bc3-4bad-86bc-c2eccb91b76b tempest-VolumesSnapshotTestJSON-153537947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3244c8c6-c46a-4200-8c23-9bedb61ad324 -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3244c8c6-c46a-4200-8c23-9bedb61ad324.b21f7edd-ba2f-44b7-8065-8aa59fab3611 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:35:27 devstack sudo[103042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3244c8c6-c46a-4200-8c23-9bedb61ad324 -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3244c8c6-c46a-4200-8c23-9bedb61ad324.b21f7edd-ba2f-44b7-8065-8aa59fab3611
Jul 30 20:35:27 devstack sudo[103042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:35:27 devstack sudo[103042]: pam_unix(sudo:session): session closed for user root
Jul 30 20:35:27 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-85a3b854-5bc3-4bad-86bc-c2eccb91b76b tempest-VolumesSnapshotTestJSON-153537947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3244c8c6-c46a-4200-8c23-9bedb61ad324 -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3244c8c6-c46a-4200-8c23-9bedb61ad324.b21f7edd-ba2f-44b7-8065-8aa59fab3611" returned: 0 in 0.335s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:35:27 devstack cinder-volume[88719]: WARNING cinder.volume.drivers.remotefs [None req-85a3b854-5bc3-4bad-86bc-c2eccb91b76b tempest-VolumesSnapshotTestJSON-153537947 None] /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3244c8c6-c46a-4200-8c23-9bedb61ad324.b21f7edd-ba2f-44b7-8065-8aa59fab3611 is being set with open permissions: ugo+rw
Jul 30 20:35:27 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-85a3b854-5bc3-4bad-86bc-c2eccb91b76b tempest-VolumesSnapshotTestJSON-153537947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3244c8c6-c46a-4200-8c23-9bedb61ad324.b21f7edd-ba2f-44b7-8065-8aa59fab3611 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:35:27 devstack sudo[103047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3244c8c6-c46a-4200-8c23-9bedb61ad324.b21f7edd-ba2f-44b7-8065-8aa59fab3611
Jul 30 20:35:27 devstack sudo[103047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:35:28 devstack sudo[103047]: pam_unix(sudo:session): session closed for user root
Jul 30 20:35:28 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-85a3b854-5bc3-4bad-86bc-c2eccb91b76b tempest-VolumesSnapshotTestJSON-153537947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3244c8c6-c46a-4200-8c23-9bedb61ad324.b21f7edd-ba2f-44b7-8065-8aa59fab3611" returned: 0 in 0.337s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:35:28 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-85a3b854-5bc3-4bad-86bc-c2eccb91b76b tempest-VolumesSnapshotTestJSON-153537947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3244c8c6-c46a-4200-8c23-9bedb61ad324.info {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:35:28 devstack sudo[103050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3244c8c6-c46a-4200-8c23-9bedb61ad324.info
Jul 30 20:35:28 devstack sudo[103050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:35:28 devstack sudo[103050]: pam_unix(sudo:session): session closed for user root
Jul 30 20:35:28 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-85a3b854-5bc3-4bad-86bc-c2eccb91b76b tempest-VolumesSnapshotTestJSON-153537947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3244c8c6-c46a-4200-8c23-9bedb61ad324.info" returned: 0 in 0.319s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:35:28 devstack cinder-volume[88719]: WARNING cinder.volume.drivers.remotefs [None req-85a3b854-5bc3-4bad-86bc-c2eccb91b76b tempest-VolumesSnapshotTestJSON-153537947 None] /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3244c8c6-c46a-4200-8c23-9bedb61ad324.info is being set with open permissions: ugo+rw
Jul 30 20:35:28 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-85a3b854-5bc3-4bad-86bc-c2eccb91b76b tempest-VolumesSnapshotTestJSON-153537947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3244c8c6-c46a-4200-8c23-9bedb61ad324.info {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:35:28 devstack sudo[103053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3244c8c6-c46a-4200-8c23-9bedb61ad324.info
Jul 30 20:35:28 devstack sudo[103053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:35:28 devstack sudo[103053]: pam_unix(sudo:session): session closed for user root
Jul 30 20:35:28 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-85a3b854-5bc3-4bad-86bc-c2eccb91b76b tempest-VolumesSnapshotTestJSON-153537947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3244c8c6-c46a-4200-8c23-9bedb61ad324.info" returned: 0 in 0.320s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:35:28 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-85a3b854-5bc3-4bad-86bc-c2eccb91b76b tempest-VolumesSnapshotTestJSON-153537947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.379s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:35:28 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-85a3b854-5bc3-4bad-86bc-c2eccb91b76b tempest-VolumesSnapshotTestJSON-153537947 None] Create snapshot completed successfully
Jul 30 20:35:30 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e5daf68-6b5d-4d37-881b-f5f136664426 tempest-VolumesSnapshotTestJSON-153537947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:35:30 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-8e5daf68-6b5d-4d37-881b-f5f136664426 tempest-VolumesSnapshotTestJSON-153537947 None] Flow 'volume_create_manager' (5243b8ce-5ae5-442f-9618-cce5a404b213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:35:30 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-8e5daf68-6b5d-4d37-881b-f5f136664426 tempest-VolumesSnapshotTestJSON-153537947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7af2789b-3be2-4285-a4b1-f8c86cc6f6be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:35:30 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-8e5daf68-6b5d-4d37-881b-f5f136664426 tempest-VolumesSnapshotTestJSON-153537947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7af2789b-3be2-4285-a4b1-f8c86cc6f6be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:35:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1653641845',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecf337d6-5186-4aab-a8bf-baf20424fb61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4db6b3c17c704eb591bba88684c77cbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:35:30Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=b21f7edd-ba2f-44b7-8065-8aa59fab3611,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:35:30Z,use_quota=True,user_id='de69dd69544b4eb7af712d3a4bfb8c4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:35:30 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-8e5daf68-6b5d-4d37-881b-f5f136664426 tempest-VolumesSnapshotTestJSON-153537947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9731e9b-549b-4158-be11-12a5d305705e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:35:30 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-8e5daf68-6b5d-4d37-881b-f5f136664426 tempest-VolumesSnapshotTestJSON-153537947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9731e9b-549b-4158-be11-12a5d305705e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:35:30 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-8e5daf68-6b5d-4d37-881b-f5f136664426 tempest-VolumesSnapshotTestJSON-153537947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ecd3ee8-b309-49ae-a9f6-bfef6cd1c73d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:35:30 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-8e5daf68-6b5d-4d37-881b-f5f136664426 tempest-VolumesSnapshotTestJSON-153537947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ecd3ee8-b309-49ae-a9f6-bfef6cd1c73d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ecf337d6-5186-4aab-a8bf-baf20424fb61', 'volume_name': 'volume-ecf337d6-5186-4aab-a8bf-baf20424fb61', 'volume_size': 2, 'snapshot_id': 'b21f7edd-ba2f-44b7-8065-8aa59fab3611'}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:35:30 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-8e5daf68-6b5d-4d37-881b-f5f136664426 tempest-VolumesSnapshotTestJSON-153537947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed2061b4-be6f-4cd3-88b9-bb35f63e5e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:35:30 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-8e5daf68-6b5d-4d37-881b-f5f136664426 tempest-VolumesSnapshotTestJSON-153537947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed2061b4-be6f-4cd3-88b9-bb35f63e5e60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:35:30 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-8e5daf68-6b5d-4d37-881b-f5f136664426 tempest-VolumesSnapshotTestJSON-153537947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d235574b-ac3d-4c8c-adde-4d68c57c24c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:35:30 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-8e5daf68-6b5d-4d37-881b-f5f136664426 tempest-VolumesSnapshotTestJSON-153537947 None] Volume ecf337d6-5186-4aab-a8bf-baf20424fb61: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ecf337d6-5186-4aab-a8bf-baf20424fb61', 'volume_size': 2, 'snapshot_id': 'b21f7edd-ba2f-44b7-8065-8aa59fab3611'}
Jul 30 20:35:30 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-8e5daf68-6b5d-4d37-881b-f5f136664426 tempest-VolumesSnapshotTestJSON-153537947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:35:30 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-8e5daf68-6b5d-4d37-881b-f5f136664426 tempest-VolumesSnapshotTestJSON-153537947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:35:30 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-8e5daf68-6b5d-4d37-881b-f5f136664426 tempest-VolumesSnapshotTestJSON-153537947 None] Acquiring lock "cinder-quobyte-b21f7edd-ba2f-44b7-8065-8aa59fab3611-ecf337d6-5186-4aab-a8bf-baf20424fb61" by "_create_volume_from_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:35:30 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-8e5daf68-6b5d-4d37-881b-f5f136664426 tempest-VolumesSnapshotTestJSON-153537947 None] Lock "cinder-quobyte-b21f7edd-ba2f-44b7-8065-8aa59fab3611-ecf337d6-5186-4aab-a8bf-baf20424fb61" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:35:30 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-8e5daf68-6b5d-4d37-881b-f5f136664426 tempest-VolumesSnapshotTestJSON-153537947 None] Creating volume ecf337d6-5186-4aab-a8bf-baf20424fb61 from snapshot b21f7edd-ba2f-44b7-8065-8aa59fab3611 {{(pid=88719) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Jul 30 20:35:30 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-8e5daf68-6b5d-4d37-881b-f5f136664426 tempest-VolumesSnapshotTestJSON-153537947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:35:30 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-8e5daf68-6b5d-4d37-881b-f5f136664426 tempest-VolumesSnapshotTestJSON-153537947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:35:30 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-8e5daf68-6b5d-4d37-881b-f5f136664426 tempest-VolumesSnapshotTestJSON-153537947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:35:30 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-8e5daf68-6b5d-4d37-881b-f5f136664426 tempest-VolumesSnapshotTestJSON-153537947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:35:30 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-8e5daf68-6b5d-4d37-881b-f5f136664426 tempest-VolumesSnapshotTestJSON-153537947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:35:30 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-8e5daf68-6b5d-4d37-881b-f5f136664426 tempest-VolumesSnapshotTestJSON-153537947 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:35:30 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-8e5daf68-6b5d-4d37-881b-f5f136664426 tempest-VolumesSnapshotTestJSON-153537947 None] Acquiring lock "cinder-quobyte-ecf337d6-5186-4aab-a8bf-baf20424fb61" by "_copy_volume_from_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:35:30 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-8e5daf68-6b5d-4d37-881b-f5f136664426 tempest-VolumesSnapshotTestJSON-153537947 None] Lock "cinder-quobyte-ecf337d6-5186-4aab-a8bf-baf20424fb61" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:35:30 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-8e5daf68-6b5d-4d37-881b-f5f136664426 tempest-VolumesSnapshotTestJSON-153537947 None] snapshot: b21f7edd-ba2f-44b7-8065-8aa59fab3611, volume: ecf337d6-5186-4aab-a8bf-baf20424fb61,  {{(pid=88719) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}}
Jul 30 20:35:30 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-8e5daf68-6b5d-4d37-881b-f5f136664426 tempest-VolumesSnapshotTestJSON-153537947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:35:30 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-8e5daf68-6b5d-4d37-881b-f5f136664426 tempest-VolumesSnapshotTestJSON-153537947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:35:30 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-8e5daf68-6b5d-4d37-881b-f5f136664426 tempest-VolumesSnapshotTestJSON-153537947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:35:30 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-8e5daf68-6b5d-4d37-881b-f5f136664426 tempest-VolumesSnapshotTestJSON-153537947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:35:30 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-8e5daf68-6b5d-4d37-881b-f5f136664426 tempest-VolumesSnapshotTestJSON-153537947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:35:30 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[783bba07-ad70-42a6-ad0a-b6224b7984e6]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:35:30 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8e5daf68-6b5d-4d37-881b-f5f136664426 tempest-VolumesSnapshotTestJSON-153537947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3244c8c6-c46a-4200-8c23-9bedb61ad324.b21f7edd-ba2f-44b7-8065-8aa59fab3611 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:35:30 devstack sudo[103057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3244c8c6-c46a-4200-8c23-9bedb61ad324.b21f7edd-ba2f-44b7-8065-8aa59fab3611
Jul 30 20:35:30 devstack sudo[103057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:35:30 devstack sudo[103057]: pam_unix(sudo:session): session closed for user root
Jul 30 20:35:30 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8e5daf68-6b5d-4d37-881b-f5f136664426 tempest-VolumesSnapshotTestJSON-153537947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3244c8c6-c46a-4200-8c23-9bedb61ad324.b21f7edd-ba2f-44b7-8065-8aa59fab3611" returned: 0 in 0.444s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:35:30 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-8e5daf68-6b5d-4d37-881b-f5f136664426 tempest-VolumesSnapshotTestJSON-153537947 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3244c8c6-c46a-4200-8c23-9bedb61ad324(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88719) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 30 20:35:30 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bdf24d2-3099-470f-ab89-989c6cd89f9b]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:35:30 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8e5daf68-6b5d-4d37-881b-f5f136664426 tempest-VolumesSnapshotTestJSON-153537947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3244c8c6-c46a-4200-8c23-9bedb61ad324 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:35:31 devstack sudo[103063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3244c8c6-c46a-4200-8c23-9bedb61ad324
Jul 30 20:35:31 devstack sudo[103063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:35:31 devstack sudo[103063]: pam_unix(sudo:session): session closed for user root
Jul 30 20:35:31 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8e5daf68-6b5d-4d37-881b-f5f136664426 tempest-VolumesSnapshotTestJSON-153537947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3244c8c6-c46a-4200-8c23-9bedb61ad324" returned: 0 in 0.407s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:35:31 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-8e5daf68-6b5d-4d37-881b-f5f136664426 tempest-VolumesSnapshotTestJSON-153537947 None] will copy from snapshot at /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3244c8c6-c46a-4200-8c23-9bedb61ad324 {{(pid=88719) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}}
Jul 30 20:35:31 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-8e5daf68-6b5d-4d37-881b-f5f136664426 tempest-VolumesSnapshotTestJSON-153537947 None] Creating direct copy from snapshot {{(pid=88719) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}}
Jul 30 20:35:31 devstack cinder-volume[88719]: DEBUG cinder.utils [None req-8e5daf68-6b5d-4d37-881b-f5f136664426 tempest-VolumesSnapshotTestJSON-153537947 None] Path /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-ecf337d6-5186-4aab-a8bf-baf20424fb61 not found in is_blk_device check {{(pid=88719) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 30 20:35:31 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8e5daf68-6b5d-4d37-881b-f5f136664426 tempest-VolumesSnapshotTestJSON-153537947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3244c8c6-c46a-4200-8c23-9bedb61ad324 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-ecf337d6-5186-4aab-a8bf-baf20424fb61 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:35:31 devstack sudo[103068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3244c8c6-c46a-4200-8c23-9bedb61ad324 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-ecf337d6-5186-4aab-a8bf-baf20424fb61
Jul 30 20:35:31 devstack sudo[103068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:35:36 devstack sudo[103068]: pam_unix(sudo:session): session closed for user root
Jul 30 20:35:36 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8e5daf68-6b5d-4d37-881b-f5f136664426 tempest-VolumesSnapshotTestJSON-153537947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3244c8c6-c46a-4200-8c23-9bedb61ad324 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-ecf337d6-5186-4aab-a8bf-baf20424fb61" returned: 0 in 5.017s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:35:36 devstack cinder-volume[88719]: DEBUG cinder.image.image_utils [None req-8e5daf68-6b5d-4d37-881b-f5f136664426 tempest-VolumesSnapshotTestJSON-153537947 None] Image conversion details: src /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3244c8c6-c46a-4200-8c23-9bedb61ad324, size 1024.00 MB, duration 5.02 sec, destination /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-ecf337d6-5186-4aab-a8bf-baf20424fb61 {{(pid=88719) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 30 20:35:36 devstack cinder-volume[88719]: INFO cinder.image.image_utils [None req-8e5daf68-6b5d-4d37-881b-f5f136664426 tempest-VolumesSnapshotTestJSON-153537947 None] Converted 1024.00 MB image at 204.04 MB/s
Jul 30 20:35:36 devstack cinder-volume[88719]: WARNING cinder.volume.drivers.remotefs [None req-8e5daf68-6b5d-4d37-881b-f5f136664426 tempest-VolumesSnapshotTestJSON-153537947 None] /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-ecf337d6-5186-4aab-a8bf-baf20424fb61 is being set with open permissions: ugo+rw
Jul 30 20:35:36 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8e5daf68-6b5d-4d37-881b-f5f136664426 tempest-VolumesSnapshotTestJSON-153537947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-ecf337d6-5186-4aab-a8bf-baf20424fb61 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:35:36 devstack sudo[103082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-ecf337d6-5186-4aab-a8bf-baf20424fb61
Jul 30 20:35:36 devstack sudo[103082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:35:36 devstack sudo[103082]: pam_unix(sudo:session): session closed for user root
Jul 30 20:35:36 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8e5daf68-6b5d-4d37-881b-f5f136664426 tempest-VolumesSnapshotTestJSON-153537947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-ecf337d6-5186-4aab-a8bf-baf20424fb61" returned: 0 in 0.261s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:35:36 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-8e5daf68-6b5d-4d37-881b-f5f136664426 tempest-VolumesSnapshotTestJSON-153537947 None] Lock "cinder-quobyte-ecf337d6-5186-4aab-a8bf-baf20424fb61" released by "_copy_volume_from_snapshot" :: held 6.240s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:35:36 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-8e5daf68-6b5d-4d37-881b-f5f136664426 tempest-VolumesSnapshotTestJSON-153537947 None] Lock "cinder-quobyte-b21f7edd-ba2f-44b7-8065-8aa59fab3611-ecf337d6-5186-4aab-a8bf-baf20424fb61" released by "_create_volume_from_snapshot" :: held 6.315s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:35:36 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-8e5daf68-6b5d-4d37-881b-f5f136664426 tempest-VolumesSnapshotTestJSON-153537947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.332s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:35:36 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-8e5daf68-6b5d-4d37-881b-f5f136664426 tempest-VolumesSnapshotTestJSON-153537947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d235574b-ac3d-4c8c-adde-4d68c57c24c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecf337d6-5186-4aab-a8bf-baf20424fb61', 'volume_size': 2, 'snapshot_id': 'b21f7edd-ba2f-44b7-8065-8aa59fab3611'}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:35:36 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-8e5daf68-6b5d-4d37-881b-f5f136664426 tempest-VolumesSnapshotTestJSON-153537947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f74d13a-cd6e-460d-9098-db0ace4ced39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:35:36 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-8e5daf68-6b5d-4d37-881b-f5f136664426 tempest-VolumesSnapshotTestJSON-153537947 None] Volume volume-ecf337d6-5186-4aab-a8bf-baf20424fb61 (ecf337d6-5186-4aab-a8bf-baf20424fb61): created successfully
Jul 30 20:35:36 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-8e5daf68-6b5d-4d37-881b-f5f136664426 tempest-VolumesSnapshotTestJSON-153537947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f74d13a-cd6e-460d-9098-db0ace4ced39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:35:36 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-8e5daf68-6b5d-4d37-881b-f5f136664426 tempest-VolumesSnapshotTestJSON-153537947 None] Flow 'volume_create_manager' (5243b8ce-5ae5-442f-9618-cce5a404b213) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:35:36 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-8e5daf68-6b5d-4d37-881b-f5f136664426 tempest-VolumesSnapshotTestJSON-153537947 None] Created volume successfully.
Jul 30 20:35:36 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-920cc399-2a17-4b8a-90d7-910f7891ee6d tempest-VolumesSnapshotTestJSON-153537947 None] Acquiring lock "cinder-ecf337d6-5186-4aab-a8bf-baf20424fb61-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:35:36 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-920cc399-2a17-4b8a-90d7-910f7891ee6d tempest-VolumesSnapshotTestJSON-153537947 None] Lock "cinder-ecf337d6-5186-4aab-a8bf-baf20424fb61-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:35:37 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-920cc399-2a17-4b8a-90d7-910f7891ee6d tempest-VolumesSnapshotTestJSON-153537947 None] Acquiring lock "cinder-quobyte-ecf337d6-5186-4aab-a8bf-baf20424fb61" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:35:37 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-920cc399-2a17-4b8a-90d7-910f7891ee6d tempest-VolumesSnapshotTestJSON-153537947 None] Lock "cinder-quobyte-ecf337d6-5186-4aab-a8bf-baf20424fb61" acquired by "delete_volume" :: waited 0.015s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:35:37 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4c2aafd-4ad8-4394-9b4f-f0fedaacef00]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:35:37 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-920cc399-2a17-4b8a-90d7-910f7891ee6d tempest-VolumesSnapshotTestJSON-153537947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-ecf337d6-5186-4aab-a8bf-baf20424fb61 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:35:37 devstack sudo[103089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-ecf337d6-5186-4aab-a8bf-baf20424fb61
Jul 30 20:35:37 devstack sudo[103089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:35:37 devstack sudo[103089]: pam_unix(sudo:session): session closed for user root
Jul 30 20:35:37 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-920cc399-2a17-4b8a-90d7-910f7891ee6d tempest-VolumesSnapshotTestJSON-153537947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-ecf337d6-5186-4aab-a8bf-baf20424fb61" returned: 0 in 0.435s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:35:37 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-920cc399-2a17-4b8a-90d7-910f7891ee6d tempest-VolumesSnapshotTestJSON-153537947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-ecf337d6-5186-4aab-a8bf-baf20424fb61 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:35:37 devstack sudo[103097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-ecf337d6-5186-4aab-a8bf-baf20424fb61
Jul 30 20:35:37 devstack sudo[103097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:35:37 devstack sudo[103097]: pam_unix(sudo:session): session closed for user root
Jul 30 20:35:37 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-920cc399-2a17-4b8a-90d7-910f7891ee6d tempest-VolumesSnapshotTestJSON-153537947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-ecf337d6-5186-4aab-a8bf-baf20424fb61" returned: 0 in 0.308s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:35:37 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-920cc399-2a17-4b8a-90d7-910f7891ee6d tempest-VolumesSnapshotTestJSON-153537947 None] Lock "cinder-quobyte-ecf337d6-5186-4aab-a8bf-baf20424fb61" released by "delete_volume" :: held 0.793s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:35:37 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-920cc399-2a17-4b8a-90d7-910f7891ee6d tempest-VolumesSnapshotTestJSON-153537947 None] Created reservations ['46ec4c5d-ec92-43cb-ad2e-924066eb2cfd', 'b3a66a0b-94a1-4263-a2fe-1f4f607f15f9', '270b382c-c4f8-4bd3-9136-681dc5cf4422', '83222279-8a04-4afc-8909-5adb871b4bc7'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:35:37 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-920cc399-2a17-4b8a-90d7-910f7891ee6d tempest-VolumesSnapshotTestJSON-153537947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:35:37 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-920cc399-2a17-4b8a-90d7-910f7891ee6d tempest-VolumesSnapshotTestJSON-153537947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:35:37 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-920cc399-2a17-4b8a-90d7-910f7891ee6d tempest-VolumesSnapshotTestJSON-153537947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:35:37 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-920cc399-2a17-4b8a-90d7-910f7891ee6d tempest-VolumesSnapshotTestJSON-153537947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:35:37 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-920cc399-2a17-4b8a-90d7-910f7891ee6d tempest-VolumesSnapshotTestJSON-153537947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:35:37 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-920cc399-2a17-4b8a-90d7-910f7891ee6d tempest-VolumesSnapshotTestJSON-153537947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:35:38 devstack sudo[103110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:35:38 devstack sudo[103110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:35:38 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [req-47dde5df-a72a-4e50-b6b2-c065ba088132 req-f135a423-4111-463a-b050-9efa675578f9 tempest-TestStampPattern-75201989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:35:38 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [req-47dde5df-a72a-4e50-b6b2-c065ba088132 req-f135a423-4111-463a-b050-9efa675578f9 tempest-TestStampPattern-75201989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:35:38 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [req-47dde5df-a72a-4e50-b6b2-c065ba088132 req-f135a423-4111-463a-b050-9efa675578f9 tempest-TestStampPattern-75201989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:35:38 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [req-47dde5df-a72a-4e50-b6b2-c065ba088132 req-f135a423-4111-463a-b050-9efa675578f9 tempest-TestStampPattern-75201989 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5', 'name': 'volume-0883c285-cc2b-4727-af60-5bb30a001719', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e4d3ba4c-99b4-43d4-a60e-81c523b46317', 'enforce_multipath': True} {{(pid=88719) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 30 20:35:38 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-02ff69b5-239b-41b0-afcb-6e4d9b55e55b tempest-VolumesSnapshotTestJSON-153537947 None] Acquiring lock "cinder-b21f7edd-ba2f-44b7-8065-8aa59fab3611-delete_snapshot" by "delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:35:38 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-02ff69b5-239b-41b0-afcb-6e4d9b55e55b tempest-VolumesSnapshotTestJSON-153537947 None] Lock "cinder-b21f7edd-ba2f-44b7-8065-8aa59fab3611-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:35:38 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-02ff69b5-239b-41b0-afcb-6e4d9b55e55b tempest-VolumesSnapshotTestJSON-153537947 None] Acquiring lock "cinder-quobyte-3244c8c6-c46a-4200-8c23-9bedb61ad324" by "delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:35:38 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-02ff69b5-239b-41b0-afcb-6e4d9b55e55b tempest-VolumesSnapshotTestJSON-153537947 None] Lock "cinder-quobyte-3244c8c6-c46a-4200-8c23-9bedb61ad324" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:35:38 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-02ff69b5-239b-41b0-afcb-6e4d9b55e55b tempest-VolumesSnapshotTestJSON-153537947 None] Acquiring lock "cinder-quobyte-b21f7edd-ba2f-44b7-8065-8aa59fab3611" by "_delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:35:38 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-02ff69b5-239b-41b0-afcb-6e4d9b55e55b tempest-VolumesSnapshotTestJSON-153537947 None] Lock "cinder-quobyte-b21f7edd-ba2f-44b7-8065-8aa59fab3611" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:35:38 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-02ff69b5-239b-41b0-afcb-6e4d9b55e55b tempest-VolumesSnapshotTestJSON-153537947 None] Deleting offline snapshot b21f7edd-ba2f-44b7-8065-8aa59fab3611 of volume 3244c8c6-c46a-4200-8c23-9bedb61ad324 {{(pid=88719) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 30 20:35:38 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-02ff69b5-239b-41b0-afcb-6e4d9b55e55b tempest-VolumesSnapshotTestJSON-153537947 None] snapshot_file for this snap is: volume-3244c8c6-c46a-4200-8c23-9bedb61ad324.b21f7edd-ba2f-44b7-8065-8aa59fab3611 {{(pid=88719) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 30 20:35:38 devstack cinder-volume[88719]: INFO cinder.volume.manager [req-47dde5df-a72a-4e50-b6b2-c065ba088132 req-f135a423-4111-463a-b050-9efa675578f9 tempest-TestStampPattern-75201989 None] attachment_update completed successfully.
Jul 30 20:35:38 devstack sudo[103110]: pam_unix(sudo:session): session closed for user root
Jul 30 20:35:38 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-920cc399-2a17-4b8a-90d7-910f7891ee6d tempest-VolumesSnapshotTestJSON-153537947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.343s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:35:38 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-920cc399-2a17-4b8a-90d7-910f7891ee6d tempest-VolumesSnapshotTestJSON-153537947 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:35:38 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[e261f1bc-6f57-4eb9-88c6-5938781fc66e]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:35:38 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-02ff69b5-239b-41b0-afcb-6e4d9b55e55b tempest-VolumesSnapshotTestJSON-153537947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3244c8c6-c46a-4200-8c23-9bedb61ad324.b21f7edd-ba2f-44b7-8065-8aa59fab3611 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:35:38 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-920cc399-2a17-4b8a-90d7-910f7891ee6d tempest-VolumesSnapshotTestJSON-153537947 None] Deleted volume successfully.
Jul 30 20:35:38 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-920cc399-2a17-4b8a-90d7-910f7891ee6d tempest-VolumesSnapshotTestJSON-153537947 None] Lock "cinder-ecf337d6-5186-4aab-a8bf-baf20424fb61-delete_volume" released by "delete_volume" :: held 1.389s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:35:38 devstack sudo[103113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3244c8c6-c46a-4200-8c23-9bedb61ad324.b21f7edd-ba2f-44b7-8065-8aa59fab3611
Jul 30 20:35:38 devstack sudo[103113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:35:38 devstack sudo[103113]: pam_unix(sudo:session): session closed for user root
Jul 30 20:35:38 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-02ff69b5-239b-41b0-afcb-6e4d9b55e55b tempest-VolumesSnapshotTestJSON-153537947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3244c8c6-c46a-4200-8c23-9bedb61ad324.b21f7edd-ba2f-44b7-8065-8aa59fab3611" returned: 0 in 0.453s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:35:38 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-02ff69b5-239b-41b0-afcb-6e4d9b55e55b tempest-VolumesSnapshotTestJSON-153537947 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3244c8c6-c46a-4200-8c23-9bedb61ad324(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88719) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 30 20:35:38 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[46f7473a-f0cb-4beb-8552-68edf936d4bc]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:35:38 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-02ff69b5-239b-41b0-afcb-6e4d9b55e55b tempest-VolumesSnapshotTestJSON-153537947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3244c8c6-c46a-4200-8c23-9bedb61ad324 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:35:38 devstack sudo[103502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3244c8c6-c46a-4200-8c23-9bedb61ad324
Jul 30 20:35:38 devstack sudo[103502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:35:39 devstack sudo[103502]: pam_unix(sudo:session): session closed for user root
Jul 30 20:35:39 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-02ff69b5-239b-41b0-afcb-6e4d9b55e55b tempest-VolumesSnapshotTestJSON-153537947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3244c8c6-c46a-4200-8c23-9bedb61ad324" returned: 0 in 0.612s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:35:39 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-02ff69b5-239b-41b0-afcb-6e4d9b55e55b tempest-VolumesSnapshotTestJSON-153537947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3244c8c6-c46a-4200-8c23-9bedb61ad324.b21f7edd-ba2f-44b7-8065-8aa59fab3611 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:35:39 devstack sudo[103508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3244c8c6-c46a-4200-8c23-9bedb61ad324.b21f7edd-ba2f-44b7-8065-8aa59fab3611
Jul 30 20:35:39 devstack sudo[103508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:35:39 devstack sudo[103508]: pam_unix(sudo:session): session closed for user root
Jul 30 20:35:39 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-02ff69b5-239b-41b0-afcb-6e4d9b55e55b tempest-VolumesSnapshotTestJSON-153537947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3244c8c6-c46a-4200-8c23-9bedb61ad324.b21f7edd-ba2f-44b7-8065-8aa59fab3611" returned: 0 in 0.354s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:35:39 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-02ff69b5-239b-41b0-afcb-6e4d9b55e55b tempest-VolumesSnapshotTestJSON-153537947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3244c8c6-c46a-4200-8c23-9bedb61ad324.b21f7edd-ba2f-44b7-8065-8aa59fab3611 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:35:39 devstack sudo[103514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3244c8c6-c46a-4200-8c23-9bedb61ad324.b21f7edd-ba2f-44b7-8065-8aa59fab3611
Jul 30 20:35:39 devstack sudo[103514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:35:40 devstack sudo[103514]: pam_unix(sudo:session): session closed for user root
Jul 30 20:35:40 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-02ff69b5-239b-41b0-afcb-6e4d9b55e55b tempest-VolumesSnapshotTestJSON-153537947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3244c8c6-c46a-4200-8c23-9bedb61ad324.b21f7edd-ba2f-44b7-8065-8aa59fab3611" returned: 0 in 0.435s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:35:40 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-02ff69b5-239b-41b0-afcb-6e4d9b55e55b tempest-VolumesSnapshotTestJSON-153537947 None] Lock "cinder-quobyte-b21f7edd-ba2f-44b7-8065-8aa59fab3611" released by "_delete_snapshot" :: held 2.011s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:35:40 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-02ff69b5-239b-41b0-afcb-6e4d9b55e55b tempest-VolumesSnapshotTestJSON-153537947 None] Lock "cinder-quobyte-3244c8c6-c46a-4200-8c23-9bedb61ad324" released by "delete_snapshot" :: held 2.046s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:35:40 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-02ff69b5-239b-41b0-afcb-6e4d9b55e55b tempest-VolumesSnapshotTestJSON-153537947 None] Created reservations ['e7186fb0-5802-4931-9ac8-ab622af659b5', 'e01c0f9a-e874-49ad-8340-5b525cabf693', '047b5cb6-9cec-4c2f-973a-9f2db05ad450', 'ef988d60-e2bb-415e-b00b-6d539c0959fd'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:35:40 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-02ff69b5-239b-41b0-afcb-6e4d9b55e55b tempest-VolumesSnapshotTestJSON-153537947 None] Delete snapshot completed successfully.
Jul 30 20:35:40 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-02ff69b5-239b-41b0-afcb-6e4d9b55e55b tempest-VolumesSnapshotTestJSON-153537947 None] Lock "cinder-b21f7edd-ba2f-44b7-8065-8aa59fab3611-delete_snapshot" released by "delete_snapshot" :: held 2.220s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:35:41 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-4c116317-0c90-4d0b-a750-6460ce877944 tempest-VolumesSnapshotTestJSON-153537947 None] Acquiring lock "cinder-3244c8c6-c46a-4200-8c23-9bedb61ad324-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:35:41 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-4c116317-0c90-4d0b-a750-6460ce877944 tempest-VolumesSnapshotTestJSON-153537947 None] Lock "cinder-3244c8c6-c46a-4200-8c23-9bedb61ad324-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:35:41 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-4c116317-0c90-4d0b-a750-6460ce877944 tempest-VolumesSnapshotTestJSON-153537947 None] Acquiring lock "cinder-quobyte-3244c8c6-c46a-4200-8c23-9bedb61ad324" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:35:41 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-4c116317-0c90-4d0b-a750-6460ce877944 tempest-VolumesSnapshotTestJSON-153537947 None] Lock "cinder-quobyte-3244c8c6-c46a-4200-8c23-9bedb61ad324" acquired by "delete_volume" :: waited 0.020s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:35:41 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[478e1706-beff-4730-9089-52b3ba4032a5]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:35:41 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-4c116317-0c90-4d0b-a750-6460ce877944 tempest-VolumesSnapshotTestJSON-153537947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3244c8c6-c46a-4200-8c23-9bedb61ad324 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:35:41 devstack sudo[103528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3244c8c6-c46a-4200-8c23-9bedb61ad324
Jul 30 20:35:41 devstack sudo[103528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:35:42 devstack sudo[103528]: pam_unix(sudo:session): session closed for user root
Jul 30 20:35:42 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-4c116317-0c90-4d0b-a750-6460ce877944 tempest-VolumesSnapshotTestJSON-153537947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3244c8c6-c46a-4200-8c23-9bedb61ad324" returned: 0 in 0.428s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:35:42 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-4c116317-0c90-4d0b-a750-6460ce877944 tempest-VolumesSnapshotTestJSON-153537947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3244c8c6-c46a-4200-8c23-9bedb61ad324 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:35:42 devstack sudo[103534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3244c8c6-c46a-4200-8c23-9bedb61ad324
Jul 30 20:35:42 devstack sudo[103534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:35:42 devstack sudo[103534]: pam_unix(sudo:session): session closed for user root
Jul 30 20:35:42 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-4c116317-0c90-4d0b-a750-6460ce877944 tempest-VolumesSnapshotTestJSON-153537947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3244c8c6-c46a-4200-8c23-9bedb61ad324" returned: 0 in 0.293s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:35:42 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-4c116317-0c90-4d0b-a750-6460ce877944 tempest-VolumesSnapshotTestJSON-153537947 None] Lock "cinder-quobyte-3244c8c6-c46a-4200-8c23-9bedb61ad324" released by "delete_volume" :: held 0.798s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:35:42 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-4c116317-0c90-4d0b-a750-6460ce877944 tempest-VolumesSnapshotTestJSON-153537947 None] Created reservations ['64d0c2e4-1965-45ec-98e5-095c3d38389d', '5f0f85f2-a47a-453e-824b-97ac733f6d8f', '94bcac26-1c40-4b19-bb68-d3c88fed88bd', '1bc928d5-6fda-4be6-842a-ad26f7b331bc'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:35:42 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-4c116317-0c90-4d0b-a750-6460ce877944 tempest-VolumesSnapshotTestJSON-153537947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:35:42 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-4c116317-0c90-4d0b-a750-6460ce877944 tempest-VolumesSnapshotTestJSON-153537947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:35:42 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-4c116317-0c90-4d0b-a750-6460ce877944 tempest-VolumesSnapshotTestJSON-153537947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:35:42 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-4c116317-0c90-4d0b-a750-6460ce877944 tempest-VolumesSnapshotTestJSON-153537947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:35:42 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-4c116317-0c90-4d0b-a750-6460ce877944 tempest-VolumesSnapshotTestJSON-153537947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:35:42 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-4c116317-0c90-4d0b-a750-6460ce877944 tempest-VolumesSnapshotTestJSON-153537947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:35:42 devstack sudo[103544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:35:42 devstack sudo[103544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:35:42 devstack sudo[103544]: pam_unix(sudo:session): session closed for user root
Jul 30 20:35:42 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-4c116317-0c90-4d0b-a750-6460ce877944 tempest-VolumesSnapshotTestJSON-153537947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.343s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:35:42 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-4c116317-0c90-4d0b-a750-6460ce877944 tempest-VolumesSnapshotTestJSON-153537947 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:35:42 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-4c116317-0c90-4d0b-a750-6460ce877944 tempest-VolumesSnapshotTestJSON-153537947 None] Deleted volume successfully.
Jul 30 20:35:42 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-4c116317-0c90-4d0b-a750-6460ce877944 tempest-VolumesSnapshotTestJSON-153537947 None] Lock "cinder-3244c8c6-c46a-4200-8c23-9bedb61ad324-delete_volume" released by "delete_volume" :: held 1.425s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:35:43 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-04949504-9f59-4fb5-8431-39743adf2a35 tempest-VolumesSnapshotTestJSON-153537947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:35:43 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-04949504-9f59-4fb5-8431-39743adf2a35 tempest-VolumesSnapshotTestJSON-153537947 None] Flow 'volume_create_manager' (2639cda0-bf82-4c56-8891-c26d5e514932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:35:43 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-04949504-9f59-4fb5-8431-39743adf2a35 tempest-VolumesSnapshotTestJSON-153537947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79590a27-0177-4323-9d6b-faccd1e6b0ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:35:43 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-04949504-9f59-4fb5-8431-39743adf2a35 tempest-VolumesSnapshotTestJSON-153537947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79590a27-0177-4323-9d6b-faccd1e6b0ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:35:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-401897629',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92a39caa-955e-4a9e-8577-37bbafe19e55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4db6b3c17c704eb591bba88684c77cbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:35:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:35:43Z,use_quota=True,user_id='de69dd69544b4eb7af712d3a4bfb8c4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:35:43 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-04949504-9f59-4fb5-8431-39743adf2a35 tempest-VolumesSnapshotTestJSON-153537947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2fa0a99-8137-4dfc-8fbb-6eea172c5feb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:35:43 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-04949504-9f59-4fb5-8431-39743adf2a35 tempest-VolumesSnapshotTestJSON-153537947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2fa0a99-8137-4dfc-8fbb-6eea172c5feb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:35:43 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-04949504-9f59-4fb5-8431-39743adf2a35 tempest-VolumesSnapshotTestJSON-153537947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fad1b7d6-1e66-4b55-bca7-b7098bba2411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:35:43 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-04949504-9f59-4fb5-8431-39743adf2a35 tempest-VolumesSnapshotTestJSON-153537947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fad1b7d6-1e66-4b55-bca7-b7098bba2411) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92a39caa-955e-4a9e-8577-37bbafe19e55', 'volume_name': 'volume-92a39caa-955e-4a9e-8577-37bbafe19e55', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:35:43 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-04949504-9f59-4fb5-8431-39743adf2a35 tempest-VolumesSnapshotTestJSON-153537947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a0ace70-ffe6-4485-a2f2-d2ab16d92ab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:35:43 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-04949504-9f59-4fb5-8431-39743adf2a35 tempest-VolumesSnapshotTestJSON-153537947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a0ace70-ffe6-4485-a2f2-d2ab16d92ab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:35:43 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-04949504-9f59-4fb5-8431-39743adf2a35 tempest-VolumesSnapshotTestJSON-153537947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdd1ecbc-ec00-481f-80a6-680b5bf7f067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:35:43 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-04949504-9f59-4fb5-8431-39743adf2a35 tempest-VolumesSnapshotTestJSON-153537947 None] Volume 92a39caa-955e-4a9e-8577-37bbafe19e55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92a39caa-955e-4a9e-8577-37bbafe19e55', 'volume_size': 1}
Jul 30 20:35:43 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-04949504-9f59-4fb5-8431-39743adf2a35 tempest-VolumesSnapshotTestJSON-153537947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:35:43 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-04949504-9f59-4fb5-8431-39743adf2a35 tempest-VolumesSnapshotTestJSON-153537947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:35:43 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-04949504-9f59-4fb5-8431-39743adf2a35 tempest-VolumesSnapshotTestJSON-153537947 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:35:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-401897629',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92a39caa-955e-4a9e-8577-37bbafe19e55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4db6b3c17c704eb591bba88684c77cbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:35:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:35:43Z,use_quota=True,user_id='de69dd69544b4eb7af712d3a4bfb8c4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:35:43 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-04949504-9f59-4fb5-8431-39743adf2a35 tempest-VolumesSnapshotTestJSON-153537947 None] Creating volume 92a39caa-955e-4a9e-8577-37bbafe19e55 {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:35:43 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-04949504-9f59-4fb5-8431-39743adf2a35 tempest-VolumesSnapshotTestJSON-153537947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:35:43 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-04949504-9f59-4fb5-8431-39743adf2a35 tempest-VolumesSnapshotTestJSON-153537947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:35:43 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-04949504-9f59-4fb5-8431-39743adf2a35 tempest-VolumesSnapshotTestJSON-153537947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:35:43 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-04949504-9f59-4fb5-8431-39743adf2a35 tempest-VolumesSnapshotTestJSON-153537947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:35:43 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-04949504-9f59-4fb5-8431-39743adf2a35 tempest-VolumesSnapshotTestJSON-153537947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:35:43 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-04949504-9f59-4fb5-8431-39743adf2a35 tempest-VolumesSnapshotTestJSON-153537947 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:35:43 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-04949504-9f59-4fb5-8431-39743adf2a35 tempest-VolumesSnapshotTestJSON-153537947 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:35:43 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-04949504-9f59-4fb5-8431-39743adf2a35 tempest-VolumesSnapshotTestJSON-153537947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-92a39caa-955e-4a9e-8577-37bbafe19e55 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:35:43 devstack sudo[103552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-92a39caa-955e-4a9e-8577-37bbafe19e55 1073741824
Jul 30 20:35:43 devstack sudo[103552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:35:44 devstack cinder-volume[88719]: INFO cinder.volume.manager [req-083ef91b-d063-41ea-8908-aba344836eee req-04569b46-1a69-4b25-bc62-15ea3f8a0473 tempest-TestStampPattern-75201989 None] Terminate volume connection completed successfully.
Jul 30 20:35:44 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [req-083ef91b-d063-41ea-8908-aba344836eee req-04569b46-1a69-4b25-bc62-15ea3f8a0473 tempest-TestStampPattern-75201989 None] Deleting attachment e4d3ba4c-99b4-43d4-a60e-81c523b46317. {{(pid=88719) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 30 20:35:44 devstack sudo[103552]: pam_unix(sudo:session): session closed for user root
Jul 30 20:35:44 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-04949504-9f59-4fb5-8431-39743adf2a35 tempest-VolumesSnapshotTestJSON-153537947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-92a39caa-955e-4a9e-8577-37bbafe19e55 1073741824" returned: 0 in 0.522s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:35:44 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-04949504-9f59-4fb5-8431-39743adf2a35 tempest-VolumesSnapshotTestJSON-153537947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-92a39caa-955e-4a9e-8577-37bbafe19e55 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:35:44 devstack sudo[103588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-92a39caa-955e-4a9e-8577-37bbafe19e55
Jul 30 20:35:44 devstack sudo[103588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:35:44 devstack sudo[103588]: pam_unix(sudo:session): session closed for user root
Jul 30 20:35:44 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-04949504-9f59-4fb5-8431-39743adf2a35 tempest-VolumesSnapshotTestJSON-153537947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-92a39caa-955e-4a9e-8577-37bbafe19e55" returned: 0 in 0.263s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:35:44 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-04949504-9f59-4fb5-8431-39743adf2a35 tempest-VolumesSnapshotTestJSON-153537947 None] <== create_volume: return (829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:35:44 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-04949504-9f59-4fb5-8431-39743adf2a35 tempest-VolumesSnapshotTestJSON-153537947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.832s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:35:44 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-04949504-9f59-4fb5-8431-39743adf2a35 tempest-VolumesSnapshotTestJSON-153537947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdd1ecbc-ec00-481f-80a6-680b5bf7f067) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92a39caa-955e-4a9e-8577-37bbafe19e55', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:35:44 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-04949504-9f59-4fb5-8431-39743adf2a35 tempest-VolumesSnapshotTestJSON-153537947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (165a3d2e-4d9c-412f-8327-4b9b401f5b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:35:44 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-04949504-9f59-4fb5-8431-39743adf2a35 tempest-VolumesSnapshotTestJSON-153537947 None] Volume volume-92a39caa-955e-4a9e-8577-37bbafe19e55 (92a39caa-955e-4a9e-8577-37bbafe19e55): created successfully
Jul 30 20:35:44 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-04949504-9f59-4fb5-8431-39743adf2a35 tempest-VolumesSnapshotTestJSON-153537947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (165a3d2e-4d9c-412f-8327-4b9b401f5b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:35:44 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-04949504-9f59-4fb5-8431-39743adf2a35 tempest-VolumesSnapshotTestJSON-153537947 None] Flow 'volume_create_manager' (2639cda0-bf82-4c56-8891-c26d5e514932) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:35:44 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-04949504-9f59-4fb5-8431-39743adf2a35 tempest-VolumesSnapshotTestJSON-153537947 None] Created volume successfully.
Jul 30 20:35:44 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-a2839785-a3a7-44c3-b16e-0ee2a4f8fed7 tempest-TestStampPattern-75201989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:35:44 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-a2839785-a3a7-44c3-b16e-0ee2a4f8fed7 tempest-TestStampPattern-75201989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:35:44 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-a2839785-a3a7-44c3-b16e-0ee2a4f8fed7 tempest-TestStampPattern-75201989 None] Creating offline snapshot 6739e9c6-fb89-4f6c-8d1e-616767d8818b of volume 0883c285-cc2b-4727-af60-5bb30a001719 {{(pid=88719) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 30 20:35:44 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3e0f6f3-f7e4-4648-a6e8-a09fe9a583ef]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:35:44 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-a2839785-a3a7-44c3-b16e-0ee2a4f8fed7 tempest-TestStampPattern-75201989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0883c285-cc2b-4727-af60-5bb30a001719 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:35:44 devstack sudo[103592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0883c285-cc2b-4727-af60-5bb30a001719
Jul 30 20:35:44 devstack sudo[103592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:35:45 devstack sudo[103592]: pam_unix(sudo:session): session closed for user root
Jul 30 20:35:45 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-a2839785-a3a7-44c3-b16e-0ee2a4f8fed7 tempest-TestStampPattern-75201989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0883c285-cc2b-4727-af60-5bb30a001719" returned: 0 in 0.385s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:35:45 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-a2839785-a3a7-44c3-b16e-0ee2a4f8fed7 tempest-TestStampPattern-75201989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0883c285-cc2b-4727-af60-5bb30a001719,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0883c285-cc2b-4727-af60-5bb30a001719.6739e9c6-fb89-4f6c-8d1e-616767d8818b 1G {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:35:45 devstack sudo[103597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0883c285-cc2b-4727-af60-5bb30a001719,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0883c285-cc2b-4727-af60-5bb30a001719.6739e9c6-fb89-4f6c-8d1e-616767d8818b 1G
Jul 30 20:35:45 devstack sudo[103597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:35:45 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-f4b3a01e-ba7d-420e-a60c-70f3a7119ceb tempest-VolumesSnapshotTestJSON-153537947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:35:45 devstack sudo[103597]: pam_unix(sudo:session): session closed for user root
Jul 30 20:35:45 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-a2839785-a3a7-44c3-b16e-0ee2a4f8fed7 tempest-TestStampPattern-75201989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0883c285-cc2b-4727-af60-5bb30a001719,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0883c285-cc2b-4727-af60-5bb30a001719.6739e9c6-fb89-4f6c-8d1e-616767d8818b 1G" returned: 0 in 0.522s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:35:45 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-a2839785-a3a7-44c3-b16e-0ee2a4f8fed7 tempest-TestStampPattern-75201989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0883c285-cc2b-4727-af60-5bb30a001719 -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0883c285-cc2b-4727-af60-5bb30a001719.6739e9c6-fb89-4f6c-8d1e-616767d8818b {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:35:45 devstack sudo[103603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0883c285-cc2b-4727-af60-5bb30a001719 -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0883c285-cc2b-4727-af60-5bb30a001719.6739e9c6-fb89-4f6c-8d1e-616767d8818b
Jul 30 20:35:45 devstack sudo[103603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:35:46 devstack sudo[103603]: pam_unix(sudo:session): session closed for user root
Jul 30 20:35:46 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-a2839785-a3a7-44c3-b16e-0ee2a4f8fed7 tempest-TestStampPattern-75201989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0883c285-cc2b-4727-af60-5bb30a001719 -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0883c285-cc2b-4727-af60-5bb30a001719.6739e9c6-fb89-4f6c-8d1e-616767d8818b" returned: 0 in 0.428s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:35:46 devstack cinder-volume[88719]: WARNING cinder.volume.drivers.remotefs [None req-a2839785-a3a7-44c3-b16e-0ee2a4f8fed7 tempest-TestStampPattern-75201989 None] /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0883c285-cc2b-4727-af60-5bb30a001719.6739e9c6-fb89-4f6c-8d1e-616767d8818b is being set with open permissions: ugo+rw
Jul 30 20:35:46 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-a2839785-a3a7-44c3-b16e-0ee2a4f8fed7 tempest-TestStampPattern-75201989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0883c285-cc2b-4727-af60-5bb30a001719.6739e9c6-fb89-4f6c-8d1e-616767d8818b {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:35:46 devstack sudo[103609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0883c285-cc2b-4727-af60-5bb30a001719.6739e9c6-fb89-4f6c-8d1e-616767d8818b
Jul 30 20:35:46 devstack sudo[103609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:35:46 devstack sudo[103609]: pam_unix(sudo:session): session closed for user root
Jul 30 20:35:46 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-a2839785-a3a7-44c3-b16e-0ee2a4f8fed7 tempest-TestStampPattern-75201989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0883c285-cc2b-4727-af60-5bb30a001719.6739e9c6-fb89-4f6c-8d1e-616767d8818b" returned: 0 in 0.270s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:35:46 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-a2839785-a3a7-44c3-b16e-0ee2a4f8fed7 tempest-TestStampPattern-75201989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0883c285-cc2b-4727-af60-5bb30a001719.info {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:35:46 devstack sudo[103612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0883c285-cc2b-4727-af60-5bb30a001719.info
Jul 30 20:35:46 devstack sudo[103612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:35:46 devstack sudo[103612]: pam_unix(sudo:session): session closed for user root
Jul 30 20:35:46 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-a2839785-a3a7-44c3-b16e-0ee2a4f8fed7 tempest-TestStampPattern-75201989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0883c285-cc2b-4727-af60-5bb30a001719.info" returned: 0 in 0.285s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:35:46 devstack cinder-volume[88719]: WARNING cinder.volume.drivers.remotefs [None req-a2839785-a3a7-44c3-b16e-0ee2a4f8fed7 tempest-TestStampPattern-75201989 None] /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0883c285-cc2b-4727-af60-5bb30a001719.info is being set with open permissions: ugo+rw
Jul 30 20:35:46 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-a2839785-a3a7-44c3-b16e-0ee2a4f8fed7 tempest-TestStampPattern-75201989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0883c285-cc2b-4727-af60-5bb30a001719.info {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:35:46 devstack sudo[103615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0883c285-cc2b-4727-af60-5bb30a001719.info
Jul 30 20:35:46 devstack sudo[103615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:35:47 devstack sudo[103615]: pam_unix(sudo:session): session closed for user root
Jul 30 20:35:47 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-a2839785-a3a7-44c3-b16e-0ee2a4f8fed7 tempest-TestStampPattern-75201989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0883c285-cc2b-4727-af60-5bb30a001719.info" returned: 0 in 0.268s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:35:47 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-a2839785-a3a7-44c3-b16e-0ee2a4f8fed7 tempest-TestStampPattern-75201989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.274s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:35:47 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-f4b3a01e-ba7d-420e-a60c-70f3a7119ceb tempest-VolumesSnapshotTestJSON-153537947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.357s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:35:47 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-f4b3a01e-ba7d-420e-a60c-70f3a7119ceb tempest-VolumesSnapshotTestJSON-153537947 None] Creating offline snapshot 29aed615-bb61-4909-81a2-8058eea8547f of volume 92a39caa-955e-4a9e-8577-37bbafe19e55 {{(pid=88719) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 30 20:35:47 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-a2839785-a3a7-44c3-b16e-0ee2a4f8fed7 tempest-TestStampPattern-75201989 None] Create snapshot completed successfully
Jul 30 20:35:47 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[84123b8f-9448-4625-af5d-88b1ec2c5cc9]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:35:47 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f4b3a01e-ba7d-420e-a60c-70f3a7119ceb tempest-VolumesSnapshotTestJSON-153537947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-92a39caa-955e-4a9e-8577-37bbafe19e55 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:35:47 devstack sudo[103618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-92a39caa-955e-4a9e-8577-37bbafe19e55
Jul 30 20:35:47 devstack sudo[103618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:35:47 devstack sudo[103618]: pam_unix(sudo:session): session closed for user root
Jul 30 20:35:47 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f4b3a01e-ba7d-420e-a60c-70f3a7119ceb tempest-VolumesSnapshotTestJSON-153537947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-92a39caa-955e-4a9e-8577-37bbafe19e55" returned: 0 in 0.379s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:35:47 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f4b3a01e-ba7d-420e-a60c-70f3a7119ceb tempest-VolumesSnapshotTestJSON-153537947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-92a39caa-955e-4a9e-8577-37bbafe19e55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-92a39caa-955e-4a9e-8577-37bbafe19e55.29aed615-bb61-4909-81a2-8058eea8547f 1G {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:35:47 devstack sudo[103623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-92a39caa-955e-4a9e-8577-37bbafe19e55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-92a39caa-955e-4a9e-8577-37bbafe19e55.29aed615-bb61-4909-81a2-8058eea8547f 1G
Jul 30 20:35:47 devstack sudo[103623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:35:48 devstack sudo[103623]: pam_unix(sudo:session): session closed for user root
Jul 30 20:35:48 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f4b3a01e-ba7d-420e-a60c-70f3a7119ceb tempest-VolumesSnapshotTestJSON-153537947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-92a39caa-955e-4a9e-8577-37bbafe19e55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-92a39caa-955e-4a9e-8577-37bbafe19e55.29aed615-bb61-4909-81a2-8058eea8547f 1G" returned: 0 in 0.523s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:35:48 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f4b3a01e-ba7d-420e-a60c-70f3a7119ceb tempest-VolumesSnapshotTestJSON-153537947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92a39caa-955e-4a9e-8577-37bbafe19e55 -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-92a39caa-955e-4a9e-8577-37bbafe19e55.29aed615-bb61-4909-81a2-8058eea8547f {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:35:48 devstack sudo[103629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92a39caa-955e-4a9e-8577-37bbafe19e55 -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-92a39caa-955e-4a9e-8577-37bbafe19e55.29aed615-bb61-4909-81a2-8058eea8547f
Jul 30 20:35:48 devstack sudo[103629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:35:48 devstack sudo[103629]: pam_unix(sudo:session): session closed for user root
Jul 30 20:35:48 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f4b3a01e-ba7d-420e-a60c-70f3a7119ceb tempest-VolumesSnapshotTestJSON-153537947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92a39caa-955e-4a9e-8577-37bbafe19e55 -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-92a39caa-955e-4a9e-8577-37bbafe19e55.29aed615-bb61-4909-81a2-8058eea8547f" returned: 0 in 0.378s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:35:48 devstack cinder-volume[88719]: WARNING cinder.volume.drivers.remotefs [None req-f4b3a01e-ba7d-420e-a60c-70f3a7119ceb tempest-VolumesSnapshotTestJSON-153537947 None] /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-92a39caa-955e-4a9e-8577-37bbafe19e55.29aed615-bb61-4909-81a2-8058eea8547f is being set with open permissions: ugo+rw
Jul 30 20:35:48 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f4b3a01e-ba7d-420e-a60c-70f3a7119ceb tempest-VolumesSnapshotTestJSON-153537947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-92a39caa-955e-4a9e-8577-37bbafe19e55.29aed615-bb61-4909-81a2-8058eea8547f {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:35:48 devstack sudo[103634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-92a39caa-955e-4a9e-8577-37bbafe19e55.29aed615-bb61-4909-81a2-8058eea8547f
Jul 30 20:35:48 devstack sudo[103634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:35:48 devstack sudo[103634]: pam_unix(sudo:session): session closed for user root
Jul 30 20:35:48 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f4b3a01e-ba7d-420e-a60c-70f3a7119ceb tempest-VolumesSnapshotTestJSON-153537947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-92a39caa-955e-4a9e-8577-37bbafe19e55.29aed615-bb61-4909-81a2-8058eea8547f" returned: 0 in 0.274s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:35:48 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f4b3a01e-ba7d-420e-a60c-70f3a7119ceb tempest-VolumesSnapshotTestJSON-153537947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-92a39caa-955e-4a9e-8577-37bbafe19e55.info {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:35:48 devstack sudo[103637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-92a39caa-955e-4a9e-8577-37bbafe19e55.info
Jul 30 20:35:48 devstack sudo[103637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:35:49 devstack sudo[103637]: pam_unix(sudo:session): session closed for user root
Jul 30 20:35:49 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f4b3a01e-ba7d-420e-a60c-70f3a7119ceb tempest-VolumesSnapshotTestJSON-153537947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-92a39caa-955e-4a9e-8577-37bbafe19e55.info" returned: 0 in 0.349s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:35:49 devstack cinder-volume[88719]: WARNING cinder.volume.drivers.remotefs [None req-f4b3a01e-ba7d-420e-a60c-70f3a7119ceb tempest-VolumesSnapshotTestJSON-153537947 None] /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-92a39caa-955e-4a9e-8577-37bbafe19e55.info is being set with open permissions: ugo+rw
Jul 30 20:35:49 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f4b3a01e-ba7d-420e-a60c-70f3a7119ceb tempest-VolumesSnapshotTestJSON-153537947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-92a39caa-955e-4a9e-8577-37bbafe19e55.info {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:35:49 devstack sudo[103640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-92a39caa-955e-4a9e-8577-37bbafe19e55.info
Jul 30 20:35:49 devstack sudo[103640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:35:49 devstack sudo[103640]: pam_unix(sudo:session): session closed for user root
Jul 30 20:35:49 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f4b3a01e-ba7d-420e-a60c-70f3a7119ceb tempest-VolumesSnapshotTestJSON-153537947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-92a39caa-955e-4a9e-8577-37bbafe19e55.info" returned: 0 in 0.340s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:35:49 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-f4b3a01e-ba7d-420e-a60c-70f3a7119ceb tempest-VolumesSnapshotTestJSON-153537947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.367s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:35:49 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-f4b3a01e-ba7d-420e-a60c-70f3a7119ceb tempest-VolumesSnapshotTestJSON-153537947 None] Create snapshot completed successfully
Jul 30 20:35:50 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-91830aad-28ac-47b7-9332-7f4fc3eb2b67 tempest-VolumesSnapshotTestJSON-153537947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:35:50 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-91830aad-28ac-47b7-9332-7f4fc3eb2b67 tempest-VolumesSnapshotTestJSON-153537947 None] Flow 'volume_create_manager' (34295a6a-66f0-42de-9858-0bfb0b078a0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:35:50 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-91830aad-28ac-47b7-9332-7f4fc3eb2b67 tempest-VolumesSnapshotTestJSON-153537947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8d98b20-7900-43d2-a4c1-16c02c42eb12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:35:50 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-91830aad-28ac-47b7-9332-7f4fc3eb2b67 tempest-VolumesSnapshotTestJSON-153537947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8d98b20-7900-43d2-a4c1-16c02c42eb12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:35:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-310443360',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecb8e3e7-e6e7-4070-b184-6a2273b628d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4db6b3c17c704eb591bba88684c77cbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:35:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=29aed615-bb61-4909-81a2-8058eea8547f,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:35:50Z,use_quota=True,user_id='de69dd69544b4eb7af712d3a4bfb8c4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:35:50 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-91830aad-28ac-47b7-9332-7f4fc3eb2b67 tempest-VolumesSnapshotTestJSON-153537947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7293c1e-4a5e-49e7-beec-bec9aa94a1f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:35:50 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-91830aad-28ac-47b7-9332-7f4fc3eb2b67 tempest-VolumesSnapshotTestJSON-153537947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7293c1e-4a5e-49e7-beec-bec9aa94a1f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:35:50 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-91830aad-28ac-47b7-9332-7f4fc3eb2b67 tempest-VolumesSnapshotTestJSON-153537947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0d170e4-ad42-42e0-ad90-2553ef0e398f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:35:50 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-91830aad-28ac-47b7-9332-7f4fc3eb2b67 tempest-VolumesSnapshotTestJSON-153537947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0d170e4-ad42-42e0-ad90-2553ef0e398f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ecb8e3e7-e6e7-4070-b184-6a2273b628d7', 'volume_name': 'volume-ecb8e3e7-e6e7-4070-b184-6a2273b628d7', 'volume_size': 1, 'snapshot_id': '29aed615-bb61-4909-81a2-8058eea8547f'}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:35:50 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-91830aad-28ac-47b7-9332-7f4fc3eb2b67 tempest-VolumesSnapshotTestJSON-153537947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9c2d293-e23e-4358-9f8a-6b7202b534fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:35:50 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-91830aad-28ac-47b7-9332-7f4fc3eb2b67 tempest-VolumesSnapshotTestJSON-153537947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9c2d293-e23e-4358-9f8a-6b7202b534fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:35:50 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-91830aad-28ac-47b7-9332-7f4fc3eb2b67 tempest-VolumesSnapshotTestJSON-153537947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00bb5142-b172-4401-9aa7-9eb36ccb86ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:35:50 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-91830aad-28ac-47b7-9332-7f4fc3eb2b67 tempest-VolumesSnapshotTestJSON-153537947 None] Volume ecb8e3e7-e6e7-4070-b184-6a2273b628d7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ecb8e3e7-e6e7-4070-b184-6a2273b628d7', 'volume_size': 1, 'snapshot_id': '29aed615-bb61-4909-81a2-8058eea8547f'}
Jul 30 20:35:50 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-91830aad-28ac-47b7-9332-7f4fc3eb2b67 tempest-VolumesSnapshotTestJSON-153537947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:35:50 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-91830aad-28ac-47b7-9332-7f4fc3eb2b67 tempest-VolumesSnapshotTestJSON-153537947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:35:50 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-91830aad-28ac-47b7-9332-7f4fc3eb2b67 tempest-VolumesSnapshotTestJSON-153537947 None] Acquiring lock "cinder-quobyte-29aed615-bb61-4909-81a2-8058eea8547f-ecb8e3e7-e6e7-4070-b184-6a2273b628d7" by "_create_volume_from_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:35:50 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-91830aad-28ac-47b7-9332-7f4fc3eb2b67 tempest-VolumesSnapshotTestJSON-153537947 None] Lock "cinder-quobyte-29aed615-bb61-4909-81a2-8058eea8547f-ecb8e3e7-e6e7-4070-b184-6a2273b628d7" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:35:50 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-91830aad-28ac-47b7-9332-7f4fc3eb2b67 tempest-VolumesSnapshotTestJSON-153537947 None] Creating volume ecb8e3e7-e6e7-4070-b184-6a2273b628d7 from snapshot 29aed615-bb61-4909-81a2-8058eea8547f {{(pid=88719) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Jul 30 20:35:50 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-91830aad-28ac-47b7-9332-7f4fc3eb2b67 tempest-VolumesSnapshotTestJSON-153537947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:35:50 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-91830aad-28ac-47b7-9332-7f4fc3eb2b67 tempest-VolumesSnapshotTestJSON-153537947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:35:50 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-91830aad-28ac-47b7-9332-7f4fc3eb2b67 tempest-VolumesSnapshotTestJSON-153537947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:35:50 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-91830aad-28ac-47b7-9332-7f4fc3eb2b67 tempest-VolumesSnapshotTestJSON-153537947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:35:50 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-91830aad-28ac-47b7-9332-7f4fc3eb2b67 tempest-VolumesSnapshotTestJSON-153537947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:35:50 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-91830aad-28ac-47b7-9332-7f4fc3eb2b67 tempest-VolumesSnapshotTestJSON-153537947 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:35:50 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-91830aad-28ac-47b7-9332-7f4fc3eb2b67 tempest-VolumesSnapshotTestJSON-153537947 None] Acquiring lock "cinder-quobyte-ecb8e3e7-e6e7-4070-b184-6a2273b628d7" by "_copy_volume_from_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:35:50 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-91830aad-28ac-47b7-9332-7f4fc3eb2b67 tempest-VolumesSnapshotTestJSON-153537947 None] Lock "cinder-quobyte-ecb8e3e7-e6e7-4070-b184-6a2273b628d7" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:35:50 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-91830aad-28ac-47b7-9332-7f4fc3eb2b67 tempest-VolumesSnapshotTestJSON-153537947 None] snapshot: 29aed615-bb61-4909-81a2-8058eea8547f, volume: ecb8e3e7-e6e7-4070-b184-6a2273b628d7,  {{(pid=88719) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}}
Jul 30 20:35:50 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-91830aad-28ac-47b7-9332-7f4fc3eb2b67 tempest-VolumesSnapshotTestJSON-153537947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:35:50 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-91830aad-28ac-47b7-9332-7f4fc3eb2b67 tempest-VolumesSnapshotTestJSON-153537947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:35:50 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-91830aad-28ac-47b7-9332-7f4fc3eb2b67 tempest-VolumesSnapshotTestJSON-153537947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:35:50 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-91830aad-28ac-47b7-9332-7f4fc3eb2b67 tempest-VolumesSnapshotTestJSON-153537947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:35:50 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-91830aad-28ac-47b7-9332-7f4fc3eb2b67 tempest-VolumesSnapshotTestJSON-153537947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:35:50 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[288f97ad-7343-4186-9230-1a73ce807f71]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:35:50 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-91830aad-28ac-47b7-9332-7f4fc3eb2b67 tempest-VolumesSnapshotTestJSON-153537947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-92a39caa-955e-4a9e-8577-37bbafe19e55.29aed615-bb61-4909-81a2-8058eea8547f {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:35:50 devstack sudo[103666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-92a39caa-955e-4a9e-8577-37bbafe19e55.29aed615-bb61-4909-81a2-8058eea8547f
Jul 30 20:35:50 devstack sudo[103666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:35:51 devstack sudo[103666]: pam_unix(sudo:session): session closed for user root
Jul 30 20:35:51 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-91830aad-28ac-47b7-9332-7f4fc3eb2b67 tempest-VolumesSnapshotTestJSON-153537947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-92a39caa-955e-4a9e-8577-37bbafe19e55.29aed615-bb61-4909-81a2-8058eea8547f" returned: 0 in 0.417s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:35:51 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-91830aad-28ac-47b7-9332-7f4fc3eb2b67 tempest-VolumesSnapshotTestJSON-153537947 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-92a39caa-955e-4a9e-8577-37bbafe19e55(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88719) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 30 20:35:51 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3ad2509-296a-4a31-93b3-facdbe7e491b]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:35:51 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-91830aad-28ac-47b7-9332-7f4fc3eb2b67 tempest-VolumesSnapshotTestJSON-153537947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-92a39caa-955e-4a9e-8577-37bbafe19e55 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:35:51 devstack sudo[103680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-92a39caa-955e-4a9e-8577-37bbafe19e55
Jul 30 20:35:51 devstack sudo[103680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:35:51 devstack sudo[103680]: pam_unix(sudo:session): session closed for user root
Jul 30 20:35:51 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-91830aad-28ac-47b7-9332-7f4fc3eb2b67 tempest-VolumesSnapshotTestJSON-153537947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-92a39caa-955e-4a9e-8577-37bbafe19e55" returned: 0 in 0.404s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:35:51 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-91830aad-28ac-47b7-9332-7f4fc3eb2b67 tempest-VolumesSnapshotTestJSON-153537947 None] will copy from snapshot at /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-92a39caa-955e-4a9e-8577-37bbafe19e55 {{(pid=88719) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}}
Jul 30 20:35:51 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-91830aad-28ac-47b7-9332-7f4fc3eb2b67 tempest-VolumesSnapshotTestJSON-153537947 None] Creating direct copy from snapshot {{(pid=88719) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}}
Jul 30 20:35:51 devstack cinder-volume[88719]: DEBUG cinder.utils [None req-91830aad-28ac-47b7-9332-7f4fc3eb2b67 tempest-VolumesSnapshotTestJSON-153537947 None] Path /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-ecb8e3e7-e6e7-4070-b184-6a2273b628d7 not found in is_blk_device check {{(pid=88719) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 30 20:35:51 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-91830aad-28ac-47b7-9332-7f4fc3eb2b67 tempest-VolumesSnapshotTestJSON-153537947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-92a39caa-955e-4a9e-8577-37bbafe19e55 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-ecb8e3e7-e6e7-4070-b184-6a2273b628d7 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:35:51 devstack sudo[103686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-92a39caa-955e-4a9e-8577-37bbafe19e55 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-ecb8e3e7-e6e7-4070-b184-6a2273b628d7
Jul 30 20:35:51 devstack sudo[103686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:35:57 devstack sudo[103686]: pam_unix(sudo:session): session closed for user root
Jul 30 20:35:57 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-91830aad-28ac-47b7-9332-7f4fc3eb2b67 tempest-VolumesSnapshotTestJSON-153537947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-92a39caa-955e-4a9e-8577-37bbafe19e55 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-ecb8e3e7-e6e7-4070-b184-6a2273b628d7" returned: 0 in 6.176s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:35:57 devstack cinder-volume[88719]: DEBUG cinder.image.image_utils [None req-91830aad-28ac-47b7-9332-7f4fc3eb2b67 tempest-VolumesSnapshotTestJSON-153537947 None] Image conversion details: src /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-92a39caa-955e-4a9e-8577-37bbafe19e55, size 1024.00 MB, duration 6.18 sec, destination /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-ecb8e3e7-e6e7-4070-b184-6a2273b628d7 {{(pid=88719) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 30 20:35:57 devstack cinder-volume[88719]: INFO cinder.image.image_utils [None req-91830aad-28ac-47b7-9332-7f4fc3eb2b67 tempest-VolumesSnapshotTestJSON-153537947 None] Converted 1024.00 MB image at 165.76 MB/s
Jul 30 20:35:57 devstack cinder-volume[88719]: WARNING cinder.volume.drivers.remotefs [None req-91830aad-28ac-47b7-9332-7f4fc3eb2b67 tempest-VolumesSnapshotTestJSON-153537947 None] /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-ecb8e3e7-e6e7-4070-b184-6a2273b628d7 is being set with open permissions: ugo+rw
Jul 30 20:35:57 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-91830aad-28ac-47b7-9332-7f4fc3eb2b67 tempest-VolumesSnapshotTestJSON-153537947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-ecb8e3e7-e6e7-4070-b184-6a2273b628d7 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:35:57 devstack sudo[103700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-ecb8e3e7-e6e7-4070-b184-6a2273b628d7
Jul 30 20:35:57 devstack sudo[103700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:35:58 devstack sudo[103700]: pam_unix(sudo:session): session closed for user root
Jul 30 20:35:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-91830aad-28ac-47b7-9332-7f4fc3eb2b67 tempest-VolumesSnapshotTestJSON-153537947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-ecb8e3e7-e6e7-4070-b184-6a2273b628d7" returned: 0 in 0.318s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:35:58 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-91830aad-28ac-47b7-9332-7f4fc3eb2b67 tempest-VolumesSnapshotTestJSON-153537947 None] Lock "cinder-quobyte-ecb8e3e7-e6e7-4070-b184-6a2273b628d7" released by "_copy_volume_from_snapshot" :: held 7.407s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:35:58 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-91830aad-28ac-47b7-9332-7f4fc3eb2b67 tempest-VolumesSnapshotTestJSON-153537947 None] Lock "cinder-quobyte-29aed615-bb61-4909-81a2-8058eea8547f-ecb8e3e7-e6e7-4070-b184-6a2273b628d7" released by "_create_volume_from_snapshot" :: held 7.494s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:35:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-91830aad-28ac-47b7-9332-7f4fc3eb2b67 tempest-VolumesSnapshotTestJSON-153537947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.515s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:35:58 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-91830aad-28ac-47b7-9332-7f4fc3eb2b67 tempest-VolumesSnapshotTestJSON-153537947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00bb5142-b172-4401-9aa7-9eb36ccb86ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecb8e3e7-e6e7-4070-b184-6a2273b628d7', 'volume_size': 1, 'snapshot_id': '29aed615-bb61-4909-81a2-8058eea8547f'}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:35:58 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-91830aad-28ac-47b7-9332-7f4fc3eb2b67 tempest-VolumesSnapshotTestJSON-153537947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (992937ca-6889-4721-a369-079f48e7da9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:35:58 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-91830aad-28ac-47b7-9332-7f4fc3eb2b67 tempest-VolumesSnapshotTestJSON-153537947 None] Volume volume-ecb8e3e7-e6e7-4070-b184-6a2273b628d7 (ecb8e3e7-e6e7-4070-b184-6a2273b628d7): created successfully
Jul 30 20:35:58 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-91830aad-28ac-47b7-9332-7f4fc3eb2b67 tempest-VolumesSnapshotTestJSON-153537947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (992937ca-6889-4721-a369-079f48e7da9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:35:58 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-91830aad-28ac-47b7-9332-7f4fc3eb2b67 tempest-VolumesSnapshotTestJSON-153537947 None] Flow 'volume_create_manager' (34295a6a-66f0-42de-9858-0bfb0b078a0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:35:58 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-91830aad-28ac-47b7-9332-7f4fc3eb2b67 tempest-VolumesSnapshotTestJSON-153537947 None] Created volume successfully.
Jul 30 20:35:59 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-0655c5d5-d90a-4370-9960-c2e49dd40bfa tempest-VolumesSnapshotTestJSON-153537947 None] Acquiring lock "cinder-ecb8e3e7-e6e7-4070-b184-6a2273b628d7-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:35:59 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-0655c5d5-d90a-4370-9960-c2e49dd40bfa tempest-VolumesSnapshotTestJSON-153537947 None] Lock "cinder-ecb8e3e7-e6e7-4070-b184-6a2273b628d7-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:35:59 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-0655c5d5-d90a-4370-9960-c2e49dd40bfa tempest-VolumesSnapshotTestJSON-153537947 None] Acquiring lock "cinder-quobyte-ecb8e3e7-e6e7-4070-b184-6a2273b628d7" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:35:59 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-0655c5d5-d90a-4370-9960-c2e49dd40bfa tempest-VolumesSnapshotTestJSON-153537947 None] Lock "cinder-quobyte-ecb8e3e7-e6e7-4070-b184-6a2273b628d7" acquired by "delete_volume" :: waited 0.049s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:35:59 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[51fed0b5-48b4-4e90-b3c1-43c1b6502001]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:35:59 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-0655c5d5-d90a-4370-9960-c2e49dd40bfa tempest-VolumesSnapshotTestJSON-153537947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-ecb8e3e7-e6e7-4070-b184-6a2273b628d7 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:36:00 devstack sudo[103713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-ecb8e3e7-e6e7-4070-b184-6a2273b628d7
Jul 30 20:36:00 devstack sudo[103713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:36:00 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ca83ed5-e584-4994-8c7e-1e1256155242 tempest-TestStampPattern-75201989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:36:00 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2ca83ed5-e584-4994-8c7e-1e1256155242 tempest-TestStampPattern-75201989 None] Flow 'volume_create_manager' (b6d2e920-9ba2-4c82-9e8c-0696fd3b7217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:36:00 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2ca83ed5-e584-4994-8c7e-1e1256155242 tempest-TestStampPattern-75201989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f56de79-f687-450e-bdd8-79af943e861c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:36:00 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2ca83ed5-e584-4994-8c7e-1e1256155242 tempest-TestStampPattern-75201989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f56de79-f687-450e-bdd8-79af943e861c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:35:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-2101072214',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7bff003-ef4d-4e45-bfcc-83beabf4018d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e71b8ca9bfa4acc8482988b1de5ed83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:36:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=6739e9c6-fb89-4f6c-8d1e-616767d8818b,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:36:00Z,use_quota=True,user_id='854ef3b7611a42809aa153cf7f08b32e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:36:00 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2ca83ed5-e584-4994-8c7e-1e1256155242 tempest-TestStampPattern-75201989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (134a9e15-8a33-40d9-83a3-864f722af40d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:36:00 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2ca83ed5-e584-4994-8c7e-1e1256155242 tempest-TestStampPattern-75201989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (134a9e15-8a33-40d9-83a3-864f722af40d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:36:00 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2ca83ed5-e584-4994-8c7e-1e1256155242 tempest-TestStampPattern-75201989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a51cee2a-c3c2-4a89-a31b-50aff5119757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:36:00 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2ca83ed5-e584-4994-8c7e-1e1256155242 tempest-TestStampPattern-75201989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a51cee2a-c3c2-4a89-a31b-50aff5119757) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b7bff003-ef4d-4e45-bfcc-83beabf4018d', 'volume_name': 'volume-b7bff003-ef4d-4e45-bfcc-83beabf4018d', 'volume_size': 1, 'snapshot_id': '6739e9c6-fb89-4f6c-8d1e-616767d8818b'}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:36:00 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2ca83ed5-e584-4994-8c7e-1e1256155242 tempest-TestStampPattern-75201989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a85a7e5-ec54-4727-affc-f571d56723bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:36:00 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2ca83ed5-e584-4994-8c7e-1e1256155242 tempest-TestStampPattern-75201989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a85a7e5-ec54-4727-affc-f571d56723bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:36:00 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2ca83ed5-e584-4994-8c7e-1e1256155242 tempest-TestStampPattern-75201989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5ecf38b-096f-4b55-badc-e741b63b95b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:36:00 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-2ca83ed5-e584-4994-8c7e-1e1256155242 tempest-TestStampPattern-75201989 None] Volume b7bff003-ef4d-4e45-bfcc-83beabf4018d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b7bff003-ef4d-4e45-bfcc-83beabf4018d', 'volume_size': 1, 'snapshot_id': '6739e9c6-fb89-4f6c-8d1e-616767d8818b'}
Jul 30 20:36:00 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-2ca83ed5-e584-4994-8c7e-1e1256155242 tempest-TestStampPattern-75201989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:36:00 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-2ca83ed5-e584-4994-8c7e-1e1256155242 tempest-TestStampPattern-75201989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:36:00 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-2ca83ed5-e584-4994-8c7e-1e1256155242 tempest-TestStampPattern-75201989 None] Acquiring lock "cinder-quobyte-6739e9c6-fb89-4f6c-8d1e-616767d8818b-b7bff003-ef4d-4e45-bfcc-83beabf4018d" by "_create_volume_from_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:36:00 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-2ca83ed5-e584-4994-8c7e-1e1256155242 tempest-TestStampPattern-75201989 None] Lock "cinder-quobyte-6739e9c6-fb89-4f6c-8d1e-616767d8818b-b7bff003-ef4d-4e45-bfcc-83beabf4018d" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:36:00 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-2ca83ed5-e584-4994-8c7e-1e1256155242 tempest-TestStampPattern-75201989 None] Creating volume b7bff003-ef4d-4e45-bfcc-83beabf4018d from snapshot 6739e9c6-fb89-4f6c-8d1e-616767d8818b {{(pid=88719) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Jul 30 20:36:00 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-2ca83ed5-e584-4994-8c7e-1e1256155242 tempest-TestStampPattern-75201989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:36:00 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-2ca83ed5-e584-4994-8c7e-1e1256155242 tempest-TestStampPattern-75201989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:36:00 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-2ca83ed5-e584-4994-8c7e-1e1256155242 tempest-TestStampPattern-75201989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:36:00 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-2ca83ed5-e584-4994-8c7e-1e1256155242 tempest-TestStampPattern-75201989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:36:00 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-2ca83ed5-e584-4994-8c7e-1e1256155242 tempest-TestStampPattern-75201989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:36:00 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-2ca83ed5-e584-4994-8c7e-1e1256155242 tempest-TestStampPattern-75201989 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:36:00 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-2ca83ed5-e584-4994-8c7e-1e1256155242 tempest-TestStampPattern-75201989 None] Acquiring lock "cinder-quobyte-b7bff003-ef4d-4e45-bfcc-83beabf4018d" by "_copy_volume_from_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:36:00 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-2ca83ed5-e584-4994-8c7e-1e1256155242 tempest-TestStampPattern-75201989 None] Lock "cinder-quobyte-b7bff003-ef4d-4e45-bfcc-83beabf4018d" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:36:00 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-2ca83ed5-e584-4994-8c7e-1e1256155242 tempest-TestStampPattern-75201989 None] snapshot: 6739e9c6-fb89-4f6c-8d1e-616767d8818b, volume: b7bff003-ef4d-4e45-bfcc-83beabf4018d,  {{(pid=88719) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}}
Jul 30 20:36:00 devstack sudo[103713]: pam_unix(sudo:session): session closed for user root
Jul 30 20:36:00 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-2ca83ed5-e584-4994-8c7e-1e1256155242 tempest-TestStampPattern-75201989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:36:00 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-2ca83ed5-e584-4994-8c7e-1e1256155242 tempest-TestStampPattern-75201989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:36:00 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-2ca83ed5-e584-4994-8c7e-1e1256155242 tempest-TestStampPattern-75201989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:36:00 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-2ca83ed5-e584-4994-8c7e-1e1256155242 tempest-TestStampPattern-75201989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:36:00 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-2ca83ed5-e584-4994-8c7e-1e1256155242 tempest-TestStampPattern-75201989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:36:00 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-0655c5d5-d90a-4370-9960-c2e49dd40bfa tempest-VolumesSnapshotTestJSON-153537947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-ecb8e3e7-e6e7-4070-b184-6a2273b628d7" returned: 0 in 0.489s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:36:00 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-0655c5d5-d90a-4370-9960-c2e49dd40bfa tempest-VolumesSnapshotTestJSON-153537947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-ecb8e3e7-e6e7-4070-b184-6a2273b628d7 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:36:00 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[4302fc46-3cb6-44b2-a4e8-fb21265c6bc1]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:36:00 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2ca83ed5-e584-4994-8c7e-1e1256155242 tempest-TestStampPattern-75201989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0883c285-cc2b-4727-af60-5bb30a001719.6739e9c6-fb89-4f6c-8d1e-616767d8818b {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:36:00 devstack sudo[103719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-ecb8e3e7-e6e7-4070-b184-6a2273b628d7
Jul 30 20:36:00 devstack sudo[103719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:36:00 devstack sudo[103720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0883c285-cc2b-4727-af60-5bb30a001719.6739e9c6-fb89-4f6c-8d1e-616767d8818b
Jul 30 20:36:00 devstack sudo[103720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:36:00 devstack sudo[103719]: pam_unix(sudo:session): session closed for user root
Jul 30 20:36:00 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-0655c5d5-d90a-4370-9960-c2e49dd40bfa tempest-VolumesSnapshotTestJSON-153537947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-ecb8e3e7-e6e7-4070-b184-6a2273b628d7" returned: 0 in 0.302s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:36:00 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-0655c5d5-d90a-4370-9960-c2e49dd40bfa tempest-VolumesSnapshotTestJSON-153537947 None] Lock "cinder-quobyte-ecb8e3e7-e6e7-4070-b184-6a2273b628d7" released by "delete_volume" :: held 0.854s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:36:00 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-0655c5d5-d90a-4370-9960-c2e49dd40bfa tempest-VolumesSnapshotTestJSON-153537947 None] Created reservations ['d4fa0a6c-9001-4f5c-ac86-7e908fc5b5a5', '49c2ffdd-fe27-4147-9716-25e82cf6e7e0', '01ef6771-8dad-4764-bb3b-32362c6dc5d8', 'c3ef5f2f-f56a-4983-9a42-ce895ab60bfb'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:36:00 devstack sudo[103720]: pam_unix(sudo:session): session closed for user root
Jul 30 20:36:00 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-0655c5d5-d90a-4370-9960-c2e49dd40bfa tempest-VolumesSnapshotTestJSON-153537947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:36:00 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-0655c5d5-d90a-4370-9960-c2e49dd40bfa tempest-VolumesSnapshotTestJSON-153537947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:36:00 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-0655c5d5-d90a-4370-9960-c2e49dd40bfa tempest-VolumesSnapshotTestJSON-153537947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:36:00 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-0655c5d5-d90a-4370-9960-c2e49dd40bfa tempest-VolumesSnapshotTestJSON-153537947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:36:00 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-0655c5d5-d90a-4370-9960-c2e49dd40bfa tempest-VolumesSnapshotTestJSON-153537947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:36:00 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-0655c5d5-d90a-4370-9960-c2e49dd40bfa tempest-VolumesSnapshotTestJSON-153537947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:36:00 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2ca83ed5-e584-4994-8c7e-1e1256155242 tempest-TestStampPattern-75201989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0883c285-cc2b-4727-af60-5bb30a001719.6739e9c6-fb89-4f6c-8d1e-616767d8818b" returned: 0 in 0.477s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:36:00 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-2ca83ed5-e584-4994-8c7e-1e1256155242 tempest-TestStampPattern-75201989 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0883c285-cc2b-4727-af60-5bb30a001719(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88719) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 30 20:36:00 devstack sudo[103728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:36:00 devstack sudo[103728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:36:00 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c40a017-5b65-4d9f-aac7-5e841402358f]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:36:00 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2ca83ed5-e584-4994-8c7e-1e1256155242 tempest-TestStampPattern-75201989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0883c285-cc2b-4727-af60-5bb30a001719 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:36:00 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-2ebc3ace-d751-46d5-8dca-bd721f5d2859 tempest-VolumesSnapshotTestJSON-153537947 None] Acquiring lock "cinder-29aed615-bb61-4909-81a2-8058eea8547f-delete_snapshot" by "delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:36:01 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-2ebc3ace-d751-46d5-8dca-bd721f5d2859 tempest-VolumesSnapshotTestJSON-153537947 None] Lock "cinder-29aed615-bb61-4909-81a2-8058eea8547f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:36:01 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-2ebc3ace-d751-46d5-8dca-bd721f5d2859 tempest-VolumesSnapshotTestJSON-153537947 None] Acquiring lock "cinder-quobyte-92a39caa-955e-4a9e-8577-37bbafe19e55" by "delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:36:01 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-2ebc3ace-d751-46d5-8dca-bd721f5d2859 tempest-VolumesSnapshotTestJSON-153537947 None] Lock "cinder-quobyte-92a39caa-955e-4a9e-8577-37bbafe19e55" acquired by "delete_snapshot" :: waited 0.035s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:36:01 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-2ebc3ace-d751-46d5-8dca-bd721f5d2859 tempest-VolumesSnapshotTestJSON-153537947 None] Acquiring lock "cinder-quobyte-29aed615-bb61-4909-81a2-8058eea8547f" by "_delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:36:01 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-2ebc3ace-d751-46d5-8dca-bd721f5d2859 tempest-VolumesSnapshotTestJSON-153537947 None] Lock "cinder-quobyte-29aed615-bb61-4909-81a2-8058eea8547f" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:36:01 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-2ebc3ace-d751-46d5-8dca-bd721f5d2859 tempest-VolumesSnapshotTestJSON-153537947 None] Deleting offline snapshot 29aed615-bb61-4909-81a2-8058eea8547f of volume 92a39caa-955e-4a9e-8577-37bbafe19e55 {{(pid=88719) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 30 20:36:01 devstack sudo[103730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0883c285-cc2b-4727-af60-5bb30a001719
Jul 30 20:36:01 devstack sudo[103730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:36:01 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-2ebc3ace-d751-46d5-8dca-bd721f5d2859 tempest-VolumesSnapshotTestJSON-153537947 None] snapshot_file for this snap is: volume-92a39caa-955e-4a9e-8577-37bbafe19e55.29aed615-bb61-4909-81a2-8058eea8547f {{(pid=88719) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 30 20:36:01 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[97f2aea5-d733-43eb-baab-88f7a0e87d9c]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:36:01 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2ebc3ace-d751-46d5-8dca-bd721f5d2859 tempest-VolumesSnapshotTestJSON-153537947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-92a39caa-955e-4a9e-8577-37bbafe19e55.29aed615-bb61-4909-81a2-8058eea8547f {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:36:01 devstack sudo[103728]: pam_unix(sudo:session): session closed for user root
Jul 30 20:36:01 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-0655c5d5-d90a-4370-9960-c2e49dd40bfa tempest-VolumesSnapshotTestJSON-153537947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.399s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:36:01 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-0655c5d5-d90a-4370-9960-c2e49dd40bfa tempest-VolumesSnapshotTestJSON-153537947 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:36:01 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-0655c5d5-d90a-4370-9960-c2e49dd40bfa tempest-VolumesSnapshotTestJSON-153537947 None] Deleted volume successfully.
Jul 30 20:36:01 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-0655c5d5-d90a-4370-9960-c2e49dd40bfa tempest-VolumesSnapshotTestJSON-153537947 None] Lock "cinder-ecb8e3e7-e6e7-4070-b184-6a2273b628d7-delete_volume" released by "delete_volume" :: held 1.610s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:36:01 devstack sudo[103733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-92a39caa-955e-4a9e-8577-37bbafe19e55.29aed615-bb61-4909-81a2-8058eea8547f
Jul 30 20:36:01 devstack sudo[103733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:36:01 devstack sudo[103730]: pam_unix(sudo:session): session closed for user root
Jul 30 20:36:01 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2ca83ed5-e584-4994-8c7e-1e1256155242 tempest-TestStampPattern-75201989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0883c285-cc2b-4727-af60-5bb30a001719" returned: 0 in 0.738s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:36:01 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-2ca83ed5-e584-4994-8c7e-1e1256155242 tempest-TestStampPattern-75201989 None] will copy from snapshot at /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0883c285-cc2b-4727-af60-5bb30a001719 {{(pid=88719) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}}
Jul 30 20:36:01 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-2ca83ed5-e584-4994-8c7e-1e1256155242 tempest-TestStampPattern-75201989 None] Creating direct copy from snapshot {{(pid=88719) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}}
Jul 30 20:36:01 devstack cinder-volume[88719]: DEBUG cinder.utils [None req-2ca83ed5-e584-4994-8c7e-1e1256155242 tempest-TestStampPattern-75201989 None] Path /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b7bff003-ef4d-4e45-bfcc-83beabf4018d not found in is_blk_device check {{(pid=88719) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 30 20:36:01 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2ca83ed5-e584-4994-8c7e-1e1256155242 tempest-TestStampPattern-75201989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0883c285-cc2b-4727-af60-5bb30a001719 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b7bff003-ef4d-4e45-bfcc-83beabf4018d {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:36:01 devstack sudo[103778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0883c285-cc2b-4727-af60-5bb30a001719 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b7bff003-ef4d-4e45-bfcc-83beabf4018d
Jul 30 20:36:01 devstack sudo[103778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:36:01 devstack sudo[103733]: pam_unix(sudo:session): session closed for user root
Jul 30 20:36:01 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2ebc3ace-d751-46d5-8dca-bd721f5d2859 tempest-VolumesSnapshotTestJSON-153537947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-92a39caa-955e-4a9e-8577-37bbafe19e55.29aed615-bb61-4909-81a2-8058eea8547f" returned: 0 in 0.567s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:36:01 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-2ebc3ace-d751-46d5-8dca-bd721f5d2859 tempest-VolumesSnapshotTestJSON-153537947 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-92a39caa-955e-4a9e-8577-37bbafe19e55(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88719) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 30 20:36:01 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c95e631-470f-4dd6-b2fc-f4ff2253d32c]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:36:01 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2ebc3ace-d751-46d5-8dca-bd721f5d2859 tempest-VolumesSnapshotTestJSON-153537947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-92a39caa-955e-4a9e-8577-37bbafe19e55 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:36:01 devstack sudo[103780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-92a39caa-955e-4a9e-8577-37bbafe19e55
Jul 30 20:36:01 devstack sudo[103780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:36:02 devstack sudo[103780]: pam_unix(sudo:session): session closed for user root
Jul 30 20:36:02 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2ebc3ace-d751-46d5-8dca-bd721f5d2859 tempest-VolumesSnapshotTestJSON-153537947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-92a39caa-955e-4a9e-8577-37bbafe19e55" returned: 0 in 0.906s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:36:02 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2ebc3ace-d751-46d5-8dca-bd721f5d2859 tempest-VolumesSnapshotTestJSON-153537947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-92a39caa-955e-4a9e-8577-37bbafe19e55.29aed615-bb61-4909-81a2-8058eea8547f {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:36:02 devstack sudo[103796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-92a39caa-955e-4a9e-8577-37bbafe19e55.29aed615-bb61-4909-81a2-8058eea8547f
Jul 30 20:36:02 devstack sudo[103796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:36:03 devstack sudo[103796]: pam_unix(sudo:session): session closed for user root
Jul 30 20:36:03 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2ebc3ace-d751-46d5-8dca-bd721f5d2859 tempest-VolumesSnapshotTestJSON-153537947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-92a39caa-955e-4a9e-8577-37bbafe19e55.29aed615-bb61-4909-81a2-8058eea8547f" returned: 0 in 1.032s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:36:03 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2ebc3ace-d751-46d5-8dca-bd721f5d2859 tempest-VolumesSnapshotTestJSON-153537947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-92a39caa-955e-4a9e-8577-37bbafe19e55.29aed615-bb61-4909-81a2-8058eea8547f {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:36:03 devstack sudo[103803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-92a39caa-955e-4a9e-8577-37bbafe19e55.29aed615-bb61-4909-81a2-8058eea8547f
Jul 30 20:36:03 devstack sudo[103803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:36:04 devstack sudo[103803]: pam_unix(sudo:session): session closed for user root
Jul 30 20:36:04 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2ebc3ace-d751-46d5-8dca-bd721f5d2859 tempest-VolumesSnapshotTestJSON-153537947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-92a39caa-955e-4a9e-8577-37bbafe19e55.29aed615-bb61-4909-81a2-8058eea8547f" returned: 0 in 0.599s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:36:04 devstack cinder-volume[88719]: DEBUG dbcounter [-] [88719] Writing DB stats cinder:UPDATE=121,cinder:SELECT=105,cinder:INSERT=25,cinder:DELETE=9 {{(pid=88719) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 30 20:36:04 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-2ebc3ace-d751-46d5-8dca-bd721f5d2859 tempest-VolumesSnapshotTestJSON-153537947 None] Lock "cinder-quobyte-29aed615-bb61-4909-81a2-8058eea8547f" released by "_delete_snapshot" :: held 3.361s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:36:04 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-2ebc3ace-d751-46d5-8dca-bd721f5d2859 tempest-VolumesSnapshotTestJSON-153537947 None] Lock "cinder-quobyte-92a39caa-955e-4a9e-8577-37bbafe19e55" released by "delete_snapshot" :: held 3.436s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:36:04 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-2ebc3ace-d751-46d5-8dca-bd721f5d2859 tempest-VolumesSnapshotTestJSON-153537947 None] Created reservations ['24def7c6-dba1-49bf-84b8-bea5f9f55d24', '8fec9bb9-aed8-4a0f-a1d1-c5fa13916c74', 'c54d1850-4bf3-47f8-818a-78fa9e8f50ea', '84816220-bb9e-4c3c-bacd-6b3b305027ee'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:36:04 devstack cinder-volume[88719]: DEBUG dbcounter [-] [88719] Writing DB stats cinder:UPDATE=102,cinder:DELETE=12,cinder:SELECT=102,cinder:INSERT=29 {{(pid=88719) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 30 20:36:04 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-2ebc3ace-d751-46d5-8dca-bd721f5d2859 tempest-VolumesSnapshotTestJSON-153537947 None] Delete snapshot completed successfully.
Jul 30 20:36:04 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-2ebc3ace-d751-46d5-8dca-bd721f5d2859 tempest-VolumesSnapshotTestJSON-153537947 None] Lock "cinder-29aed615-bb61-4909-81a2-8058eea8547f-delete_snapshot" released by "delete_snapshot" :: held 3.945s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:36:05 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-11ccb9c7-f312-4cfd-9c11-df1182697081 tempest-VolumesSnapshotTestJSON-153537947 None] Acquiring lock "cinder-92a39caa-955e-4a9e-8577-37bbafe19e55-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:36:05 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-11ccb9c7-f312-4cfd-9c11-df1182697081 tempest-VolumesSnapshotTestJSON-153537947 None] Lock "cinder-92a39caa-955e-4a9e-8577-37bbafe19e55-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:36:06 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-11ccb9c7-f312-4cfd-9c11-df1182697081 tempest-VolumesSnapshotTestJSON-153537947 None] Acquiring lock "cinder-quobyte-92a39caa-955e-4a9e-8577-37bbafe19e55" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:36:06 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-11ccb9c7-f312-4cfd-9c11-df1182697081 tempest-VolumesSnapshotTestJSON-153537947 None] Lock "cinder-quobyte-92a39caa-955e-4a9e-8577-37bbafe19e55" acquired by "delete_volume" :: waited 0.083s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:36:06 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[6311afd5-1d48-4c30-ba35-5610d56cc1f0]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:36:06 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-11ccb9c7-f312-4cfd-9c11-df1182697081 tempest-VolumesSnapshotTestJSON-153537947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-92a39caa-955e-4a9e-8577-37bbafe19e55 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:36:06 devstack sudo[103808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-92a39caa-955e-4a9e-8577-37bbafe19e55
Jul 30 20:36:06 devstack sudo[103808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:36:07 devstack sudo[103808]: pam_unix(sudo:session): session closed for user root
Jul 30 20:36:07 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-11ccb9c7-f312-4cfd-9c11-df1182697081 tempest-VolumesSnapshotTestJSON-153537947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-92a39caa-955e-4a9e-8577-37bbafe19e55" returned: 0 in 1.343s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:36:07 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-11ccb9c7-f312-4cfd-9c11-df1182697081 tempest-VolumesSnapshotTestJSON-153537947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-92a39caa-955e-4a9e-8577-37bbafe19e55 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:36:07 devstack sudo[103819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-92a39caa-955e-4a9e-8577-37bbafe19e55
Jul 30 20:36:07 devstack sudo[103819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:36:08 devstack sudo[103819]: pam_unix(sudo:session): session closed for user root
Jul 30 20:36:08 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-11ccb9c7-f312-4cfd-9c11-df1182697081 tempest-VolumesSnapshotTestJSON-153537947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-92a39caa-955e-4a9e-8577-37bbafe19e55" returned: 0 in 0.670s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:36:08 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-11ccb9c7-f312-4cfd-9c11-df1182697081 tempest-VolumesSnapshotTestJSON-153537947 None] Lock "cinder-quobyte-92a39caa-955e-4a9e-8577-37bbafe19e55" released by "delete_volume" :: held 2.216s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:36:08 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-11ccb9c7-f312-4cfd-9c11-df1182697081 tempest-VolumesSnapshotTestJSON-153537947 None] Created reservations ['30576f94-4c8b-4bbc-b9b6-e91fdb0dc974', '26506afb-66aa-438a-a600-ddf5f7572987', '9894728e-6205-4cab-8139-fe621036bcb8', 'd65f2638-4fcb-45e7-a3bb-2bbdd098e0d8'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:36:08 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-11ccb9c7-f312-4cfd-9c11-df1182697081 tempest-VolumesSnapshotTestJSON-153537947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:36:08 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-11ccb9c7-f312-4cfd-9c11-df1182697081 tempest-VolumesSnapshotTestJSON-153537947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:36:08 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-11ccb9c7-f312-4cfd-9c11-df1182697081 tempest-VolumesSnapshotTestJSON-153537947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:36:08 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-11ccb9c7-f312-4cfd-9c11-df1182697081 tempest-VolumesSnapshotTestJSON-153537947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:36:08 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-11ccb9c7-f312-4cfd-9c11-df1182697081 tempest-VolumesSnapshotTestJSON-153537947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:36:08 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-11ccb9c7-f312-4cfd-9c11-df1182697081 tempest-VolumesSnapshotTestJSON-153537947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:36:08 devstack sudo[103822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:36:08 devstack sudo[103822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:36:09 devstack sudo[103778]: pam_unix(sudo:session): session closed for user root
Jul 30 20:36:09 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2ca83ed5-e584-4994-8c7e-1e1256155242 tempest-TestStampPattern-75201989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0883c285-cc2b-4727-af60-5bb30a001719 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b7bff003-ef4d-4e45-bfcc-83beabf4018d" returned: 0 in 7.568s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:36:09 devstack cinder-volume[88719]: DEBUG cinder.image.image_utils [None req-2ca83ed5-e584-4994-8c7e-1e1256155242 tempest-TestStampPattern-75201989 None] Image conversion details: src /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0883c285-cc2b-4727-af60-5bb30a001719, size 1024.00 MB, duration 7.57 sec, destination /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b7bff003-ef4d-4e45-bfcc-83beabf4018d {{(pid=88719) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 30 20:36:09 devstack cinder-volume[88719]: INFO cinder.image.image_utils [None req-2ca83ed5-e584-4994-8c7e-1e1256155242 tempest-TestStampPattern-75201989 None] Converted 1024.00 MB image at 135.28 MB/s
Jul 30 20:36:09 devstack cinder-volume[88719]: WARNING cinder.volume.drivers.remotefs [None req-2ca83ed5-e584-4994-8c7e-1e1256155242 tempest-TestStampPattern-75201989 None] /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b7bff003-ef4d-4e45-bfcc-83beabf4018d is being set with open permissions: ugo+rw
Jul 30 20:36:09 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2ca83ed5-e584-4994-8c7e-1e1256155242 tempest-TestStampPattern-75201989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b7bff003-ef4d-4e45-bfcc-83beabf4018d {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:36:09 devstack sudo[103822]: pam_unix(sudo:session): session closed for user root
Jul 30 20:36:09 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-11ccb9c7-f312-4cfd-9c11-df1182697081 tempest-VolumesSnapshotTestJSON-153537947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.571s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:36:09 devstack sudo[103826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b7bff003-ef4d-4e45-bfcc-83beabf4018d
Jul 30 20:36:09 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-11ccb9c7-f312-4cfd-9c11-df1182697081 tempest-VolumesSnapshotTestJSON-153537947 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:36:09 devstack sudo[103826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:36:09 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-11ccb9c7-f312-4cfd-9c11-df1182697081 tempest-VolumesSnapshotTestJSON-153537947 None] Deleted volume successfully.
Jul 30 20:36:09 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-11ccb9c7-f312-4cfd-9c11-df1182697081 tempest-VolumesSnapshotTestJSON-153537947 None] Lock "cinder-92a39caa-955e-4a9e-8577-37bbafe19e55-delete_volume" released by "delete_volume" :: held 3.371s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:36:09 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-9adc917e-c55f-4a70-880c-71bab5733f18 tempest-TestShelveInstance-274392155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:36:09 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-9adc917e-c55f-4a70-880c-71bab5733f18 tempest-TestShelveInstance-274392155 None] Flow 'volume_create_manager' (b4d60006-4075-46ce-bb6f-d3fca7b7bbd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:36:09 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-9adc917e-c55f-4a70-880c-71bab5733f18 tempest-TestShelveInstance-274392155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a600e13d-4551-4351-9077-5df156501ce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:36:09 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-9adc917e-c55f-4a70-880c-71bab5733f18 tempest-TestShelveInstance-274392155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a600e13d-4551-4351-9077-5df156501ce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:36:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1502827168',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4671154d-1d6a-4b5d-a064-aebe543423a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35d2d82943814622b1a897de8a86e44d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:36:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:36:09Z,use_quota=True,user_id='c3ce078003b442719ad218eab43a71c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:36:09 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-9adc917e-c55f-4a70-880c-71bab5733f18 tempest-TestShelveInstance-274392155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8be308d8-b0f6-4c56-b66f-3c9fc746f62d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:36:09 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-9adc917e-c55f-4a70-880c-71bab5733f18 tempest-TestShelveInstance-274392155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8be308d8-b0f6-4c56-b66f-3c9fc746f62d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:36:09 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-9adc917e-c55f-4a70-880c-71bab5733f18 tempest-TestShelveInstance-274392155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43cd1756-e430-4dea-adcb-305c05110cd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:36:09 devstack cinder-volume[88719]: DEBUG cinder.image.glance [None req-9adc917e-c55f-4a70-880c-71bab5733f18 tempest-TestShelveInstance-274392155 None] Creating Keystone auth plugin from conf {{(pid=88719) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 30 20:36:09 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-c53c9ace-b16a-47ab-9823-a6dfb292203b tempest-VolumesSnapshotTestJSON-153537947 None] Acquiring lock "cinder-d81db8c5-08e1-4d1a-a9c4-ab770f1c9fb0-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:36:09 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-c53c9ace-b16a-47ab-9823-a6dfb292203b tempest-VolumesSnapshotTestJSON-153537947 None] Lock "cinder-d81db8c5-08e1-4d1a-a9c4-ab770f1c9fb0-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:36:09 devstack sudo[103826]: pam_unix(sudo:session): session closed for user root
Jul 30 20:36:09 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2ca83ed5-e584-4994-8c7e-1e1256155242 tempest-TestStampPattern-75201989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b7bff003-ef4d-4e45-bfcc-83beabf4018d" returned: 0 in 0.615s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:36:09 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-c53c9ace-b16a-47ab-9823-a6dfb292203b tempest-VolumesSnapshotTestJSON-153537947 None] Acquiring lock "cinder-quobyte-d81db8c5-08e1-4d1a-a9c4-ab770f1c9fb0" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:36:09 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-2ca83ed5-e584-4994-8c7e-1e1256155242 tempest-TestStampPattern-75201989 None] Lock "cinder-quobyte-b7bff003-ef4d-4e45-bfcc-83beabf4018d" released by "_copy_volume_from_snapshot" :: held 9.516s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:36:09 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-c53c9ace-b16a-47ab-9823-a6dfb292203b tempest-VolumesSnapshotTestJSON-153537947 None] Lock "cinder-quobyte-d81db8c5-08e1-4d1a-a9c4-ab770f1c9fb0" acquired by "delete_volume" :: waited 0.034s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:36:09 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e690eca-baae-4506-83c1-6e864677d08a]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:36:09 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-c53c9ace-b16a-47ab-9823-a6dfb292203b tempest-VolumesSnapshotTestJSON-153537947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d81db8c5-08e1-4d1a-a9c4-ab770f1c9fb0 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:36:09 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-2ca83ed5-e584-4994-8c7e-1e1256155242 tempest-TestStampPattern-75201989 None] Lock "cinder-quobyte-6739e9c6-fb89-4f6c-8d1e-616767d8818b-b7bff003-ef4d-4e45-bfcc-83beabf4018d" released by "_create_volume_from_snapshot" :: held 9.655s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:36:09 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-2ca83ed5-e584-4994-8c7e-1e1256155242 tempest-TestStampPattern-75201989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.673s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:36:09 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2ca83ed5-e584-4994-8c7e-1e1256155242 tempest-TestStampPattern-75201989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5ecf38b-096f-4b55-badc-e741b63b95b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7bff003-ef4d-4e45-bfcc-83beabf4018d', 'volume_size': 1, 'snapshot_id': '6739e9c6-fb89-4f6c-8d1e-616767d8818b'}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:36:09 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2ca83ed5-e584-4994-8c7e-1e1256155242 tempest-TestStampPattern-75201989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d2c0b17-3961-45f9-b643-30b7ad959c08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:36:10 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-2ca83ed5-e584-4994-8c7e-1e1256155242 tempest-TestStampPattern-75201989 None] Volume volume-b7bff003-ef4d-4e45-bfcc-83beabf4018d (b7bff003-ef4d-4e45-bfcc-83beabf4018d): created successfully
Jul 30 20:36:10 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2ca83ed5-e584-4994-8c7e-1e1256155242 tempest-TestStampPattern-75201989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d2c0b17-3961-45f9-b643-30b7ad959c08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:36:10 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2ca83ed5-e584-4994-8c7e-1e1256155242 tempest-TestStampPattern-75201989 None] Flow 'volume_create_manager' (b6d2e920-9ba2-4c82-9e8c-0696fd3b7217) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:36:10 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-2ca83ed5-e584-4994-8c7e-1e1256155242 tempest-TestStampPattern-75201989 None] Created volume successfully.
Jul 30 20:36:10 devstack sudo[103841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d81db8c5-08e1-4d1a-a9c4-ab770f1c9fb0
Jul 30 20:36:10 devstack sudo[103841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:36:10 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-9adc917e-c55f-4a70-880c-71bab5733f18 tempest-TestShelveInstance-274392155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43cd1756-e430-4dea-adcb-305c05110cd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4671154d-1d6a-4b5d-a064-aebe543423a0', 'volume_name': 'volume-4671154d-1d6a-4b5d-a064-aebe543423a0', 'volume_size': 1, 'image_id': '1ed21181-aca9-4608-89cf-131c66236dc1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1ed21181-aca9-4608-89cf-131c66236dc1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ec1eaae7620840deac2e426a7e923b06', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1ed21181-aca9-4608-89cf-131c66236dc1', 'created_at': datetime.datetime(2026, 7, 30, 18, 17, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 18, 17, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1ed21181-aca9-4608-89cf-131c66236dc1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x786884611f70>}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:36:10 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-9adc917e-c55f-4a70-880c-71bab5733f18 tempest-TestShelveInstance-274392155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd395f1c-8aaf-40a0-b1cf-97ffc0cb0f20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:36:10 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-9adc917e-c55f-4a70-880c-71bab5733f18 tempest-TestShelveInstance-274392155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd395f1c-8aaf-40a0-b1cf-97ffc0cb0f20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:36:10 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-9adc917e-c55f-4a70-880c-71bab5733f18 tempest-TestShelveInstance-274392155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6a15834-aeea-48ce-aa26-1ad733fdc44b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:36:10 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-9adc917e-c55f-4a70-880c-71bab5733f18 tempest-TestShelveInstance-274392155 None] Volume 4671154d-1d6a-4b5d-a064-aebe543423a0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4671154d-1d6a-4b5d-a064-aebe543423a0', 'volume_size': 1, 'image_id': '1ed21181-aca9-4608-89cf-131c66236dc1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1ed21181-aca9-4608-89cf-131c66236dc1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ec1eaae7620840deac2e426a7e923b06', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1ed21181-aca9-4608-89cf-131c66236dc1', 'created_at': datetime.datetime(2026, 7, 30, 18, 17, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 18, 17, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1ed21181-aca9-4608-89cf-131c66236dc1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x786884611f70>}
Jul 30 20:36:10 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-9adc917e-c55f-4a70-880c-71bab5733f18 tempest-TestShelveInstance-274392155 None] Trying to clone 4671154d-1d6a-4b5d-a064-aebe543423a0 from image 1ed21181-aca9-4608-89cf-131c66236dc1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/1ed21181-aca9-4608-89cf-131c66236dc1', 'metadata': {}}]). {{(pid=88719) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 30 20:36:10 devstack sudo[103841]: pam_unix(sudo:session): session closed for user root
Jul 30 20:36:10 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-c53c9ace-b16a-47ab-9823-a6dfb292203b tempest-VolumesSnapshotTestJSON-153537947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d81db8c5-08e1-4d1a-a9c4-ab770f1c9fb0" returned: 0 in 0.619s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:36:10 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-c53c9ace-b16a-47ab-9823-a6dfb292203b tempest-VolumesSnapshotTestJSON-153537947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d81db8c5-08e1-4d1a-a9c4-ab770f1c9fb0 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:36:10 devstack sudo[103860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d81db8c5-08e1-4d1a-a9c4-ab770f1c9fb0
Jul 30 20:36:10 devstack sudo[103860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:36:10 devstack cinder-volume[88719]: DEBUG cinder.image.image_utils [None req-9adc917e-c55f-4a70-880c-71bab5733f18 tempest-TestShelveInstance-274392155 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1ed21181-aca9-4608-89cf-131c66236dc1_jfe638ixdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88719) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 30 20:36:10 devstack cinder-volume[88719]: INFO cinder.image.image_utils [None req-9adc917e-c55f-4a70-880c-71bab5733f18 tempest-TestShelveInstance-274392155 None] Image download 20.69 MB at 20.69 MB/s
Jul 30 20:36:10 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[a84416d4-4999-42d4-81bd-ae568d1642f2]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:36:10 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-9adc917e-c55f-4a70-880c-71bab5733f18 tempest-TestShelveInstance-274392155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1ed21181-aca9-4608-89cf-131c66236dc1_jfe638ixdevstack@QuobyteHD {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:36:10 devstack sudo[103860]: pam_unix(sudo:session): session closed for user root
Jul 30 20:36:10 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-c53c9ace-b16a-47ab-9823-a6dfb292203b tempest-VolumesSnapshotTestJSON-153537947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d81db8c5-08e1-4d1a-a9c4-ab770f1c9fb0" returned: 0 in 0.347s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:36:10 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-c53c9ace-b16a-47ab-9823-a6dfb292203b tempest-VolumesSnapshotTestJSON-153537947 None] Lock "cinder-quobyte-d81db8c5-08e1-4d1a-a9c4-ab770f1c9fb0" released by "delete_volume" :: held 1.048s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:36:10 devstack sudo[103863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1ed21181-aca9-4608-89cf-131c66236dc1_jfe638ixdevstack@QuobyteHD
Jul 30 20:36:10 devstack sudo[103863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:36:10 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-c53c9ace-b16a-47ab-9823-a6dfb292203b tempest-VolumesSnapshotTestJSON-153537947 None] Created reservations ['95be95d4-843f-4eca-9145-147c882bdfe5', '59082913-afe5-4b1b-baee-6abd19a04068', 'ae49df7d-3bf3-4e3f-9ed7-a328c3fc0be3', '29478fba-8613-4776-8e10-e130b614cef6'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:36:11 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-c53c9ace-b16a-47ab-9823-a6dfb292203b tempest-VolumesSnapshotTestJSON-153537947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:36:11 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-c53c9ace-b16a-47ab-9823-a6dfb292203b tempest-VolumesSnapshotTestJSON-153537947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:36:11 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-c53c9ace-b16a-47ab-9823-a6dfb292203b tempest-VolumesSnapshotTestJSON-153537947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:36:11 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-c53c9ace-b16a-47ab-9823-a6dfb292203b tempest-VolumesSnapshotTestJSON-153537947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:36:11 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-c53c9ace-b16a-47ab-9823-a6dfb292203b tempest-VolumesSnapshotTestJSON-153537947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:36:11 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-c53c9ace-b16a-47ab-9823-a6dfb292203b tempest-VolumesSnapshotTestJSON-153537947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:36:11 devstack sudo[103882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:36:11 devstack sudo[103882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:36:11 devstack sudo[103863]: pam_unix(sudo:session): session closed for user root
Jul 30 20:36:11 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-9adc917e-c55f-4a70-880c-71bab5733f18 tempest-TestShelveInstance-274392155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1ed21181-aca9-4608-89cf-131c66236dc1_jfe638ixdevstack@QuobyteHD" returned: 0 in 0.503s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:36:11 devstack cinder-volume[88719]: DEBUG cinder.image.image_utils [None req-9adc917e-c55f-4a70-880c-71bab5733f18 tempest-TestShelveInstance-274392155 None] Temporary image 1ed21181-aca9-4608-89cf-131c66236dc1 is fetched for user c3ce078003b442719ad218eab43a71c7. {{(pid=88719) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 30 20:36:11 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[36fbd69a-2e7c-49ec-9a45-db5118364f9f]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:36:11 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-9adc917e-c55f-4a70-880c-71bab5733f18 tempest-TestShelveInstance-274392155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1ed21181-aca9-4608-89cf-131c66236dc1_jfe638ixdevstack@QuobyteHD {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:36:11 devstack sudo[103882]: pam_unix(sudo:session): session closed for user root
Jul 30 20:36:11 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-c53c9ace-b16a-47ab-9823-a6dfb292203b tempest-VolumesSnapshotTestJSON-153537947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.367s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:36:11 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-c53c9ace-b16a-47ab-9823-a6dfb292203b tempest-VolumesSnapshotTestJSON-153537947 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:36:11 devstack sudo[103893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1ed21181-aca9-4608-89cf-131c66236dc1_jfe638ixdevstack@QuobyteHD
Jul 30 20:36:11 devstack sudo[103893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:36:11 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-c53c9ace-b16a-47ab-9823-a6dfb292203b tempest-VolumesSnapshotTestJSON-153537947 None] Deleted volume successfully.
Jul 30 20:36:11 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-c53c9ace-b16a-47ab-9823-a6dfb292203b tempest-VolumesSnapshotTestJSON-153537947 None] Lock "cinder-d81db8c5-08e1-4d1a-a9c4-ab770f1c9fb0-delete_volume" released by "delete_volume" :: held 1.950s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:36:11 devstack sudo[103893]: pam_unix(sudo:session): session closed for user root
Jul 30 20:36:11 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-9adc917e-c55f-4a70-880c-71bab5733f18 tempest-TestShelveInstance-274392155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1ed21181-aca9-4608-89cf-131c66236dc1_jfe638ixdevstack@QuobyteHD" returned: 0 in 0.452s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:36:11 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-9adc917e-c55f-4a70-880c-71bab5733f18 tempest-TestShelveInstance-274392155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:36:11 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-9adc917e-c55f-4a70-880c-71bab5733f18 tempest-TestShelveInstance-274392155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:36:11 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-9adc917e-c55f-4a70-880c-71bab5733f18 tempest-TestShelveInstance-274392155 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:36:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1502827168',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4671154d-1d6a-4b5d-a064-aebe543423a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35d2d82943814622b1a897de8a86e44d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:36:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:36:09Z,use_quota=True,user_id='c3ce078003b442719ad218eab43a71c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:36:11 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-9adc917e-c55f-4a70-880c-71bab5733f18 tempest-TestShelveInstance-274392155 None] Creating volume 4671154d-1d6a-4b5d-a064-aebe543423a0 {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:36:11 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-9adc917e-c55f-4a70-880c-71bab5733f18 tempest-TestShelveInstance-274392155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:36:11 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-9adc917e-c55f-4a70-880c-71bab5733f18 tempest-TestShelveInstance-274392155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:36:11 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-9adc917e-c55f-4a70-880c-71bab5733f18 tempest-TestShelveInstance-274392155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:36:11 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-9adc917e-c55f-4a70-880c-71bab5733f18 tempest-TestShelveInstance-274392155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:36:11 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-9adc917e-c55f-4a70-880c-71bab5733f18 tempest-TestShelveInstance-274392155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:36:11 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-9adc917e-c55f-4a70-880c-71bab5733f18 tempest-TestShelveInstance-274392155 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:36:11 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-9adc917e-c55f-4a70-880c-71bab5733f18 tempest-TestShelveInstance-274392155 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:36:11 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-9adc917e-c55f-4a70-880c-71bab5733f18 tempest-TestShelveInstance-274392155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-4671154d-1d6a-4b5d-a064-aebe543423a0 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:36:11 devstack sudo[103913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-4671154d-1d6a-4b5d-a064-aebe543423a0 1073741824
Jul 30 20:36:11 devstack sudo[103913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:36:12 devstack sudo[103913]: pam_unix(sudo:session): session closed for user root
Jul 30 20:36:12 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-9adc917e-c55f-4a70-880c-71bab5733f18 tempest-TestShelveInstance-274392155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-4671154d-1d6a-4b5d-a064-aebe543423a0 1073741824" returned: 0 in 0.489s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:36:12 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-9adc917e-c55f-4a70-880c-71bab5733f18 tempest-TestShelveInstance-274392155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-4671154d-1d6a-4b5d-a064-aebe543423a0 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:36:12 devstack sudo[103940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-4671154d-1d6a-4b5d-a064-aebe543423a0
Jul 30 20:36:12 devstack sudo[103940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:36:12 devstack sudo[103940]: pam_unix(sudo:session): session closed for user root
Jul 30 20:36:12 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-9adc917e-c55f-4a70-880c-71bab5733f18 tempest-TestShelveInstance-274392155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-4671154d-1d6a-4b5d-a064-aebe543423a0" returned: 0 in 0.279s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:36:12 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-9adc917e-c55f-4a70-880c-71bab5733f18 tempest-TestShelveInstance-274392155 None] <== create_volume: return (826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:36:12 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-9adc917e-c55f-4a70-880c-71bab5733f18 tempest-TestShelveInstance-274392155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.830s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:36:12 devstack cinder-volume[88719]: DEBUG cinder.volume.volume_utils [None req-9adc917e-c55f-4a70-880c-71bab5733f18 tempest-TestShelveInstance-274392155 None] Attempting download of 1ed21181-aca9-4608-89cf-131c66236dc1 ((None, [{'url': 'file:///opt/stack/data/glance/images/1ed21181-aca9-4608-89cf-131c66236dc1', 'metadata': {}}])) to volume 4671154d-1d6a-4b5d-a064-aebe543423a0. {{(pid=88719) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 30 20:36:12 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf86b33e-319e-4bc6-b627-5a3af805d878]: (4, 'raw') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:36:12 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-9adc917e-c55f-4a70-880c-71bab5733f18 tempest-TestShelveInstance-274392155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1ed21181-aca9-4608-89cf-131c66236dc1_jtls_qwy {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:36:12 devstack sudo[103943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1ed21181-aca9-4608-89cf-131c66236dc1_jtls_qwy
Jul 30 20:36:12 devstack sudo[103943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:36:13 devstack sudo[103943]: pam_unix(sudo:session): session closed for user root
Jul 30 20:36:13 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-9adc917e-c55f-4a70-880c-71bab5733f18 tempest-TestShelveInstance-274392155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1ed21181-aca9-4608-89cf-131c66236dc1_jtls_qwy" returned: 0 in 0.419s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:36:13 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-9adc917e-c55f-4a70-880c-71bab5733f18 tempest-TestShelveInstance-274392155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1ed21181-aca9-4608-89cf-131c66236dc1_jtls_qwy {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:36:13 devstack sudo[103947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1ed21181-aca9-4608-89cf-131c66236dc1_jtls_qwy
Jul 30 20:36:13 devstack sudo[103947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:36:13 devstack sudo[103947]: pam_unix(sudo:session): session closed for user root
Jul 30 20:36:13 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-9adc917e-c55f-4a70-880c-71bab5733f18 tempest-TestShelveInstance-274392155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1ed21181-aca9-4608-89cf-131c66236dc1_jtls_qwy" returned: 1 in 0.495s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:36:13 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-9adc917e-c55f-4a70-880c-71bab5733f18 tempest-TestShelveInstance-274392155 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1ed21181-aca9-4608-89cf-131c66236dc1_jtls_qwy' failed. Not Retrying. {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 30 20:36:13 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f9f9658-669a-403c-911d-662f5b4255eb]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:36:13 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-9adc917e-c55f-4a70-880c-71bab5733f18 tempest-TestShelveInstance-274392155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1ed21181-aca9-4608-89cf-131c66236dc1_jfe638ixdevstack@QuobyteHD {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:36:13 devstack sudo[103954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1ed21181-aca9-4608-89cf-131c66236dc1_jfe638ixdevstack@QuobyteHD
Jul 30 20:36:13 devstack sudo[103954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:36:14 devstack sudo[103954]: pam_unix(sudo:session): session closed for user root
Jul 30 20:36:14 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-9adc917e-c55f-4a70-880c-71bab5733f18 tempest-TestShelveInstance-274392155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1ed21181-aca9-4608-89cf-131c66236dc1_jfe638ixdevstack@QuobyteHD" returned: 0 in 0.365s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:36:14 devstack cinder-volume[88719]: DEBUG cinder.image.image_utils [None req-9adc917e-c55f-4a70-880c-71bab5733f18 tempest-TestShelveInstance-274392155 None] 1ed21181-aca9-4608-89cf-131c66236dc1 was qcow2, converting to qcow2 {{(pid=88719) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 30 20:36:14 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-9adc917e-c55f-4a70-880c-71bab5733f18 tempest-TestShelveInstance-274392155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1ed21181-aca9-4608-89cf-131c66236dc1_jfe638ixdevstack@QuobyteHD /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-4671154d-1d6a-4b5d-a064-aebe543423a0 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:36:14 devstack sudo[103959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1ed21181-aca9-4608-89cf-131c66236dc1_jfe638ixdevstack@QuobyteHD /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-4671154d-1d6a-4b5d-a064-aebe543423a0
Jul 30 20:36:14 devstack sudo[103959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:36:16 devstack cinder-volume[88719]: DEBUG oslo_service.periodic_task [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88719) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 30 20:36:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:36:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:36:16 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:36:16 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:36:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:36:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:36:16 devstack sudo[103969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:36:16 devstack sudo[103969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:36:16 devstack sudo[103959]: pam_unix(sudo:session): session closed for user root
Jul 30 20:36:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-9adc917e-c55f-4a70-880c-71bab5733f18 tempest-TestShelveInstance-274392155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1ed21181-aca9-4608-89cf-131c66236dc1_jfe638ixdevstack@QuobyteHD /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-4671154d-1d6a-4b5d-a064-aebe543423a0" returned: 0 in 2.677s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:36:16 devstack cinder-volume[88719]: DEBUG cinder.image.image_utils [None req-9adc917e-c55f-4a70-880c-71bab5733f18 tempest-TestShelveInstance-274392155 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1ed21181-aca9-4608-89cf-131c66236dc1_jfe638ixdevstack@QuobyteHD, size 112.00 MB, duration 2.68 sec, destination /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-4671154d-1d6a-4b5d-a064-aebe543423a0 {{(pid=88719) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 30 20:36:16 devstack cinder-volume[88719]: INFO cinder.image.image_utils [None req-9adc917e-c55f-4a70-880c-71bab5733f18 tempest-TestShelveInstance-274392155 None] Converted 112.00 MB image at 41.78 MB/s
Jul 30 20:36:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-9adc917e-c55f-4a70-880c-71bab5733f18 tempest-TestShelveInstance-274392155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-4671154d-1d6a-4b5d-a064-aebe543423a0 1G {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:36:16 devstack sudo[103972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-4671154d-1d6a-4b5d-a064-aebe543423a0 1G
Jul 30 20:36:16 devstack sudo[103972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:36:16 devstack sudo[103969]: pam_unix(sudo:session): session closed for user root
Jul 30 20:36:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.387s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:36:16 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:36:16 devstack cinder-volume[88719]: DEBUG oslo_service.periodic_task [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Running periodic task VolumeManager._thread_info {{(pid=88719) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 30 20:36:16 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] thread count: 28 {{(pid=88719) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 30 20:36:16 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] thread info: [<_MainThread(MainThread, started 132390416908416)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132390306497536)>, <Thread(Thread-3 (stat_writer), started daemon 132390304471680)>, <Thread(Rabbit-heartbeat, started daemon 132390303393408)>, <Thread(Thread-5 (_runner), started daemon 132390303543168)>, <Thread(Thread-7 (_runner), started daemon 132390303563392)>, <Thread(fd_logger, started daemon 132390301344640)>, <Thread(privsep_reader, started daemon 132390301560640)>, <Thread(tpool_thread_0, started daemon 132390291470016)>, <Thread(tpool_thread_1, started daemon 132390283077312)>, <Thread(tpool_thread_2, started daemon 132390274684608)>, <Thread(tpool_thread_3, started daemon 132390266291904)>, <Thread(tpool_thread_4, started daemon 132390257899200)>, <Thread(tpool_thread_5, started daemon 132390249506496)>, <Thread(tpool_thread_6, started daemon 132390241113792)>, <Thread(tpool_thread_7, started daemon 132390232721088)>, <Thread(tpool_thread_8, started daemon 132390224328384)>, <Thread(tpool_thread_9, started daemon 132390215919296)>, <Thread(tpool_thread_10, started daemon 132390207510208)>, <Thread(tpool_thread_11, started daemon 132390199101120)>, <Thread(tpool_thread_12, started daemon 132390190692032)>, <Thread(tpool_thread_13, started daemon 132390182282944)>, <Thread(tpool_thread_14, started daemon 132390173873856)>, <Thread(tpool_thread_15, started daemon 132390165464768)>, <Thread(tpool_thread_16, started daemon 132390157055680)>, <Thread(tpool_thread_17, started daemon 132390148646592)>, <Thread(tpool_thread_18, started daemon 132390140237504)>, <Thread(tpool_thread_19, started daemon 132390131828416)>] {{(pid=88719) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 30 20:36:17 devstack sudo[103972]: pam_unix(sudo:session): session closed for user root
Jul 30 20:36:17 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-9adc917e-c55f-4a70-880c-71bab5733f18 tempest-TestShelveInstance-274392155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-4671154d-1d6a-4b5d-a064-aebe543423a0 1G" returned: 0 in 0.470s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:36:17 devstack cinder-volume[88719]: DEBUG cinder.volume.volume_utils [None req-9adc917e-c55f-4a70-880c-71bab5733f18 tempest-TestShelveInstance-274392155 None] Downloaded image 1ed21181-aca9-4608-89cf-131c66236dc1 ((None, [{'url': 'file:///opt/stack/data/glance/images/1ed21181-aca9-4608-89cf-131c66236dc1', 'metadata': {}}])) to volume 4671154d-1d6a-4b5d-a064-aebe543423a0 successfully. {{(pid=88719) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 30 20:36:17 devstack cinder-volume[88719]: DEBUG cinder.image.image_utils [None req-9adc917e-c55f-4a70-880c-71bab5733f18 tempest-TestShelveInstance-274392155 None] Temporary image 1ed21181-aca9-4608-89cf-131c66236dc1 for user c3ce078003b442719ad218eab43a71c7 is deleted. {{(pid=88719) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 30 20:36:17 devstack cinder-volume[88719]: DEBUG cinder.volume.volume_utils [None req-9adc917e-c55f-4a70-880c-71bab5733f18 tempest-TestShelveInstance-274392155 None] Marking volume 4671154d-1d6a-4b5d-a064-aebe543423a0 as bootable. {{(pid=88719) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 30 20:36:17 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-9adc917e-c55f-4a70-880c-71bab5733f18 tempest-TestShelveInstance-274392155 None] Copying metadata from image 1ed21181-aca9-4608-89cf-131c66236dc1 to 4671154d-1d6a-4b5d-a064-aebe543423a0. {{(pid=88719) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 30 20:36:17 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-9adc917e-c55f-4a70-880c-71bab5733f18 tempest-TestShelveInstance-274392155 None] Creating volume glance metadata for volume 4671154d-1d6a-4b5d-a064-aebe543423a0 backed by image 1ed21181-aca9-4608-89cf-131c66236dc1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '1ed21181-aca9-4608-89cf-131c66236dc1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88719) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 30 20:36:17 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-9adc917e-c55f-4a70-880c-71bab5733f18 tempest-TestShelveInstance-274392155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6a15834-aeea-48ce-aa26-1ad733fdc44b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4671154d-1d6a-4b5d-a064-aebe543423a0', 'volume_size': 1, 'image_id': '1ed21181-aca9-4608-89cf-131c66236dc1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1ed21181-aca9-4608-89cf-131c66236dc1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ec1eaae7620840deac2e426a7e923b06', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1ed21181-aca9-4608-89cf-131c66236dc1', 'created_at': datetime.datetime(2026, 7, 30, 18, 17, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 18, 17, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1ed21181-aca9-4608-89cf-131c66236dc1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x786884611f70>}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:36:17 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-9adc917e-c55f-4a70-880c-71bab5733f18 tempest-TestShelveInstance-274392155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c84f090-89c3-4034-9d5f-b6c8929de5db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:36:17 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-9adc917e-c55f-4a70-880c-71bab5733f18 tempest-TestShelveInstance-274392155 None] Volume volume-4671154d-1d6a-4b5d-a064-aebe543423a0 (4671154d-1d6a-4b5d-a064-aebe543423a0): created successfully
Jul 30 20:36:17 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-9adc917e-c55f-4a70-880c-71bab5733f18 tempest-TestShelveInstance-274392155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c84f090-89c3-4034-9d5f-b6c8929de5db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:36:17 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-9adc917e-c55f-4a70-880c-71bab5733f18 tempest-TestShelveInstance-274392155 None] Flow 'volume_create_manager' (b4d60006-4075-46ce-bb6f-d3fca7b7bbd2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:36:17 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-9adc917e-c55f-4a70-880c-71bab5733f18 tempest-TestShelveInstance-274392155 None] Created volume successfully.
Jul 30 20:36:21 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [req-3e68661e-3dc3-4522-8390-1846f89e24e0 req-28b44b0c-a11a-4562-a8f7-23a3c82decb8 tempest-TestShelveInstance-274392155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:36:21 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [req-3e68661e-3dc3-4522-8390-1846f89e24e0 req-28b44b0c-a11a-4562-a8f7-23a3c82decb8 tempest-TestShelveInstance-274392155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:36:21 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [req-3e68661e-3dc3-4522-8390-1846f89e24e0 req-28b44b0c-a11a-4562-a8f7-23a3c82decb8 tempest-TestShelveInstance-274392155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:36:21 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [req-3e68661e-3dc3-4522-8390-1846f89e24e0 req-28b44b0c-a11a-4562-a8f7-23a3c82decb8 tempest-TestShelveInstance-274392155 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5', 'name': 'volume-4671154d-1d6a-4b5d-a064-aebe543423a0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a170e856-51fe-4f74-ac38-bab03223084f', 'enforce_multipath': True} {{(pid=88719) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 30 20:36:21 devstack cinder-volume[88719]: INFO cinder.volume.manager [req-3e68661e-3dc3-4522-8390-1846f89e24e0 req-28b44b0c-a11a-4562-a8f7-23a3c82decb8 tempest-TestShelveInstance-274392155 None] attachment_update completed successfully.
Jul 30 20:36:31 devstack cinder-volume[88719]: DEBUG dbcounter [-] [88719] Writing DB stats cinder:SELECT=32,cinder:INSERT=19,cinder:UPDATE=32,cinder:DELETE=2 {{(pid=88719) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 30 20:36:31 devstack cinder-volume[88719]: DEBUG dbcounter [-] [88719] Writing DB stats cinder:UPDATE=26,cinder:SELECT=30,cinder:INSERT=7,cinder:DELETE=2 {{(pid=88719) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 30 20:36:41 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [req-09110877-41b7-4d7f-acfe-70bd66de5f6e req-acdbf6dd-2e63-4af8-9191-9a214dbc6d48 tempest-TestStampPattern-75201989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:36:41 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [req-09110877-41b7-4d7f-acfe-70bd66de5f6e req-acdbf6dd-2e63-4af8-9191-9a214dbc6d48 tempest-TestStampPattern-75201989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:36:41 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [req-09110877-41b7-4d7f-acfe-70bd66de5f6e req-acdbf6dd-2e63-4af8-9191-9a214dbc6d48 tempest-TestStampPattern-75201989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:36:41 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [req-09110877-41b7-4d7f-acfe-70bd66de5f6e req-acdbf6dd-2e63-4af8-9191-9a214dbc6d48 tempest-TestStampPattern-75201989 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5', 'name': 'volume-b7bff003-ef4d-4e45-bfcc-83beabf4018d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2bdb5687-3fe7-4089-af45-346e38da2e3a', 'enforce_multipath': True} {{(pid=88719) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 30 20:36:41 devstack cinder-volume[88719]: INFO cinder.volume.manager [req-09110877-41b7-4d7f-acfe-70bd66de5f6e req-acdbf6dd-2e63-4af8-9191-9a214dbc6d48 tempest-TestStampPattern-75201989 None] attachment_update completed successfully.
Jul 30 20:36:45 devstack cinder-volume[88719]: INFO cinder.volume.manager [req-b5af5795-2c7c-46da-bf1e-ac38c092305c req-2925f897-8c4c-4de9-ac7e-6341f7b1269d tempest-TestStampPattern-75201989 None] Terminate volume connection completed successfully.
Jul 30 20:36:45 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [req-b5af5795-2c7c-46da-bf1e-ac38c092305c req-2925f897-8c4c-4de9-ac7e-6341f7b1269d tempest-TestStampPattern-75201989 None] Deleting attachment 2bdb5687-3fe7-4089-af45-346e38da2e3a. {{(pid=88719) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 30 20:36:46 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-143c4f2f-f185-435f-85c9-79686a495319 tempest-TestInstancesWithCinderVolumes-554188937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:36:46 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-143c4f2f-f185-435f-85c9-79686a495319 tempest-TestInstancesWithCinderVolumes-554188937 None] Flow 'volume_create_manager' (4ee34ef0-860d-4026-88a8-36a1f049587c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:36:46 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-143c4f2f-f185-435f-85c9-79686a495319 tempest-TestInstancesWithCinderVolumes-554188937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (956032e8-13df-4222-8eb7-27a7c83533ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:36:46 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-143c4f2f-f185-435f-85c9-79686a495319 tempest-TestInstancesWithCinderVolumes-554188937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (956032e8-13df-4222-8eb7-27a7c83533ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:36:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1825064833',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=356bddb1-ac5b-4d88-8054-778bf75be628,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='635493e4a0704165bc324974aeeee33f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:36:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:36:46Z,use_quota=True,user_id='5e05594dfef84b018735d38fd5a3927f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b82a3093-76cd-4021-ad76-c358d77c39b6),volume_type_id=b82a3093-76cd-4021-ad76-c358d77c39b6)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:36:46 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-143c4f2f-f185-435f-85c9-79686a495319 tempest-TestInstancesWithCinderVolumes-554188937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5162e8ee-3470-4654-828e-8fe6f8385916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:36:46 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-143c4f2f-f185-435f-85c9-79686a495319 tempest-TestInstancesWithCinderVolumes-554188937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5162e8ee-3470-4654-828e-8fe6f8385916) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:36:46 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-143c4f2f-f185-435f-85c9-79686a495319 tempest-TestInstancesWithCinderVolumes-554188937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a32c14cc-d106-4e21-b212-acf1e3c2fe57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:36:46 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-143c4f2f-f185-435f-85c9-79686a495319 tempest-TestInstancesWithCinderVolumes-554188937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a32c14cc-d106-4e21-b212-acf1e3c2fe57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '356bddb1-ac5b-4d88-8054-778bf75be628', 'volume_name': 'volume-356bddb1-ac5b-4d88-8054-778bf75be628', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:36:46 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-143c4f2f-f185-435f-85c9-79686a495319 tempest-TestInstancesWithCinderVolumes-554188937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e59c6b9c-1984-44d6-9104-43e3176086c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:36:46 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-143c4f2f-f185-435f-85c9-79686a495319 tempest-TestInstancesWithCinderVolumes-554188937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e59c6b9c-1984-44d6-9104-43e3176086c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:36:46 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-143c4f2f-f185-435f-85c9-79686a495319 tempest-TestInstancesWithCinderVolumes-554188937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d425f33-cf50-4520-94b9-f73f6f20aaed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:36:46 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-143c4f2f-f185-435f-85c9-79686a495319 tempest-TestInstancesWithCinderVolumes-554188937 None] Volume 356bddb1-ac5b-4d88-8054-778bf75be628: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-356bddb1-ac5b-4d88-8054-778bf75be628', 'volume_size': 1}
Jul 30 20:36:46 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-143c4f2f-f185-435f-85c9-79686a495319 tempest-TestInstancesWithCinderVolumes-554188937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:36:46 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-143c4f2f-f185-435f-85c9-79686a495319 tempest-TestInstancesWithCinderVolumes-554188937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:36:46 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-143c4f2f-f185-435f-85c9-79686a495319 tempest-TestInstancesWithCinderVolumes-554188937 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:36:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1825064833',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=356bddb1-ac5b-4d88-8054-778bf75be628,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='635493e4a0704165bc324974aeeee33f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:36:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:36:46Z,use_quota=True,user_id='5e05594dfef84b018735d38fd5a3927f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b82a3093-76cd-4021-ad76-c358d77c39b6),volume_type_id=b82a3093-76cd-4021-ad76-c358d77c39b6)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:36:46 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-143c4f2f-f185-435f-85c9-79686a495319 tempest-TestInstancesWithCinderVolumes-554188937 None] Creating volume 356bddb1-ac5b-4d88-8054-778bf75be628 {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:36:46 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-143c4f2f-f185-435f-85c9-79686a495319 tempest-TestInstancesWithCinderVolumes-554188937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:36:46 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-143c4f2f-f185-435f-85c9-79686a495319 tempest-TestInstancesWithCinderVolumes-554188937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:36:46 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-143c4f2f-f185-435f-85c9-79686a495319 tempest-TestInstancesWithCinderVolumes-554188937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:36:46 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-143c4f2f-f185-435f-85c9-79686a495319 tempest-TestInstancesWithCinderVolumes-554188937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:36:46 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-143c4f2f-f185-435f-85c9-79686a495319 tempest-TestInstancesWithCinderVolumes-554188937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:36:46 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-143c4f2f-f185-435f-85c9-79686a495319 tempest-TestInstancesWithCinderVolumes-554188937 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:36:46 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-143c4f2f-f185-435f-85c9-79686a495319 tempest-TestInstancesWithCinderVolumes-554188937 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:36:46 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-143c4f2f-f185-435f-85c9-79686a495319 tempest-TestInstancesWithCinderVolumes-554188937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-356bddb1-ac5b-4d88-8054-778bf75be628 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:36:46 devstack sudo[104551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-356bddb1-ac5b-4d88-8054-778bf75be628 1073741824
Jul 30 20:36:46 devstack sudo[104551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:36:47 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb22d330-f329-4a62-885d-f4c79e33abce tempest-TestInstancesWithCinderVolumes-554188937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:36:47 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-bb22d330-f329-4a62-885d-f4c79e33abce tempest-TestInstancesWithCinderVolumes-554188937 None] Flow 'volume_create_manager' (cfd1919f-97da-4bb1-840a-484060ef7cad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:36:47 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-bb22d330-f329-4a62-885d-f4c79e33abce tempest-TestInstancesWithCinderVolumes-554188937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01358bd3-8e55-4ca1-aa96-a862e3a90bc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:36:47 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-bb22d330-f329-4a62-885d-f4c79e33abce tempest-TestInstancesWithCinderVolumes-554188937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01358bd3-8e55-4ca1-aa96-a862e3a90bc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:36:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-321163178',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53c10edc-e1da-4367-a6f3-2d22d90764d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='635493e4a0704165bc324974aeeee33f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:36:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:36:47Z,use_quota=True,user_id='5e05594dfef84b018735d38fd5a3927f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f316623d-1776-4f20-a5e1-b7ae291507af),volume_type_id=f316623d-1776-4f20-a5e1-b7ae291507af)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:36:47 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-bb22d330-f329-4a62-885d-f4c79e33abce tempest-TestInstancesWithCinderVolumes-554188937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a038e6f-5689-41e4-8915-85cd9be7257c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:36:47 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-bb22d330-f329-4a62-885d-f4c79e33abce tempest-TestInstancesWithCinderVolumes-554188937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a038e6f-5689-41e4-8915-85cd9be7257c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:36:47 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-bb22d330-f329-4a62-885d-f4c79e33abce tempest-TestInstancesWithCinderVolumes-554188937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cc87a8f-6761-45e7-9764-98c06693f89d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:36:47 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-bb22d330-f329-4a62-885d-f4c79e33abce tempest-TestInstancesWithCinderVolumes-554188937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cc87a8f-6761-45e7-9764-98c06693f89d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53c10edc-e1da-4367-a6f3-2d22d90764d6', 'volume_name': 'volume-53c10edc-e1da-4367-a6f3-2d22d90764d6', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:36:47 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-bb22d330-f329-4a62-885d-f4c79e33abce tempest-TestInstancesWithCinderVolumes-554188937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72055c18-4ce9-4610-b0f9-6d143a748322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:36:47 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-bb22d330-f329-4a62-885d-f4c79e33abce tempest-TestInstancesWithCinderVolumes-554188937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72055c18-4ce9-4610-b0f9-6d143a748322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:36:47 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-bb22d330-f329-4a62-885d-f4c79e33abce tempest-TestInstancesWithCinderVolumes-554188937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19dc8d41-d4f1-4aef-a408-f54716bfd323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:36:47 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-bb22d330-f329-4a62-885d-f4c79e33abce tempest-TestInstancesWithCinderVolumes-554188937 None] Volume 53c10edc-e1da-4367-a6f3-2d22d90764d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53c10edc-e1da-4367-a6f3-2d22d90764d6', 'volume_size': 1}
Jul 30 20:36:47 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-bb22d330-f329-4a62-885d-f4c79e33abce tempest-TestInstancesWithCinderVolumes-554188937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:36:47 devstack sudo[104551]: pam_unix(sudo:session): session closed for user root
Jul 30 20:36:47 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-143c4f2f-f185-435f-85c9-79686a495319 tempest-TestInstancesWithCinderVolumes-554188937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-356bddb1-ac5b-4d88-8054-778bf75be628 1073741824" returned: 0 in 0.852s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:36:47 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-143c4f2f-f185-435f-85c9-79686a495319 tempest-TestInstancesWithCinderVolumes-554188937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-356bddb1-ac5b-4d88-8054-778bf75be628 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:36:47 devstack sudo[104577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-356bddb1-ac5b-4d88-8054-778bf75be628
Jul 30 20:36:47 devstack sudo[104577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:36:47 devstack sudo[104577]: pam_unix(sudo:session): session closed for user root
Jul 30 20:36:47 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-143c4f2f-f185-435f-85c9-79686a495319 tempest-TestInstancesWithCinderVolumes-554188937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-356bddb1-ac5b-4d88-8054-778bf75be628" returned: 0 in 0.337s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:36:47 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-143c4f2f-f185-435f-85c9-79686a495319 tempest-TestInstancesWithCinderVolumes-554188937 None] <== create_volume: return (1297ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:36:47 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-143c4f2f-f185-435f-85c9-79686a495319 tempest-TestInstancesWithCinderVolumes-554188937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.300s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:36:47 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-bb22d330-f329-4a62-885d-f4c79e33abce tempest-TestInstancesWithCinderVolumes-554188937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.729s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:36:47 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-bb22d330-f329-4a62-885d-f4c79e33abce tempest-TestInstancesWithCinderVolumes-554188937 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:36:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-321163178',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53c10edc-e1da-4367-a6f3-2d22d90764d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='635493e4a0704165bc324974aeeee33f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:36:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:36:47Z,use_quota=True,user_id='5e05594dfef84b018735d38fd5a3927f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f316623d-1776-4f20-a5e1-b7ae291507af),volume_type_id=f316623d-1776-4f20-a5e1-b7ae291507af)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:36:47 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-bb22d330-f329-4a62-885d-f4c79e33abce tempest-TestInstancesWithCinderVolumes-554188937 None] Creating volume 53c10edc-e1da-4367-a6f3-2d22d90764d6 {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:36:47 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-bb22d330-f329-4a62-885d-f4c79e33abce tempest-TestInstancesWithCinderVolumes-554188937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:36:47 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-bb22d330-f329-4a62-885d-f4c79e33abce tempest-TestInstancesWithCinderVolumes-554188937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:36:47 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-bb22d330-f329-4a62-885d-f4c79e33abce tempest-TestInstancesWithCinderVolumes-554188937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:36:47 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-bb22d330-f329-4a62-885d-f4c79e33abce tempest-TestInstancesWithCinderVolumes-554188937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:36:47 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-bb22d330-f329-4a62-885d-f4c79e33abce tempest-TestInstancesWithCinderVolumes-554188937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:36:47 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-bb22d330-f329-4a62-885d-f4c79e33abce tempest-TestInstancesWithCinderVolumes-554188937 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:36:47 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-bb22d330-f329-4a62-885d-f4c79e33abce tempest-TestInstancesWithCinderVolumes-554188937 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:36:47 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-bb22d330-f329-4a62-885d-f4c79e33abce tempest-TestInstancesWithCinderVolumes-554188937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-53c10edc-e1da-4367-a6f3-2d22d90764d6 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:36:48 devstack sudo[104588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-53c10edc-e1da-4367-a6f3-2d22d90764d6 1073741824
Jul 30 20:36:48 devstack sudo[104588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:36:48 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-143c4f2f-f185-435f-85c9-79686a495319 tempest-TestInstancesWithCinderVolumes-554188937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d425f33-cf50-4520-94b9-f73f6f20aaed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-356bddb1-ac5b-4d88-8054-778bf75be628', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:36:48 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-143c4f2f-f185-435f-85c9-79686a495319 tempest-TestInstancesWithCinderVolumes-554188937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d377fa49-522d-48ff-b088-2e31c8340de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:36:48 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-143c4f2f-f185-435f-85c9-79686a495319 tempest-TestInstancesWithCinderVolumes-554188937 None] Volume volume-356bddb1-ac5b-4d88-8054-778bf75be628 (356bddb1-ac5b-4d88-8054-778bf75be628): created successfully
Jul 30 20:36:48 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-143c4f2f-f185-435f-85c9-79686a495319 tempest-TestInstancesWithCinderVolumes-554188937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d377fa49-522d-48ff-b088-2e31c8340de3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:36:48 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-143c4f2f-f185-435f-85c9-79686a495319 tempest-TestInstancesWithCinderVolumes-554188937 None] Flow 'volume_create_manager' (4ee34ef0-860d-4026-88a8-36a1f049587c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:36:48 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-06760936-1d9b-4205-add7-cf3a1f0848a0 tempest-TestInstancesWithCinderVolumes-554188937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:36:48 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-06760936-1d9b-4205-add7-cf3a1f0848a0 tempest-TestInstancesWithCinderVolumes-554188937 None] Flow 'volume_create_manager' (2c298ca6-32c1-40ea-a18b-d399bcf9e844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:36:48 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-06760936-1d9b-4205-add7-cf3a1f0848a0 tempest-TestInstancesWithCinderVolumes-554188937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0eff5f36-1b40-405d-bcd6-947cb5faef9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:36:48 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-06760936-1d9b-4205-add7-cf3a1f0848a0 tempest-TestInstancesWithCinderVolumes-554188937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0eff5f36-1b40-405d-bcd6-947cb5faef9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:36:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-353605517',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec8a14b9-99f7-434b-85a6-499a7ed2f589,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='635493e4a0704165bc324974aeeee33f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:36:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:36:48Z,use_quota=True,user_id='5e05594dfef84b018735d38fd5a3927f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df29c499-bbf9-4413-b1e4-15fbe0896467),volume_type_id=df29c499-bbf9-4413-b1e4-15fbe0896467)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:36:48 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-06760936-1d9b-4205-add7-cf3a1f0848a0 tempest-TestInstancesWithCinderVolumes-554188937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84764608-b5d6-4715-9a03-a43845151c63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:36:48 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-06760936-1d9b-4205-add7-cf3a1f0848a0 tempest-TestInstancesWithCinderVolumes-554188937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84764608-b5d6-4715-9a03-a43845151c63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:36:48 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-06760936-1d9b-4205-add7-cf3a1f0848a0 tempest-TestInstancesWithCinderVolumes-554188937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf0880bd-511d-41b8-b897-88ccf18eb854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:36:48 devstack cinder-volume[88719]: DEBUG cinder.image.glance [None req-06760936-1d9b-4205-add7-cf3a1f0848a0 tempest-TestInstancesWithCinderVolumes-554188937 None] Creating Keystone auth plugin from conf {{(pid=88719) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 30 20:36:48 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-143c4f2f-f185-435f-85c9-79686a495319 tempest-TestInstancesWithCinderVolumes-554188937 None] Created volume successfully.
Jul 30 20:36:48 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-06760936-1d9b-4205-add7-cf3a1f0848a0 tempest-TestInstancesWithCinderVolumes-554188937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf0880bd-511d-41b8-b897-88ccf18eb854) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ec8a14b9-99f7-434b-85a6-499a7ed2f589', 'volume_name': 'volume-ec8a14b9-99f7-434b-85a6-499a7ed2f589', 'volume_size': 1, 'image_id': '1f620dec-3845-43ae-8168-cf830b2210df', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1f620dec-3845-43ae-8168-cf830b2210df', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1129430271', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '635493e4a0704165bc324974aeeee33f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1f620dec-3845-43ae-8168-cf830b2210df', 'created_at': datetime.datetime(2026, 7, 30, 18, 36, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 18, 36, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1f620dec-3845-43ae-8168-cf830b2210df/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7868848275c0>}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:36:48 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-06760936-1d9b-4205-add7-cf3a1f0848a0 tempest-TestInstancesWithCinderVolumes-554188937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (845e91ff-45ec-4e64-94d3-194ccf74fddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:36:48 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-06760936-1d9b-4205-add7-cf3a1f0848a0 tempest-TestInstancesWithCinderVolumes-554188937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (845e91ff-45ec-4e64-94d3-194ccf74fddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:36:48 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-06760936-1d9b-4205-add7-cf3a1f0848a0 tempest-TestInstancesWithCinderVolumes-554188937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86b7ad40-5305-40d0-8e52-b0793fcdd599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:36:48 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-06760936-1d9b-4205-add7-cf3a1f0848a0 tempest-TestInstancesWithCinderVolumes-554188937 None] Volume ec8a14b9-99f7-434b-85a6-499a7ed2f589: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ec8a14b9-99f7-434b-85a6-499a7ed2f589', 'volume_size': 1, 'image_id': '1f620dec-3845-43ae-8168-cf830b2210df', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1f620dec-3845-43ae-8168-cf830b2210df', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1129430271', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '635493e4a0704165bc324974aeeee33f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1f620dec-3845-43ae-8168-cf830b2210df', 'created_at': datetime.datetime(2026, 7, 30, 18, 36, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 18, 36, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1f620dec-3845-43ae-8168-cf830b2210df/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7868848275c0>}
Jul 30 20:36:48 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-06760936-1d9b-4205-add7-cf3a1f0848a0 tempest-TestInstancesWithCinderVolumes-554188937 None] Trying to clone ec8a14b9-99f7-434b-85a6-499a7ed2f589 from image 1f620dec-3845-43ae-8168-cf830b2210df at location (None, [{'url': 'file:///opt/stack/data/glance/images/1f620dec-3845-43ae-8168-cf830b2210df', 'metadata': {}}]). {{(pid=88719) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 30 20:36:48 devstack sudo[104588]: pam_unix(sudo:session): session closed for user root
Jul 30 20:36:48 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-bb22d330-f329-4a62-885d-f4c79e33abce tempest-TestInstancesWithCinderVolumes-554188937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-53c10edc-e1da-4367-a6f3-2d22d90764d6 1073741824" returned: 0 in 0.635s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:36:48 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-bb22d330-f329-4a62-885d-f4c79e33abce tempest-TestInstancesWithCinderVolumes-554188937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-53c10edc-e1da-4367-a6f3-2d22d90764d6 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:36:48 devstack sudo[104596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-53c10edc-e1da-4367-a6f3-2d22d90764d6
Jul 30 20:36:48 devstack sudo[104596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:36:48 devstack sudo[104596]: pam_unix(sudo:session): session closed for user root
Jul 30 20:36:49 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-bb22d330-f329-4a62-885d-f4c79e33abce tempest-TestInstancesWithCinderVolumes-554188937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-53c10edc-e1da-4367-a6f3-2d22d90764d6" returned: 0 in 0.326s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:36:49 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-bb22d330-f329-4a62-885d-f4c79e33abce tempest-TestInstancesWithCinderVolumes-554188937 None] <== create_volume: return (1039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:36:49 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-bb22d330-f329-4a62-885d-f4c79e33abce tempest-TestInstancesWithCinderVolumes-554188937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.042s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:36:49 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-bb22d330-f329-4a62-885d-f4c79e33abce tempest-TestInstancesWithCinderVolumes-554188937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19dc8d41-d4f1-4aef-a408-f54716bfd323) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53c10edc-e1da-4367-a6f3-2d22d90764d6', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:36:49 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-bb22d330-f329-4a62-885d-f4c79e33abce tempest-TestInstancesWithCinderVolumes-554188937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea038ee9-59be-42aa-88d5-e7600cf67580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:36:49 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-bb22d330-f329-4a62-885d-f4c79e33abce tempest-TestInstancesWithCinderVolumes-554188937 None] Volume volume-53c10edc-e1da-4367-a6f3-2d22d90764d6 (53c10edc-e1da-4367-a6f3-2d22d90764d6): created successfully
Jul 30 20:36:49 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-bb22d330-f329-4a62-885d-f4c79e33abce tempest-TestInstancesWithCinderVolumes-554188937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea038ee9-59be-42aa-88d5-e7600cf67580) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:36:49 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-bb22d330-f329-4a62-885d-f4c79e33abce tempest-TestInstancesWithCinderVolumes-554188937 None] Flow 'volume_create_manager' (cfd1919f-97da-4bb1-840a-484060ef7cad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:36:49 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-bb22d330-f329-4a62-885d-f4c79e33abce tempest-TestInstancesWithCinderVolumes-554188937 None] Created volume successfully.
Jul 30 20:36:49 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-42e7b6a0-7135-408c-933c-7354cea1791e tempest-TestStampPattern-75201989 None] Acquiring lock "cinder-b7bff003-ef4d-4e45-bfcc-83beabf4018d-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:36:49 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-42e7b6a0-7135-408c-933c-7354cea1791e tempest-TestStampPattern-75201989 None] Lock "cinder-b7bff003-ef4d-4e45-bfcc-83beabf4018d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:36:49 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-42e7b6a0-7135-408c-933c-7354cea1791e tempest-TestStampPattern-75201989 None] Acquiring lock "cinder-quobyte-b7bff003-ef4d-4e45-bfcc-83beabf4018d" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:36:49 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-42e7b6a0-7135-408c-933c-7354cea1791e tempest-TestStampPattern-75201989 None] Lock "cinder-quobyte-b7bff003-ef4d-4e45-bfcc-83beabf4018d" acquired by "delete_volume" :: waited 0.016s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:36:49 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[e533891f-e4f0-4866-96db-b4ee67d2dbcc]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:36:49 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-42e7b6a0-7135-408c-933c-7354cea1791e tempest-TestStampPattern-75201989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b7bff003-ef4d-4e45-bfcc-83beabf4018d {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:36:49 devstack sudo[104599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b7bff003-ef4d-4e45-bfcc-83beabf4018d
Jul 30 20:36:49 devstack sudo[104599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:36:50 devstack sudo[104599]: pam_unix(sudo:session): session closed for user root
Jul 30 20:36:50 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-42e7b6a0-7135-408c-933c-7354cea1791e tempest-TestStampPattern-75201989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b7bff003-ef4d-4e45-bfcc-83beabf4018d" returned: 0 in 0.391s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:36:50 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-42e7b6a0-7135-408c-933c-7354cea1791e tempest-TestStampPattern-75201989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b7bff003-ef4d-4e45-bfcc-83beabf4018d {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:36:50 devstack sudo[104604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b7bff003-ef4d-4e45-bfcc-83beabf4018d
Jul 30 20:36:50 devstack sudo[104604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:36:50 devstack sudo[104604]: pam_unix(sudo:session): session closed for user root
Jul 30 20:36:50 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-42e7b6a0-7135-408c-933c-7354cea1791e tempest-TestStampPattern-75201989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b7bff003-ef4d-4e45-bfcc-83beabf4018d" returned: 0 in 0.276s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:36:50 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-42e7b6a0-7135-408c-933c-7354cea1791e tempest-TestStampPattern-75201989 None] Lock "cinder-quobyte-b7bff003-ef4d-4e45-bfcc-83beabf4018d" released by "delete_volume" :: held 0.715s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:36:50 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-42e7b6a0-7135-408c-933c-7354cea1791e tempest-TestStampPattern-75201989 None] Created reservations ['86ee7626-9b06-4272-910c-fd619bc1db3d', 'a47c26b9-9f33-4dff-a447-94c5ad96b260', '96cb71e0-a57d-4829-9a8d-556cb25708e8', '3c5ae7b9-1056-4c42-91ab-b1aa7636663e'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:36:50 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-42e7b6a0-7135-408c-933c-7354cea1791e tempest-TestStampPattern-75201989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:36:50 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-42e7b6a0-7135-408c-933c-7354cea1791e tempest-TestStampPattern-75201989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:36:50 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-42e7b6a0-7135-408c-933c-7354cea1791e tempest-TestStampPattern-75201989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:36:50 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-42e7b6a0-7135-408c-933c-7354cea1791e tempest-TestStampPattern-75201989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:36:50 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-42e7b6a0-7135-408c-933c-7354cea1791e tempest-TestStampPattern-75201989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:36:50 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-42e7b6a0-7135-408c-933c-7354cea1791e tempest-TestStampPattern-75201989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:36:50 devstack sudo[104607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:36:50 devstack sudo[104607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:36:50 devstack sudo[104607]: pam_unix(sudo:session): session closed for user root
Jul 30 20:36:50 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-42e7b6a0-7135-408c-933c-7354cea1791e tempest-TestStampPattern-75201989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.277s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:36:50 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-42e7b6a0-7135-408c-933c-7354cea1791e tempest-TestStampPattern-75201989 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:36:50 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-42e7b6a0-7135-408c-933c-7354cea1791e tempest-TestStampPattern-75201989 None] Deleted volume successfully.
Jul 30 20:36:51 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-42e7b6a0-7135-408c-933c-7354cea1791e tempest-TestStampPattern-75201989 None] Lock "cinder-b7bff003-ef4d-4e45-bfcc-83beabf4018d-delete_volume" released by "delete_volume" :: held 1.348s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:36:51 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-975ddd3c-fcb4-4807-9dd1-5fcc84942472 tempest-TestStampPattern-75201989 None] Acquiring lock "cinder-6739e9c6-fb89-4f6c-8d1e-616767d8818b-delete_snapshot" by "delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:36:51 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-975ddd3c-fcb4-4807-9dd1-5fcc84942472 tempest-TestStampPattern-75201989 None] Lock "cinder-6739e9c6-fb89-4f6c-8d1e-616767d8818b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:36:51 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-975ddd3c-fcb4-4807-9dd1-5fcc84942472 tempest-TestStampPattern-75201989 None] Acquiring lock "cinder-quobyte-0883c285-cc2b-4727-af60-5bb30a001719" by "delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:36:51 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-975ddd3c-fcb4-4807-9dd1-5fcc84942472 tempest-TestStampPattern-75201989 None] Lock "cinder-quobyte-0883c285-cc2b-4727-af60-5bb30a001719" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:36:51 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-975ddd3c-fcb4-4807-9dd1-5fcc84942472 tempest-TestStampPattern-75201989 None] Acquiring lock "cinder-quobyte-6739e9c6-fb89-4f6c-8d1e-616767d8818b" by "_delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:36:51 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-975ddd3c-fcb4-4807-9dd1-5fcc84942472 tempest-TestStampPattern-75201989 None] Lock "cinder-quobyte-6739e9c6-fb89-4f6c-8d1e-616767d8818b" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:36:51 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-975ddd3c-fcb4-4807-9dd1-5fcc84942472 tempest-TestStampPattern-75201989 None] Deleting offline snapshot 6739e9c6-fb89-4f6c-8d1e-616767d8818b of volume 0883c285-cc2b-4727-af60-5bb30a001719 {{(pid=88719) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 30 20:36:51 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-975ddd3c-fcb4-4807-9dd1-5fcc84942472 tempest-TestStampPattern-75201989 None] snapshot_file for this snap is: volume-0883c285-cc2b-4727-af60-5bb30a001719.6739e9c6-fb89-4f6c-8d1e-616767d8818b {{(pid=88719) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 30 20:36:51 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2a1ba31-a58f-42cf-bd64-8c52dea431e7]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:36:51 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-975ddd3c-fcb4-4807-9dd1-5fcc84942472 tempest-TestStampPattern-75201989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0883c285-cc2b-4727-af60-5bb30a001719.6739e9c6-fb89-4f6c-8d1e-616767d8818b {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:36:51 devstack sudo[104610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0883c285-cc2b-4727-af60-5bb30a001719.6739e9c6-fb89-4f6c-8d1e-616767d8818b
Jul 30 20:36:51 devstack sudo[104610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:36:51 devstack sudo[104610]: pam_unix(sudo:session): session closed for user root
Jul 30 20:36:51 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-975ddd3c-fcb4-4807-9dd1-5fcc84942472 tempest-TestStampPattern-75201989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0883c285-cc2b-4727-af60-5bb30a001719.6739e9c6-fb89-4f6c-8d1e-616767d8818b" returned: 0 in 0.416s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:36:51 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-975ddd3c-fcb4-4807-9dd1-5fcc84942472 tempest-TestStampPattern-75201989 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0883c285-cc2b-4727-af60-5bb30a001719(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88719) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 30 20:36:51 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[722ce801-022e-4126-abc9-a00b298391a8]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:36:51 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-975ddd3c-fcb4-4807-9dd1-5fcc84942472 tempest-TestStampPattern-75201989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0883c285-cc2b-4727-af60-5bb30a001719 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:36:51 devstack sudo[104615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0883c285-cc2b-4727-af60-5bb30a001719
Jul 30 20:36:51 devstack sudo[104615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:36:52 devstack sudo[104615]: pam_unix(sudo:session): session closed for user root
Jul 30 20:36:52 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-975ddd3c-fcb4-4807-9dd1-5fcc84942472 tempest-TestStampPattern-75201989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0883c285-cc2b-4727-af60-5bb30a001719" returned: 0 in 0.613s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:36:52 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-975ddd3c-fcb4-4807-9dd1-5fcc84942472 tempest-TestStampPattern-75201989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0883c285-cc2b-4727-af60-5bb30a001719.6739e9c6-fb89-4f6c-8d1e-616767d8818b {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:36:52 devstack sudo[104629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0883c285-cc2b-4727-af60-5bb30a001719.6739e9c6-fb89-4f6c-8d1e-616767d8818b
Jul 30 20:36:52 devstack sudo[104629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:36:52 devstack cinder-volume[88719]: DEBUG cinder.image.image_utils [None req-06760936-1d9b-4205-add7-cf3a1f0848a0 tempest-TestInstancesWithCinderVolumes-554188937 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1f620dec-3845-43ae-8168-cf830b2210df_ubpv5ohsdevstack@QuobyteHD, size 20.69 MB, duration 4.08 sec {{(pid=88719) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 30 20:36:52 devstack cinder-volume[88719]: INFO cinder.image.image_utils [None req-06760936-1d9b-4205-add7-cf3a1f0848a0 tempest-TestInstancesWithCinderVolumes-554188937 None] Image download 20.69 MB at 5.07 MB/s
Jul 30 20:36:52 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[817d0453-fc55-4027-8bfa-c12aed8459f4]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:36:52 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-06760936-1d9b-4205-add7-cf3a1f0848a0 tempest-TestInstancesWithCinderVolumes-554188937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1f620dec-3845-43ae-8168-cf830b2210df_ubpv5ohsdevstack@QuobyteHD {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:36:52 devstack sudo[104631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1f620dec-3845-43ae-8168-cf830b2210df_ubpv5ohsdevstack@QuobyteHD
Jul 30 20:36:52 devstack sudo[104631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:36:52 devstack sudo[104629]: pam_unix(sudo:session): session closed for user root
Jul 30 20:36:52 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-975ddd3c-fcb4-4807-9dd1-5fcc84942472 tempest-TestStampPattern-75201989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0883c285-cc2b-4727-af60-5bb30a001719.6739e9c6-fb89-4f6c-8d1e-616767d8818b" returned: 0 in 0.360s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:36:52 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-975ddd3c-fcb4-4807-9dd1-5fcc84942472 tempest-TestStampPattern-75201989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0883c285-cc2b-4727-af60-5bb30a001719.6739e9c6-fb89-4f6c-8d1e-616767d8818b {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:36:52 devstack sudo[104636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0883c285-cc2b-4727-af60-5bb30a001719.6739e9c6-fb89-4f6c-8d1e-616767d8818b
Jul 30 20:36:52 devstack sudo[104636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:36:52 devstack sudo[104631]: pam_unix(sudo:session): session closed for user root
Jul 30 20:36:52 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-06760936-1d9b-4205-add7-cf3a1f0848a0 tempest-TestInstancesWithCinderVolumes-554188937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1f620dec-3845-43ae-8168-cf830b2210df_ubpv5ohsdevstack@QuobyteHD" returned: 0 in 0.343s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:36:52 devstack cinder-volume[88719]: DEBUG cinder.image.image_utils [None req-06760936-1d9b-4205-add7-cf3a1f0848a0 tempest-TestInstancesWithCinderVolumes-554188937 None] Temporary image 1f620dec-3845-43ae-8168-cf830b2210df is fetched for user 5e05594dfef84b018735d38fd5a3927f. {{(pid=88719) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 30 20:36:53 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[da071f01-121a-4150-b378-980727a13dae]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:36:53 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-06760936-1d9b-4205-add7-cf3a1f0848a0 tempest-TestInstancesWithCinderVolumes-554188937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1f620dec-3845-43ae-8168-cf830b2210df_ubpv5ohsdevstack@QuobyteHD {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:36:53 devstack sudo[104636]: pam_unix(sudo:session): session closed for user root
Jul 30 20:36:53 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-975ddd3c-fcb4-4807-9dd1-5fcc84942472 tempest-TestStampPattern-75201989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0883c285-cc2b-4727-af60-5bb30a001719.6739e9c6-fb89-4f6c-8d1e-616767d8818b" returned: 0 in 0.283s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:36:53 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-975ddd3c-fcb4-4807-9dd1-5fcc84942472 tempest-TestStampPattern-75201989 None] Lock "cinder-quobyte-6739e9c6-fb89-4f6c-8d1e-616767d8818b" released by "_delete_snapshot" :: held 1.772s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:36:53 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-975ddd3c-fcb4-4807-9dd1-5fcc84942472 tempest-TestStampPattern-75201989 None] Lock "cinder-quobyte-0883c285-cc2b-4727-af60-5bb30a001719" released by "delete_snapshot" :: held 1.799s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:36:53 devstack sudo[104642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1f620dec-3845-43ae-8168-cf830b2210df_ubpv5ohsdevstack@QuobyteHD
Jul 30 20:36:53 devstack sudo[104642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:36:53 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-975ddd3c-fcb4-4807-9dd1-5fcc84942472 tempest-TestStampPattern-75201989 None] Created reservations ['7591b1ee-c538-458c-9c5f-7a5f5e869899', '2e3923ec-3dfd-4728-8a00-313769f454df', '8d6235d0-a371-4193-952e-e537bb236534', '0ccd4de0-9880-4187-97cc-1dedcb0f17f7'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:36:53 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-975ddd3c-fcb4-4807-9dd1-5fcc84942472 tempest-TestStampPattern-75201989 None] Delete snapshot completed successfully.
Jul 30 20:36:53 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-975ddd3c-fcb4-4807-9dd1-5fcc84942472 tempest-TestStampPattern-75201989 None] Lock "cinder-6739e9c6-fb89-4f6c-8d1e-616767d8818b-delete_snapshot" released by "delete_snapshot" :: held 1.971s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:36:53 devstack sudo[104642]: pam_unix(sudo:session): session closed for user root
Jul 30 20:36:53 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-06760936-1d9b-4205-add7-cf3a1f0848a0 tempest-TestInstancesWithCinderVolumes-554188937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1f620dec-3845-43ae-8168-cf830b2210df_ubpv5ohsdevstack@QuobyteHD" returned: 0 in 0.368s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:36:53 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-06760936-1d9b-4205-add7-cf3a1f0848a0 tempest-TestInstancesWithCinderVolumes-554188937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:36:53 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-06760936-1d9b-4205-add7-cf3a1f0848a0 tempest-TestInstancesWithCinderVolumes-554188937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:36:53 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-06760936-1d9b-4205-add7-cf3a1f0848a0 tempest-TestInstancesWithCinderVolumes-554188937 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:36:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-353605517',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec8a14b9-99f7-434b-85a6-499a7ed2f589,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='635493e4a0704165bc324974aeeee33f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:36:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:36:48Z,use_quota=True,user_id='5e05594dfef84b018735d38fd5a3927f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df29c499-bbf9-4413-b1e4-15fbe0896467),volume_type_id=df29c499-bbf9-4413-b1e4-15fbe0896467)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:36:53 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-06760936-1d9b-4205-add7-cf3a1f0848a0 tempest-TestInstancesWithCinderVolumes-554188937 None] Creating volume ec8a14b9-99f7-434b-85a6-499a7ed2f589 {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:36:53 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-06760936-1d9b-4205-add7-cf3a1f0848a0 tempest-TestInstancesWithCinderVolumes-554188937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:36:53 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-06760936-1d9b-4205-add7-cf3a1f0848a0 tempest-TestInstancesWithCinderVolumes-554188937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:36:53 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-06760936-1d9b-4205-add7-cf3a1f0848a0 tempest-TestInstancesWithCinderVolumes-554188937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:36:53 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-06760936-1d9b-4205-add7-cf3a1f0848a0 tempest-TestInstancesWithCinderVolumes-554188937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:36:53 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-06760936-1d9b-4205-add7-cf3a1f0848a0 tempest-TestInstancesWithCinderVolumes-554188937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:36:53 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-06760936-1d9b-4205-add7-cf3a1f0848a0 tempest-TestInstancesWithCinderVolumes-554188937 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:36:53 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-06760936-1d9b-4205-add7-cf3a1f0848a0 tempest-TestInstancesWithCinderVolumes-554188937 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:36:53 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-06760936-1d9b-4205-add7-cf3a1f0848a0 tempest-TestInstancesWithCinderVolumes-554188937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-ec8a14b9-99f7-434b-85a6-499a7ed2f589 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:36:53 devstack sudo[104651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-ec8a14b9-99f7-434b-85a6-499a7ed2f589 1073741824
Jul 30 20:36:53 devstack sudo[104651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:36:54 devstack sudo[104651]: pam_unix(sudo:session): session closed for user root
Jul 30 20:36:54 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-06760936-1d9b-4205-add7-cf3a1f0848a0 tempest-TestInstancesWithCinderVolumes-554188937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-ec8a14b9-99f7-434b-85a6-499a7ed2f589 1073741824" returned: 0 in 0.590s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:36:54 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-06760936-1d9b-4205-add7-cf3a1f0848a0 tempest-TestInstancesWithCinderVolumes-554188937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-ec8a14b9-99f7-434b-85a6-499a7ed2f589 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:36:54 devstack sudo[104660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-ec8a14b9-99f7-434b-85a6-499a7ed2f589
Jul 30 20:36:54 devstack sudo[104660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:36:54 devstack sudo[104660]: pam_unix(sudo:session): session closed for user root
Jul 30 20:36:54 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-06760936-1d9b-4205-add7-cf3a1f0848a0 tempest-TestInstancesWithCinderVolumes-554188937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-ec8a14b9-99f7-434b-85a6-499a7ed2f589" returned: 0 in 0.324s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:36:54 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-06760936-1d9b-4205-add7-cf3a1f0848a0 tempest-TestInstancesWithCinderVolumes-554188937 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:36:54 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-06760936-1d9b-4205-add7-cf3a1f0848a0 tempest-TestInstancesWithCinderVolumes-554188937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:36:54 devstack cinder-volume[88719]: DEBUG cinder.volume.volume_utils [None req-06760936-1d9b-4205-add7-cf3a1f0848a0 tempest-TestInstancesWithCinderVolumes-554188937 None] Attempting download of 1f620dec-3845-43ae-8168-cf830b2210df ((None, [{'url': 'file:///opt/stack/data/glance/images/1f620dec-3845-43ae-8168-cf830b2210df', 'metadata': {}}])) to volume ec8a14b9-99f7-434b-85a6-499a7ed2f589. {{(pid=88719) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 30 20:36:54 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[13793f98-7172-4410-89b6-01450e81db18]: (4, 'raw') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:36:54 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-06760936-1d9b-4205-add7-cf3a1f0848a0 tempest-TestInstancesWithCinderVolumes-554188937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1f620dec-3845-43ae-8168-cf830b2210df_76ey4n24 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:36:54 devstack sudo[104671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1f620dec-3845-43ae-8168-cf830b2210df_76ey4n24
Jul 30 20:36:54 devstack sudo[104671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:36:54 devstack sudo[104671]: pam_unix(sudo:session): session closed for user root
Jul 30 20:36:54 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-06760936-1d9b-4205-add7-cf3a1f0848a0 tempest-TestInstancesWithCinderVolumes-554188937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1f620dec-3845-43ae-8168-cf830b2210df_76ey4n24" returned: 0 in 0.450s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:36:54 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-06760936-1d9b-4205-add7-cf3a1f0848a0 tempest-TestInstancesWithCinderVolumes-554188937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1f620dec-3845-43ae-8168-cf830b2210df_76ey4n24 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:36:55 devstack sudo[104680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1f620dec-3845-43ae-8168-cf830b2210df_76ey4n24
Jul 30 20:36:55 devstack sudo[104680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:36:55 devstack sudo[104680]: pam_unix(sudo:session): session closed for user root
Jul 30 20:36:55 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-06760936-1d9b-4205-add7-cf3a1f0848a0 tempest-TestInstancesWithCinderVolumes-554188937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1f620dec-3845-43ae-8168-cf830b2210df_76ey4n24" returned: 1 in 0.515s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:36:55 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-06760936-1d9b-4205-add7-cf3a1f0848a0 tempest-TestInstancesWithCinderVolumes-554188937 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1f620dec-3845-43ae-8168-cf830b2210df_76ey4n24' failed. Not Retrying. {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 30 20:36:55 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aa38fd2-2505-48d1-84e7-9ef3a1b6f1cd]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:36:55 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-06760936-1d9b-4205-add7-cf3a1f0848a0 tempest-TestInstancesWithCinderVolumes-554188937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1f620dec-3845-43ae-8168-cf830b2210df_ubpv5ohsdevstack@QuobyteHD {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:36:55 devstack sudo[104704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1f620dec-3845-43ae-8168-cf830b2210df_ubpv5ohsdevstack@QuobyteHD
Jul 30 20:36:55 devstack sudo[104704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:36:55 devstack sudo[104704]: pam_unix(sudo:session): session closed for user root
Jul 30 20:36:55 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-06760936-1d9b-4205-add7-cf3a1f0848a0 tempest-TestInstancesWithCinderVolumes-554188937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1f620dec-3845-43ae-8168-cf830b2210df_ubpv5ohsdevstack@QuobyteHD" returned: 0 in 0.408s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:36:55 devstack cinder-volume[88719]: DEBUG cinder.image.image_utils [None req-06760936-1d9b-4205-add7-cf3a1f0848a0 tempest-TestInstancesWithCinderVolumes-554188937 None] 1f620dec-3845-43ae-8168-cf830b2210df was qcow2, converting to qcow2 {{(pid=88719) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 30 20:36:55 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-06760936-1d9b-4205-add7-cf3a1f0848a0 tempest-TestInstancesWithCinderVolumes-554188937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1f620dec-3845-43ae-8168-cf830b2210df_ubpv5ohsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-ec8a14b9-99f7-434b-85a6-499a7ed2f589 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:36:55 devstack sudo[104710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1f620dec-3845-43ae-8168-cf830b2210df_ubpv5ohsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-ec8a14b9-99f7-434b-85a6-499a7ed2f589
Jul 30 20:36:55 devstack sudo[104710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:36:57 devstack cinder-volume[88719]: INFO cinder.volume.manager [req-f22a1989-8dca-4d57-8850-e61c685776ba req-171ecb1f-595c-438f-9816-f7e57aa2e0b0 tempest-TestShelveInstance-274392155 None] Terminate volume connection completed successfully.
Jul 30 20:36:57 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [req-f22a1989-8dca-4d57-8850-e61c685776ba req-171ecb1f-595c-438f-9816-f7e57aa2e0b0 tempest-TestShelveInstance-274392155 None] Deleting attachment a170e856-51fe-4f74-ac38-bab03223084f. {{(pid=88719) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 30 20:36:57 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-0589ed49-3a5f-4569-825f-53039345db85 tempest-TestStampPattern-75201989 None] Acquiring lock "cinder-0883c285-cc2b-4727-af60-5bb30a001719-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:36:57 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-0589ed49-3a5f-4569-825f-53039345db85 tempest-TestStampPattern-75201989 None] Lock "cinder-0883c285-cc2b-4727-af60-5bb30a001719-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:36:57 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-0589ed49-3a5f-4569-825f-53039345db85 tempest-TestStampPattern-75201989 None] Acquiring lock "cinder-quobyte-0883c285-cc2b-4727-af60-5bb30a001719" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:36:57 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-0589ed49-3a5f-4569-825f-53039345db85 tempest-TestStampPattern-75201989 None] Lock "cinder-quobyte-0883c285-cc2b-4727-af60-5bb30a001719" acquired by "delete_volume" :: waited 0.017s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:36:57 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[deb59da3-b0fb-4125-9e5f-6320c419ddb1]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:36:57 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-0589ed49-3a5f-4569-825f-53039345db85 tempest-TestStampPattern-75201989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0883c285-cc2b-4727-af60-5bb30a001719 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:36:57 devstack sudo[104737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0883c285-cc2b-4727-af60-5bb30a001719
Jul 30 20:36:57 devstack sudo[104737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:36:58 devstack sudo[104710]: pam_unix(sudo:session): session closed for user root
Jul 30 20:36:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-06760936-1d9b-4205-add7-cf3a1f0848a0 tempest-TestInstancesWithCinderVolumes-554188937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1f620dec-3845-43ae-8168-cf830b2210df_ubpv5ohsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-ec8a14b9-99f7-434b-85a6-499a7ed2f589" returned: 0 in 2.412s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:36:58 devstack cinder-volume[88719]: DEBUG cinder.image.image_utils [None req-06760936-1d9b-4205-add7-cf3a1f0848a0 tempest-TestInstancesWithCinderVolumes-554188937 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1f620dec-3845-43ae-8168-cf830b2210df_ubpv5ohsdevstack@QuobyteHD, size 112.00 MB, duration 2.41 sec, destination /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-ec8a14b9-99f7-434b-85a6-499a7ed2f589 {{(pid=88719) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 30 20:36:58 devstack cinder-volume[88719]: INFO cinder.image.image_utils [None req-06760936-1d9b-4205-add7-cf3a1f0848a0 tempest-TestInstancesWithCinderVolumes-554188937 None] Converted 112.00 MB image at 46.42 MB/s
Jul 30 20:36:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-06760936-1d9b-4205-add7-cf3a1f0848a0 tempest-TestInstancesWithCinderVolumes-554188937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-ec8a14b9-99f7-434b-85a6-499a7ed2f589 1G {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:36:58 devstack sudo[104737]: pam_unix(sudo:session): session closed for user root
Jul 30 20:36:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-0589ed49-3a5f-4569-825f-53039345db85 tempest-TestStampPattern-75201989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0883c285-cc2b-4727-af60-5bb30a001719" returned: 0 in 0.465s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:36:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-0589ed49-3a5f-4569-825f-53039345db85 tempest-TestStampPattern-75201989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0883c285-cc2b-4727-af60-5bb30a001719 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:36:58 devstack sudo[104742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-ec8a14b9-99f7-434b-85a6-499a7ed2f589 1G
Jul 30 20:36:58 devstack sudo[104742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:36:58 devstack sudo[104743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0883c285-cc2b-4727-af60-5bb30a001719
Jul 30 20:36:58 devstack sudo[104743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:36:58 devstack sudo[104743]: pam_unix(sudo:session): session closed for user root
Jul 30 20:36:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-0589ed49-3a5f-4569-825f-53039345db85 tempest-TestStampPattern-75201989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0883c285-cc2b-4727-af60-5bb30a001719" returned: 0 in 0.276s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:36:58 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-0589ed49-3a5f-4569-825f-53039345db85 tempest-TestStampPattern-75201989 None] Lock "cinder-quobyte-0883c285-cc2b-4727-af60-5bb30a001719" released by "delete_volume" :: held 0.810s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:36:58 devstack sudo[104742]: pam_unix(sudo:session): session closed for user root
Jul 30 20:36:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-06760936-1d9b-4205-add7-cf3a1f0848a0 tempest-TestInstancesWithCinderVolumes-554188937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-ec8a14b9-99f7-434b-85a6-499a7ed2f589 1G" returned: 0 in 0.332s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:36:58 devstack cinder-volume[88719]: DEBUG cinder.volume.volume_utils [None req-06760936-1d9b-4205-add7-cf3a1f0848a0 tempest-TestInstancesWithCinderVolumes-554188937 None] Downloaded image 1f620dec-3845-43ae-8168-cf830b2210df ((None, [{'url': 'file:///opt/stack/data/glance/images/1f620dec-3845-43ae-8168-cf830b2210df', 'metadata': {}}])) to volume ec8a14b9-99f7-434b-85a6-499a7ed2f589 successfully. {{(pid=88719) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 30 20:36:58 devstack cinder-volume[88719]: DEBUG cinder.image.image_utils [None req-06760936-1d9b-4205-add7-cf3a1f0848a0 tempest-TestInstancesWithCinderVolumes-554188937 None] Temporary image 1f620dec-3845-43ae-8168-cf830b2210df for user 5e05594dfef84b018735d38fd5a3927f is deleted. {{(pid=88719) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 30 20:36:58 devstack cinder-volume[88719]: DEBUG cinder.volume.volume_utils [None req-06760936-1d9b-4205-add7-cf3a1f0848a0 tempest-TestInstancesWithCinderVolumes-554188937 None] Marking volume ec8a14b9-99f7-434b-85a6-499a7ed2f589 as bootable. {{(pid=88719) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 30 20:36:58 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-06760936-1d9b-4205-add7-cf3a1f0848a0 tempest-TestInstancesWithCinderVolumes-554188937 None] Copying metadata from image 1f620dec-3845-43ae-8168-cf830b2210df to ec8a14b9-99f7-434b-85a6-499a7ed2f589. {{(pid=88719) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 30 20:36:58 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-06760936-1d9b-4205-add7-cf3a1f0848a0 tempest-TestInstancesWithCinderVolumes-554188937 None] Creating volume glance metadata for volume ec8a14b9-99f7-434b-85a6-499a7ed2f589 backed by image 1f620dec-3845-43ae-8168-cf830b2210df with: {'image_id': '1f620dec-3845-43ae-8168-cf830b2210df', 'image_name': 'tempest-scenario-img--1129430271', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88719) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 30 20:36:58 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-0589ed49-3a5f-4569-825f-53039345db85 tempest-TestStampPattern-75201989 None] Created reservations ['c0f6466c-bf2a-4e15-b4e7-b275f84daa53', 'cb078a03-c6bd-4175-adfe-ed38c61b81d5', '8948657f-8124-415f-abe3-4eb45fc025db', 'e5cff7ed-db74-4234-9d6b-257ba369ee5f'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:36:58 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-06760936-1d9b-4205-add7-cf3a1f0848a0 tempest-TestInstancesWithCinderVolumes-554188937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86b7ad40-5305-40d0-8e52-b0793fcdd599) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec8a14b9-99f7-434b-85a6-499a7ed2f589', 'volume_size': 1, 'image_id': '1f620dec-3845-43ae-8168-cf830b2210df', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1f620dec-3845-43ae-8168-cf830b2210df', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1129430271', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '635493e4a0704165bc324974aeeee33f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1f620dec-3845-43ae-8168-cf830b2210df', 'created_at': datetime.datetime(2026, 7, 30, 18, 36, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 18, 36, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1f620dec-3845-43ae-8168-cf830b2210df/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7868848275c0>}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:36:58 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-06760936-1d9b-4205-add7-cf3a1f0848a0 tempest-TestInstancesWithCinderVolumes-554188937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f2d6028-6e28-48b3-b92e-326609b10b61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:36:58 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-06760936-1d9b-4205-add7-cf3a1f0848a0 tempest-TestInstancesWithCinderVolumes-554188937 None] Volume volume-ec8a14b9-99f7-434b-85a6-499a7ed2f589 (ec8a14b9-99f7-434b-85a6-499a7ed2f589): created successfully
Jul 30 20:36:58 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-06760936-1d9b-4205-add7-cf3a1f0848a0 tempest-TestInstancesWithCinderVolumes-554188937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f2d6028-6e28-48b3-b92e-326609b10b61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:36:58 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-06760936-1d9b-4205-add7-cf3a1f0848a0 tempest-TestInstancesWithCinderVolumes-554188937 None] Flow 'volume_create_manager' (2c298ca6-32c1-40ea-a18b-d399bcf9e844) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:36:58 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-06760936-1d9b-4205-add7-cf3a1f0848a0 tempest-TestInstancesWithCinderVolumes-554188937 None] Created volume successfully.
Jul 30 20:36:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-0589ed49-3a5f-4569-825f-53039345db85 tempest-TestStampPattern-75201989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:36:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-0589ed49-3a5f-4569-825f-53039345db85 tempest-TestStampPattern-75201989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:36:58 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-0589ed49-3a5f-4569-825f-53039345db85 tempest-TestStampPattern-75201989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:36:58 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-0589ed49-3a5f-4569-825f-53039345db85 tempest-TestStampPattern-75201989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:36:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-0589ed49-3a5f-4569-825f-53039345db85 tempest-TestStampPattern-75201989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:36:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-0589ed49-3a5f-4569-825f-53039345db85 tempest-TestStampPattern-75201989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:36:58 devstack sudo[104751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:36:58 devstack sudo[104751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:36:59 devstack sudo[104751]: pam_unix(sudo:session): session closed for user root
Jul 30 20:36:59 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-0589ed49-3a5f-4569-825f-53039345db85 tempest-TestStampPattern-75201989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.316s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:36:59 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-0589ed49-3a5f-4569-825f-53039345db85 tempest-TestStampPattern-75201989 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:36:59 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-0589ed49-3a5f-4569-825f-53039345db85 tempest-TestStampPattern-75201989 None] Deleted volume successfully.
Jul 30 20:36:59 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-0589ed49-3a5f-4569-825f-53039345db85 tempest-TestStampPattern-75201989 None] Lock "cinder-0883c285-cc2b-4727-af60-5bb30a001719-delete_volume" released by "delete_volume" :: held 1.483s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:37:00 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [req-f5482792-70e2-4c4f-9231-facb29ff2bcf req-17ed703c-651a-42b7-967b-d6c96d40e6ef tempest-TestShelveInstance-274392155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:37:00 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [req-f5482792-70e2-4c4f-9231-facb29ff2bcf req-17ed703c-651a-42b7-967b-d6c96d40e6ef tempest-TestShelveInstance-274392155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:37:00 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [req-f5482792-70e2-4c4f-9231-facb29ff2bcf req-17ed703c-651a-42b7-967b-d6c96d40e6ef tempest-TestShelveInstance-274392155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:37:00 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [req-f5482792-70e2-4c4f-9231-facb29ff2bcf req-17ed703c-651a-42b7-967b-d6c96d40e6ef tempest-TestShelveInstance-274392155 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5', 'name': 'volume-4671154d-1d6a-4b5d-a064-aebe543423a0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8d33d7ea-ef7b-4637-a902-1b2d1eb2cc64', 'enforce_multipath': True} {{(pid=88719) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 30 20:37:00 devstack cinder-volume[88719]: INFO cinder.volume.manager [req-f5482792-70e2-4c4f-9231-facb29ff2bcf req-17ed703c-651a-42b7-967b-d6c96d40e6ef tempest-TestShelveInstance-274392155 None] attachment_update completed successfully.
Jul 30 20:37:03 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [req-95bf2d9a-5298-4e4e-a895-5705b6ba09c1 req-88642ac9-91a6-46c1-b6f2-0284fd25714c tempest-TestInstancesWithCinderVolumes-554188937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:37:03 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [req-95bf2d9a-5298-4e4e-a895-5705b6ba09c1 req-88642ac9-91a6-46c1-b6f2-0284fd25714c tempest-TestInstancesWithCinderVolumes-554188937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:37:03 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [req-95bf2d9a-5298-4e4e-a895-5705b6ba09c1 req-88642ac9-91a6-46c1-b6f2-0284fd25714c tempest-TestInstancesWithCinderVolumes-554188937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:37:03 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [req-95bf2d9a-5298-4e4e-a895-5705b6ba09c1 req-88642ac9-91a6-46c1-b6f2-0284fd25714c tempest-TestInstancesWithCinderVolumes-554188937 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5', 'name': 'volume-ec8a14b9-99f7-434b-85a6-499a7ed2f589', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '900e8964-34cb-4abf-959c-8fe014355423', 'enforce_multipath': True} {{(pid=88719) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 30 20:37:03 devstack cinder-volume[88719]: INFO cinder.volume.manager [req-95bf2d9a-5298-4e4e-a895-5705b6ba09c1 req-88642ac9-91a6-46c1-b6f2-0284fd25714c tempest-TestInstancesWithCinderVolumes-554188937 None] attachment_update completed successfully.
Jul 30 20:37:13 devstack cinder-volume[88719]: DEBUG dbcounter [-] [88719] Writing DB stats cinder:SELECT=44,cinder:UPDATE=32,cinder:INSERT=13,cinder:DELETE=4 {{(pid=88719) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 30 20:37:13 devstack cinder-volume[88719]: DEBUG dbcounter [-] [88719] Writing DB stats cinder:SELECT=53,cinder:UPDATE=41,cinder:INSERT=11,cinder:DELETE=1 {{(pid=88719) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 30 20:37:15 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea229b93-ee83-4e23-a764-6eb3d20ca2e6 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:37:15 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-ea229b93-ee83-4e23-a764-6eb3d20ca2e6 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Flow 'volume_create_manager' (2d5ba912-a723-4fd3-b418-fe31201c4407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:37:15 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-ea229b93-ee83-4e23-a764-6eb3d20ca2e6 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d852835-b2a8-4b2c-81d9-bccca006d2bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:37:15 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-ea229b93-ee83-4e23-a764-6eb3d20ca2e6 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d852835-b2a8-4b2c-81d9-bccca006d2bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:37:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-54000465',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=541f00c5-33a4-47e7-b0b5-cb2c3fdde6a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f745d20d93694356a4edfa7fd79c1f24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:37:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:37:16Z,use_quota=True,user_id='f4fba2d27de14bd489772f201d0d5dc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:37:15 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-ea229b93-ee83-4e23-a764-6eb3d20ca2e6 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a0f5367-411b-4e42-8cfe-06888c10f3fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:37:15 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-ea229b93-ee83-4e23-a764-6eb3d20ca2e6 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a0f5367-411b-4e42-8cfe-06888c10f3fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:37:15 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-ea229b93-ee83-4e23-a764-6eb3d20ca2e6 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (019bada2-6d3e-45e8-a52d-5ba009442c5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:37:15 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-ea229b93-ee83-4e23-a764-6eb3d20ca2e6 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (019bada2-6d3e-45e8-a52d-5ba009442c5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '541f00c5-33a4-47e7-b0b5-cb2c3fdde6a2', 'volume_name': 'volume-541f00c5-33a4-47e7-b0b5-cb2c3fdde6a2', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:37:15 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-ea229b93-ee83-4e23-a764-6eb3d20ca2e6 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb475d33-47ad-49c1-9877-714913da1677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:37:15 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-ea229b93-ee83-4e23-a764-6eb3d20ca2e6 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb475d33-47ad-49c1-9877-714913da1677) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:37:15 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-ea229b93-ee83-4e23-a764-6eb3d20ca2e6 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5421b94b-4599-4cf2-8f0c-e2f878ad1465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:37:15 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-ea229b93-ee83-4e23-a764-6eb3d20ca2e6 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Volume 541f00c5-33a4-47e7-b0b5-cb2c3fdde6a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-541f00c5-33a4-47e7-b0b5-cb2c3fdde6a2', 'volume_size': 1}
Jul 30 20:37:15 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-ea229b93-ee83-4e23-a764-6eb3d20ca2e6 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:37:15 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-ea229b93-ee83-4e23-a764-6eb3d20ca2e6 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:37:15 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-ea229b93-ee83-4e23-a764-6eb3d20ca2e6 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:37:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-54000465',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=541f00c5-33a4-47e7-b0b5-cb2c3fdde6a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f745d20d93694356a4edfa7fd79c1f24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:37:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:37:16Z,use_quota=True,user_id='f4fba2d27de14bd489772f201d0d5dc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:37:15 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-ea229b93-ee83-4e23-a764-6eb3d20ca2e6 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Creating volume 541f00c5-33a4-47e7-b0b5-cb2c3fdde6a2 {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:37:15 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-ea229b93-ee83-4e23-a764-6eb3d20ca2e6 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:37:15 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-ea229b93-ee83-4e23-a764-6eb3d20ca2e6 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:37:15 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-ea229b93-ee83-4e23-a764-6eb3d20ca2e6 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:37:15 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-ea229b93-ee83-4e23-a764-6eb3d20ca2e6 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:37:15 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-ea229b93-ee83-4e23-a764-6eb3d20ca2e6 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:37:15 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-ea229b93-ee83-4e23-a764-6eb3d20ca2e6 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:37:15 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-ea229b93-ee83-4e23-a764-6eb3d20ca2e6 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:37:15 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-ea229b93-ee83-4e23-a764-6eb3d20ca2e6 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-541f00c5-33a4-47e7-b0b5-cb2c3fdde6a2 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:37:15 devstack sudo[105372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-541f00c5-33a4-47e7-b0b5-cb2c3fdde6a2 1073741824
Jul 30 20:37:15 devstack sudo[105372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:37:16 devstack cinder-volume[88719]: DEBUG oslo_service.periodic_task [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88719) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 30 20:37:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:37:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:37:16 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:37:16 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:37:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:37:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:37:16 devstack sudo[105377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:37:16 devstack sudo[105377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:37:16 devstack sudo[105372]: pam_unix(sudo:session): session closed for user root
Jul 30 20:37:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-ea229b93-ee83-4e23-a764-6eb3d20ca2e6 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-541f00c5-33a4-47e7-b0b5-cb2c3fdde6a2 1073741824" returned: 0 in 1.018s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:37:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-ea229b93-ee83-4e23-a764-6eb3d20ca2e6 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-541f00c5-33a4-47e7-b0b5-cb2c3fdde6a2 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:37:17 devstack sudo[105380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-541f00c5-33a4-47e7-b0b5-cb2c3fdde6a2
Jul 30 20:37:17 devstack sudo[105380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:37:17 devstack sudo[105377]: pam_unix(sudo:session): session closed for user root
Jul 30 20:37:17 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.674s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:37:17 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:37:17 devstack cinder-volume[88719]: DEBUG oslo_service.periodic_task [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Running periodic task VolumeManager._thread_info {{(pid=88719) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 30 20:37:17 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] thread count: 28 {{(pid=88719) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 30 20:37:17 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] thread info: [<_MainThread(MainThread, started 132390416908416)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132390306497536)>, <Thread(Thread-3 (stat_writer), started daemon 132390304471680)>, <Thread(Rabbit-heartbeat, started daemon 132390303393408)>, <Thread(Thread-5 (_runner), started daemon 132390303543168)>, <Thread(Thread-7 (_runner), started daemon 132390303563392)>, <Thread(fd_logger, started daemon 132390301344640)>, <Thread(privsep_reader, started daemon 132390301560640)>, <Thread(tpool_thread_0, started daemon 132390291470016)>, <Thread(tpool_thread_1, started daemon 132390283077312)>, <Thread(tpool_thread_2, started daemon 132390274684608)>, <Thread(tpool_thread_3, started daemon 132390266291904)>, <Thread(tpool_thread_4, started daemon 132390257899200)>, <Thread(tpool_thread_5, started daemon 132390249506496)>, <Thread(tpool_thread_6, started daemon 132390241113792)>, <Thread(tpool_thread_7, started daemon 132390232721088)>, <Thread(tpool_thread_8, started daemon 132390224328384)>, <Thread(tpool_thread_9, started daemon 132390215919296)>, <Thread(tpool_thread_10, started daemon 132390207510208)>, <Thread(tpool_thread_11, started daemon 132390199101120)>, <Thread(tpool_thread_12, started daemon 132390190692032)>, <Thread(tpool_thread_13, started daemon 132390182282944)>, <Thread(tpool_thread_14, started daemon 132390173873856)>, <Thread(tpool_thread_15, started daemon 132390165464768)>, <Thread(tpool_thread_16, started daemon 132390157055680)>, <Thread(tpool_thread_17, started daemon 132390148646592)>, <Thread(tpool_thread_18, started daemon 132390140237504)>, <Thread(tpool_thread_19, started daemon 132390131828416)>] {{(pid=88719) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 30 20:37:17 devstack sudo[105380]: pam_unix(sudo:session): session closed for user root
Jul 30 20:37:17 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-ea229b93-ee83-4e23-a764-6eb3d20ca2e6 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-541f00c5-33a4-47e7-b0b5-cb2c3fdde6a2" returned: 0 in 0.509s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:37:17 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-ea229b93-ee83-4e23-a764-6eb3d20ca2e6 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] <== create_volume: return (1621ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:37:17 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-ea229b93-ee83-4e23-a764-6eb3d20ca2e6 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.624s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:37:17 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-ea229b93-ee83-4e23-a764-6eb3d20ca2e6 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5421b94b-4599-4cf2-8f0c-e2f878ad1465) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-541f00c5-33a4-47e7-b0b5-cb2c3fdde6a2', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:37:17 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-ea229b93-ee83-4e23-a764-6eb3d20ca2e6 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7fb9ab5-2073-43a3-861d-7309e23adb1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:37:17 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-ea229b93-ee83-4e23-a764-6eb3d20ca2e6 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Volume volume-541f00c5-33a4-47e7-b0b5-cb2c3fdde6a2 (541f00c5-33a4-47e7-b0b5-cb2c3fdde6a2): created successfully
Jul 30 20:37:17 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-ea229b93-ee83-4e23-a764-6eb3d20ca2e6 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7fb9ab5-2073-43a3-861d-7309e23adb1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:37:17 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-ea229b93-ee83-4e23-a764-6eb3d20ca2e6 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Flow 'volume_create_manager' (2d5ba912-a723-4fd3-b418-fe31201c4407) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:37:17 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-ea229b93-ee83-4e23-a764-6eb3d20ca2e6 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Created volume successfully.
Jul 30 20:37:18 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-31e6ab52-9d79-4559-82bc-1b9d87a83575 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:37:18 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-31e6ab52-9d79-4559-82bc-1b9d87a83575 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Flow 'volume_create_manager' (b301118e-00a6-497a-b8f3-f085e00d2e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:37:18 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-31e6ab52-9d79-4559-82bc-1b9d87a83575 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6fe8170-c9de-4dc2-972d-ba890c4c52c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:37:18 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-31e6ab52-9d79-4559-82bc-1b9d87a83575 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6fe8170-c9de-4dc2-972d-ba890c4c52c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:37:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-870838747',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d2eebe8-fae5-4c05-9754-af3b3a897264,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f745d20d93694356a4edfa7fd79c1f24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:37:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:37:19Z,use_quota=True,user_id='f4fba2d27de14bd489772f201d0d5dc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:37:18 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-31e6ab52-9d79-4559-82bc-1b9d87a83575 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc2c2f70-b9c6-4c2d-8192-b82d08b5557a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:37:18 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-31e6ab52-9d79-4559-82bc-1b9d87a83575 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc2c2f70-b9c6-4c2d-8192-b82d08b5557a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:37:18 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-31e6ab52-9d79-4559-82bc-1b9d87a83575 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (596ce29e-9d57-4c59-aaf1-2fc8fccd1ed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:37:18 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-31e6ab52-9d79-4559-82bc-1b9d87a83575 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (596ce29e-9d57-4c59-aaf1-2fc8fccd1ed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d2eebe8-fae5-4c05-9754-af3b3a897264', 'volume_name': 'volume-9d2eebe8-fae5-4c05-9754-af3b3a897264', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:37:18 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-31e6ab52-9d79-4559-82bc-1b9d87a83575 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9322451-3ead-4907-b14c-95a584620cb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:37:18 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-31e6ab52-9d79-4559-82bc-1b9d87a83575 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9322451-3ead-4907-b14c-95a584620cb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:37:18 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-31e6ab52-9d79-4559-82bc-1b9d87a83575 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf998f84-a771-41f6-9648-d06ae6713a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:37:18 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-31e6ab52-9d79-4559-82bc-1b9d87a83575 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Volume 9d2eebe8-fae5-4c05-9754-af3b3a897264: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d2eebe8-fae5-4c05-9754-af3b3a897264', 'volume_size': 1}
Jul 30 20:37:18 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-31e6ab52-9d79-4559-82bc-1b9d87a83575 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:37:18 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-31e6ab52-9d79-4559-82bc-1b9d87a83575 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:37:18 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-31e6ab52-9d79-4559-82bc-1b9d87a83575 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:37:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-870838747',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d2eebe8-fae5-4c05-9754-af3b3a897264,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f745d20d93694356a4edfa7fd79c1f24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:37:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:37:19Z,use_quota=True,user_id='f4fba2d27de14bd489772f201d0d5dc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:37:18 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-31e6ab52-9d79-4559-82bc-1b9d87a83575 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Creating volume 9d2eebe8-fae5-4c05-9754-af3b3a897264 {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:37:18 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-31e6ab52-9d79-4559-82bc-1b9d87a83575 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:37:18 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-31e6ab52-9d79-4559-82bc-1b9d87a83575 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:37:18 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-31e6ab52-9d79-4559-82bc-1b9d87a83575 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:37:18 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-31e6ab52-9d79-4559-82bc-1b9d87a83575 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:37:18 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-31e6ab52-9d79-4559-82bc-1b9d87a83575 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:37:18 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-31e6ab52-9d79-4559-82bc-1b9d87a83575 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:37:18 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-31e6ab52-9d79-4559-82bc-1b9d87a83575 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:37:18 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-31e6ab52-9d79-4559-82bc-1b9d87a83575 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-9d2eebe8-fae5-4c05-9754-af3b3a897264 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:37:18 devstack sudo[105384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-9d2eebe8-fae5-4c05-9754-af3b3a897264 1073741824
Jul 30 20:37:18 devstack sudo[105384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:37:19 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-034ca0b9-8d50-41bd-b255-af160014cb6c tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:37:19 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-034ca0b9-8d50-41bd-b255-af160014cb6c tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Flow 'volume_create_manager' (ed8730b5-14f2-401d-819d-d901b63c2b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:37:19 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-034ca0b9-8d50-41bd-b255-af160014cb6c tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3a12905-f456-4224-a299-0be28d7e615b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:37:19 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-034ca0b9-8d50-41bd-b255-af160014cb6c tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3a12905-f456-4224-a299-0be28d7e615b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:37:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-908645347',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd1cdd18-409c-4e72-93da-31ded229808b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f745d20d93694356a4edfa7fd79c1f24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:37:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:37:19Z,use_quota=True,user_id='f4fba2d27de14bd489772f201d0d5dc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:37:19 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-034ca0b9-8d50-41bd-b255-af160014cb6c tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7363b900-0648-4b9d-aa17-b66840c0c100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:37:19 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-034ca0b9-8d50-41bd-b255-af160014cb6c tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7363b900-0648-4b9d-aa17-b66840c0c100) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:37:19 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-034ca0b9-8d50-41bd-b255-af160014cb6c tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61c009b8-1616-433e-bad6-78be32884c21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:37:19 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-034ca0b9-8d50-41bd-b255-af160014cb6c tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61c009b8-1616-433e-bad6-78be32884c21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd1cdd18-409c-4e72-93da-31ded229808b', 'volume_name': 'volume-fd1cdd18-409c-4e72-93da-31ded229808b', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:37:19 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-034ca0b9-8d50-41bd-b255-af160014cb6c tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (847164dc-d6de-4039-a986-8e4adffedd43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:37:19 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-034ca0b9-8d50-41bd-b255-af160014cb6c tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (847164dc-d6de-4039-a986-8e4adffedd43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:37:19 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-034ca0b9-8d50-41bd-b255-af160014cb6c tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f16e34d0-de24-41ab-90c7-00af08bdab2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:37:19 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-034ca0b9-8d50-41bd-b255-af160014cb6c tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Volume fd1cdd18-409c-4e72-93da-31ded229808b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd1cdd18-409c-4e72-93da-31ded229808b', 'volume_size': 1}
Jul 30 20:37:19 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-034ca0b9-8d50-41bd-b255-af160014cb6c tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:37:19 devstack sudo[105384]: pam_unix(sudo:session): session closed for user root
Jul 30 20:37:19 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-31e6ab52-9d79-4559-82bc-1b9d87a83575 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-9d2eebe8-fae5-4c05-9754-af3b3a897264 1073741824" returned: 0 in 1.077s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:37:19 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-31e6ab52-9d79-4559-82bc-1b9d87a83575 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-9d2eebe8-fae5-4c05-9754-af3b3a897264 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:37:20 devstack sudo[105389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-9d2eebe8-fae5-4c05-9754-af3b3a897264
Jul 30 20:37:20 devstack sudo[105389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:37:20 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3aa4c94-2d8d-4c82-a1d0-9db472a3fa91 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:37:20 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e3aa4c94-2d8d-4c82-a1d0-9db472a3fa91 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Flow 'volume_create_manager' (e406ee90-c368-41ca-ba43-851cf324c70b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:37:20 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e3aa4c94-2d8d-4c82-a1d0-9db472a3fa91 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (133445f4-6590-4e4b-8a53-de7a8725c25e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:37:20 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e3aa4c94-2d8d-4c82-a1d0-9db472a3fa91 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (133445f4-6590-4e4b-8a53-de7a8725c25e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:37:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1366210958',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=288a49cd-b512-45b9-8c5a-3d5b3837a686,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f745d20d93694356a4edfa7fd79c1f24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:37:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:37:20Z,use_quota=True,user_id='f4fba2d27de14bd489772f201d0d5dc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:37:20 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e3aa4c94-2d8d-4c82-a1d0-9db472a3fa91 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5f9b984-c397-4fb9-91f3-6c2b4134562b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:37:20 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e3aa4c94-2d8d-4c82-a1d0-9db472a3fa91 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5f9b984-c397-4fb9-91f3-6c2b4134562b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:37:20 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e3aa4c94-2d8d-4c82-a1d0-9db472a3fa91 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f08e533c-b561-428d-b2fc-3698900b510f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:37:20 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e3aa4c94-2d8d-4c82-a1d0-9db472a3fa91 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f08e533c-b561-428d-b2fc-3698900b510f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '288a49cd-b512-45b9-8c5a-3d5b3837a686', 'volume_name': 'volume-288a49cd-b512-45b9-8c5a-3d5b3837a686', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:37:20 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e3aa4c94-2d8d-4c82-a1d0-9db472a3fa91 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cf6b8c1-67aa-48c5-b9a8-1a16294d2999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:37:20 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e3aa4c94-2d8d-4c82-a1d0-9db472a3fa91 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cf6b8c1-67aa-48c5-b9a8-1a16294d2999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:37:20 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e3aa4c94-2d8d-4c82-a1d0-9db472a3fa91 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d3793f5-80ce-4629-ae23-e7052e6c9dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:37:20 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-e3aa4c94-2d8d-4c82-a1d0-9db472a3fa91 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Volume 288a49cd-b512-45b9-8c5a-3d5b3837a686: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-288a49cd-b512-45b9-8c5a-3d5b3837a686', 'volume_size': 1}
Jul 30 20:37:20 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-e3aa4c94-2d8d-4c82-a1d0-9db472a3fa91 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:37:20 devstack sudo[105389]: pam_unix(sudo:session): session closed for user root
Jul 30 20:37:20 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-31e6ab52-9d79-4559-82bc-1b9d87a83575 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-9d2eebe8-fae5-4c05-9754-af3b3a897264" returned: 0 in 0.649s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:37:20 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-31e6ab52-9d79-4559-82bc-1b9d87a83575 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] <== create_volume: return (1832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:37:20 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-31e6ab52-9d79-4559-82bc-1b9d87a83575 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.835s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:37:20 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-034ca0b9-8d50-41bd-b255-af160014cb6c tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.948s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:37:20 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-034ca0b9-8d50-41bd-b255-af160014cb6c tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:37:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-908645347',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd1cdd18-409c-4e72-93da-31ded229808b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f745d20d93694356a4edfa7fd79c1f24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:37:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:37:19Z,use_quota=True,user_id='f4fba2d27de14bd489772f201d0d5dc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:37:20 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-034ca0b9-8d50-41bd-b255-af160014cb6c tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Creating volume fd1cdd18-409c-4e72-93da-31ded229808b {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:37:20 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-034ca0b9-8d50-41bd-b255-af160014cb6c tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:37:20 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-034ca0b9-8d50-41bd-b255-af160014cb6c tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:37:20 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-034ca0b9-8d50-41bd-b255-af160014cb6c tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:37:20 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-034ca0b9-8d50-41bd-b255-af160014cb6c tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:37:20 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-034ca0b9-8d50-41bd-b255-af160014cb6c tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:37:20 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-034ca0b9-8d50-41bd-b255-af160014cb6c tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:37:20 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-034ca0b9-8d50-41bd-b255-af160014cb6c tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:37:20 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-034ca0b9-8d50-41bd-b255-af160014cb6c tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-fd1cdd18-409c-4e72-93da-31ded229808b 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:37:20 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-31e6ab52-9d79-4559-82bc-1b9d87a83575 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf998f84-a771-41f6-9648-d06ae6713a64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d2eebe8-fae5-4c05-9754-af3b3a897264', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:37:20 devstack sudo[105392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-fd1cdd18-409c-4e72-93da-31ded229808b 1073741824
Jul 30 20:37:20 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-31e6ab52-9d79-4559-82bc-1b9d87a83575 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddad726e-2585-4a6f-bbc2-a3d9a3fedced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:37:20 devstack sudo[105392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:37:20 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-31e6ab52-9d79-4559-82bc-1b9d87a83575 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Volume volume-9d2eebe8-fae5-4c05-9754-af3b3a897264 (9d2eebe8-fae5-4c05-9754-af3b3a897264): created successfully
Jul 30 20:37:20 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-31e6ab52-9d79-4559-82bc-1b9d87a83575 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddad726e-2585-4a6f-bbc2-a3d9a3fedced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:37:20 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-31e6ab52-9d79-4559-82bc-1b9d87a83575 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Flow 'volume_create_manager' (b301118e-00a6-497a-b8f3-f085e00d2e04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:37:20 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-31e6ab52-9d79-4559-82bc-1b9d87a83575 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Created volume successfully.
Jul 30 20:37:21 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bc75582-6363-4133-ade3-687e84d8a1c1 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:37:21 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-8bc75582-6363-4133-ade3-687e84d8a1c1 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Flow 'volume_create_manager' (4d919fd9-70b3-47e0-8e07-493b0de23d08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:37:21 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-8bc75582-6363-4133-ade3-687e84d8a1c1 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19acfc90-9df3-47b5-8279-5b68290dc96a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:37:21 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-8bc75582-6363-4133-ade3-687e84d8a1c1 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19acfc90-9df3-47b5-8279-5b68290dc96a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:37:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-980914708',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78fa8306-6f3a-444a-b861-8f1f7c3f0337,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f745d20d93694356a4edfa7fd79c1f24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:37:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:37:21Z,use_quota=True,user_id='f4fba2d27de14bd489772f201d0d5dc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:37:21 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-8bc75582-6363-4133-ade3-687e84d8a1c1 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4da9c0d4-4e00-498d-82f2-d7cee01b9167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:37:21 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-8bc75582-6363-4133-ade3-687e84d8a1c1 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4da9c0d4-4e00-498d-82f2-d7cee01b9167) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:37:21 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-8bc75582-6363-4133-ade3-687e84d8a1c1 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da9f8f2e-87f6-4eef-8cb4-adaa3d082521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:37:21 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-8bc75582-6363-4133-ade3-687e84d8a1c1 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da9f8f2e-87f6-4eef-8cb4-adaa3d082521) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78fa8306-6f3a-444a-b861-8f1f7c3f0337', 'volume_name': 'volume-78fa8306-6f3a-444a-b861-8f1f7c3f0337', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:37:21 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-8bc75582-6363-4133-ade3-687e84d8a1c1 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dbe7673-3747-4d7c-92bc-440db28a64a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:37:21 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-8bc75582-6363-4133-ade3-687e84d8a1c1 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dbe7673-3747-4d7c-92bc-440db28a64a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:37:21 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-8bc75582-6363-4133-ade3-687e84d8a1c1 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e0ac235-e4a9-4f21-8488-42346df67a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:37:21 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-8bc75582-6363-4133-ade3-687e84d8a1c1 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Volume 78fa8306-6f3a-444a-b861-8f1f7c3f0337: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78fa8306-6f3a-444a-b861-8f1f7c3f0337', 'volume_size': 1}
Jul 30 20:37:21 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-8bc75582-6363-4133-ade3-687e84d8a1c1 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:37:21 devstack sudo[105392]: pam_unix(sudo:session): session closed for user root
Jul 30 20:37:21 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-034ca0b9-8d50-41bd-b255-af160014cb6c tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-fd1cdd18-409c-4e72-93da-31ded229808b 1073741824" returned: 0 in 1.140s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:37:21 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-dce0f14e-d81e-4374-9699-b8e93fbf9135 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:37:21 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-dce0f14e-d81e-4374-9699-b8e93fbf9135 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Flow 'volume_create_manager' (b840cdec-9c5d-4a24-a061-523bd930d265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:37:21 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-dce0f14e-d81e-4374-9699-b8e93fbf9135 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8013d5eb-4c01-4151-acd3-297daad2839a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:37:21 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-034ca0b9-8d50-41bd-b255-af160014cb6c tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-fd1cdd18-409c-4e72-93da-31ded229808b {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:37:21 devstack sudo[105399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-fd1cdd18-409c-4e72-93da-31ded229808b
Jul 30 20:37:21 devstack sudo[105399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:37:21 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-dce0f14e-d81e-4374-9699-b8e93fbf9135 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8013d5eb-4c01-4151-acd3-297daad2839a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:37:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1059880904',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2ec47db-0f14-4aaf-ac91-71271bb31510,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f745d20d93694356a4edfa7fd79c1f24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:37:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:37:22Z,use_quota=True,user_id='f4fba2d27de14bd489772f201d0d5dc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:37:21 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-dce0f14e-d81e-4374-9699-b8e93fbf9135 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6177f76-c319-486c-93bf-e0b06891947b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:37:21 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-dce0f14e-d81e-4374-9699-b8e93fbf9135 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6177f76-c319-486c-93bf-e0b06891947b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:37:21 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-dce0f14e-d81e-4374-9699-b8e93fbf9135 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14a1e126-9932-4963-b2a3-db075e18527b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:37:21 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-dce0f14e-d81e-4374-9699-b8e93fbf9135 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14a1e126-9932-4963-b2a3-db075e18527b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2ec47db-0f14-4aaf-ac91-71271bb31510', 'volume_name': 'volume-b2ec47db-0f14-4aaf-ac91-71271bb31510', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:37:21 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-dce0f14e-d81e-4374-9699-b8e93fbf9135 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92e5d793-13cf-4645-9d24-54a4a1cb0b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:37:21 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-dce0f14e-d81e-4374-9699-b8e93fbf9135 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92e5d793-13cf-4645-9d24-54a4a1cb0b67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:37:21 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-dce0f14e-d81e-4374-9699-b8e93fbf9135 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d325378-47d9-47c8-aab4-f34f771ed52a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:37:21 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-dce0f14e-d81e-4374-9699-b8e93fbf9135 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Volume b2ec47db-0f14-4aaf-ac91-71271bb31510: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2ec47db-0f14-4aaf-ac91-71271bb31510', 'volume_size': 1}
Jul 30 20:37:22 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-dce0f14e-d81e-4374-9699-b8e93fbf9135 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:37:22 devstack sudo[105399]: pam_unix(sudo:session): session closed for user root
Jul 30 20:37:22 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-034ca0b9-8d50-41bd-b255-af160014cb6c tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-fd1cdd18-409c-4e72-93da-31ded229808b" returned: 0 in 0.395s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:37:22 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-034ca0b9-8d50-41bd-b255-af160014cb6c tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] <== create_volume: return (1675ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:37:22 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-034ca0b9-8d50-41bd-b255-af160014cb6c tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.678s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:37:22 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-e3aa4c94-2d8d-4c82-a1d0-9db472a3fa91 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.970s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:37:22 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-e3aa4c94-2d8d-4c82-a1d0-9db472a3fa91 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:37:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1366210958',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=288a49cd-b512-45b9-8c5a-3d5b3837a686,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f745d20d93694356a4edfa7fd79c1f24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:37:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:37:20Z,use_quota=True,user_id='f4fba2d27de14bd489772f201d0d5dc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:37:22 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-e3aa4c94-2d8d-4c82-a1d0-9db472a3fa91 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Creating volume 288a49cd-b512-45b9-8c5a-3d5b3837a686 {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:37:22 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-e3aa4c94-2d8d-4c82-a1d0-9db472a3fa91 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:37:22 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-e3aa4c94-2d8d-4c82-a1d0-9db472a3fa91 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:37:22 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-e3aa4c94-2d8d-4c82-a1d0-9db472a3fa91 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:37:22 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-e3aa4c94-2d8d-4c82-a1d0-9db472a3fa91 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:37:22 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-e3aa4c94-2d8d-4c82-a1d0-9db472a3fa91 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:37:22 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-e3aa4c94-2d8d-4c82-a1d0-9db472a3fa91 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:37:22 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-e3aa4c94-2d8d-4c82-a1d0-9db472a3fa91 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:37:22 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-e3aa4c94-2d8d-4c82-a1d0-9db472a3fa91 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-288a49cd-b512-45b9-8c5a-3d5b3837a686 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:37:22 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-034ca0b9-8d50-41bd-b255-af160014cb6c tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f16e34d0-de24-41ab-90c7-00af08bdab2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd1cdd18-409c-4e72-93da-31ded229808b', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:37:22 devstack sudo[105402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-288a49cd-b512-45b9-8c5a-3d5b3837a686 1073741824
Jul 30 20:37:22 devstack sudo[105402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:37:22 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-034ca0b9-8d50-41bd-b255-af160014cb6c tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df87e73f-928d-44ef-bfb5-793a23857607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:37:22 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-034ca0b9-8d50-41bd-b255-af160014cb6c tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Volume volume-fd1cdd18-409c-4e72-93da-31ded229808b (fd1cdd18-409c-4e72-93da-31ded229808b): created successfully
Jul 30 20:37:22 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-034ca0b9-8d50-41bd-b255-af160014cb6c tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df87e73f-928d-44ef-bfb5-793a23857607) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:37:22 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-034ca0b9-8d50-41bd-b255-af160014cb6c tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Flow 'volume_create_manager' (ed8730b5-14f2-401d-819d-d901b63c2b20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:37:22 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-034ca0b9-8d50-41bd-b255-af160014cb6c tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Created volume successfully.
Jul 30 20:37:22 devstack sudo[105402]: pam_unix(sudo:session): session closed for user root
Jul 30 20:37:22 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-e3aa4c94-2d8d-4c82-a1d0-9db472a3fa91 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-288a49cd-b512-45b9-8c5a-3d5b3837a686 1073741824" returned: 0 in 0.450s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:37:22 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-e3aa4c94-2d8d-4c82-a1d0-9db472a3fa91 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-288a49cd-b512-45b9-8c5a-3d5b3837a686 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:37:22 devstack sudo[105408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-288a49cd-b512-45b9-8c5a-3d5b3837a686
Jul 30 20:37:22 devstack sudo[105408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:37:23 devstack sudo[105408]: pam_unix(sudo:session): session closed for user root
Jul 30 20:37:23 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-e3aa4c94-2d8d-4c82-a1d0-9db472a3fa91 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-288a49cd-b512-45b9-8c5a-3d5b3837a686" returned: 0 in 0.267s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:37:23 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-e3aa4c94-2d8d-4c82-a1d0-9db472a3fa91 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] <== create_volume: return (773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:37:23 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-e3aa4c94-2d8d-4c82-a1d0-9db472a3fa91 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.779s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:37:23 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-8bc75582-6363-4133-ade3-687e84d8a1c1 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.585s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:37:23 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-8bc75582-6363-4133-ade3-687e84d8a1c1 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:37:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-980914708',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78fa8306-6f3a-444a-b861-8f1f7c3f0337,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f745d20d93694356a4edfa7fd79c1f24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:37:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:37:21Z,use_quota=True,user_id='f4fba2d27de14bd489772f201d0d5dc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:37:23 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-8bc75582-6363-4133-ade3-687e84d8a1c1 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Creating volume 78fa8306-6f3a-444a-b861-8f1f7c3f0337 {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:37:23 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-8bc75582-6363-4133-ade3-687e84d8a1c1 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:37:23 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-8bc75582-6363-4133-ade3-687e84d8a1c1 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:37:23 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-8bc75582-6363-4133-ade3-687e84d8a1c1 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:37:23 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-8bc75582-6363-4133-ade3-687e84d8a1c1 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:37:23 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-8bc75582-6363-4133-ade3-687e84d8a1c1 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:37:23 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-8bc75582-6363-4133-ade3-687e84d8a1c1 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:37:23 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-8bc75582-6363-4133-ade3-687e84d8a1c1 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:37:23 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8bc75582-6363-4133-ade3-687e84d8a1c1 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-78fa8306-6f3a-444a-b861-8f1f7c3f0337 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:37:23 devstack sudo[105411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-78fa8306-6f3a-444a-b861-8f1f7c3f0337 1073741824
Jul 30 20:37:23 devstack sudo[105411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:37:23 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e3aa4c94-2d8d-4c82-a1d0-9db472a3fa91 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d3793f5-80ce-4629-ae23-e7052e6c9dae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-288a49cd-b512-45b9-8c5a-3d5b3837a686', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:37:23 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e3aa4c94-2d8d-4c82-a1d0-9db472a3fa91 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cc490ee-6469-4439-bbb4-c32fa8d10835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:37:23 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-e3aa4c94-2d8d-4c82-a1d0-9db472a3fa91 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Volume volume-288a49cd-b512-45b9-8c5a-3d5b3837a686 (288a49cd-b512-45b9-8c5a-3d5b3837a686): created successfully
Jul 30 20:37:23 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e3aa4c94-2d8d-4c82-a1d0-9db472a3fa91 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cc490ee-6469-4439-bbb4-c32fa8d10835) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:37:23 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e3aa4c94-2d8d-4c82-a1d0-9db472a3fa91 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Flow 'volume_create_manager' (e406ee90-c368-41ca-ba43-851cf324c70b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:37:23 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-e3aa4c94-2d8d-4c82-a1d0-9db472a3fa91 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Created volume successfully.
Jul 30 20:37:23 devstack sudo[105411]: pam_unix(sudo:session): session closed for user root
Jul 30 20:37:23 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8bc75582-6363-4133-ade3-687e84d8a1c1 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-78fa8306-6f3a-444a-b861-8f1f7c3f0337 1073741824" returned: 0 in 0.488s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:37:23 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8bc75582-6363-4133-ade3-687e84d8a1c1 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-78fa8306-6f3a-444a-b861-8f1f7c3f0337 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:37:23 devstack sudo[105417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-78fa8306-6f3a-444a-b861-8f1f7c3f0337
Jul 30 20:37:23 devstack sudo[105417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:37:23 devstack sudo[105417]: pam_unix(sudo:session): session closed for user root
Jul 30 20:37:23 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8bc75582-6363-4133-ade3-687e84d8a1c1 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-78fa8306-6f3a-444a-b861-8f1f7c3f0337" returned: 0 in 0.291s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:37:23 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-8bc75582-6363-4133-ade3-687e84d8a1c1 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] <== create_volume: return (818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:37:23 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-8bc75582-6363-4133-ade3-687e84d8a1c1 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.822s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:37:23 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-dce0f14e-d81e-4374-9699-b8e93fbf9135 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.884s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:37:23 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-dce0f14e-d81e-4374-9699-b8e93fbf9135 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:37:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1059880904',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2ec47db-0f14-4aaf-ac91-71271bb31510,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f745d20d93694356a4edfa7fd79c1f24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:37:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:37:22Z,use_quota=True,user_id='f4fba2d27de14bd489772f201d0d5dc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:37:23 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-dce0f14e-d81e-4374-9699-b8e93fbf9135 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Creating volume b2ec47db-0f14-4aaf-ac91-71271bb31510 {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:37:23 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-dce0f14e-d81e-4374-9699-b8e93fbf9135 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:37:23 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-dce0f14e-d81e-4374-9699-b8e93fbf9135 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:37:23 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-dce0f14e-d81e-4374-9699-b8e93fbf9135 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:37:23 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-dce0f14e-d81e-4374-9699-b8e93fbf9135 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:37:23 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-dce0f14e-d81e-4374-9699-b8e93fbf9135 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:37:23 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-dce0f14e-d81e-4374-9699-b8e93fbf9135 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:37:23 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-dce0f14e-d81e-4374-9699-b8e93fbf9135 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:37:23 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-dce0f14e-d81e-4374-9699-b8e93fbf9135 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b2ec47db-0f14-4aaf-ac91-71271bb31510 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:37:23 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-8bc75582-6363-4133-ade3-687e84d8a1c1 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e0ac235-e4a9-4f21-8488-42346df67a39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78fa8306-6f3a-444a-b861-8f1f7c3f0337', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:37:23 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-8bc75582-6363-4133-ade3-687e84d8a1c1 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83020cd8-bfb8-44ee-9a9f-eb7cab654200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:37:23 devstack sudo[105420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b2ec47db-0f14-4aaf-ac91-71271bb31510 1073741824
Jul 30 20:37:23 devstack sudo[105420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:37:23 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-8bc75582-6363-4133-ade3-687e84d8a1c1 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Volume volume-78fa8306-6f3a-444a-b861-8f1f7c3f0337 (78fa8306-6f3a-444a-b861-8f1f7c3f0337): created successfully
Jul 30 20:37:23 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-8bc75582-6363-4133-ade3-687e84d8a1c1 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83020cd8-bfb8-44ee-9a9f-eb7cab654200) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:37:23 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-8bc75582-6363-4133-ade3-687e84d8a1c1 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Flow 'volume_create_manager' (4d919fd9-70b3-47e0-8e07-493b0de23d08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:37:24 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-8bc75582-6363-4133-ade3-687e84d8a1c1 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Created volume successfully.
Jul 30 20:37:24 devstack sudo[105420]: pam_unix(sudo:session): session closed for user root
Jul 30 20:37:24 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-dce0f14e-d81e-4374-9699-b8e93fbf9135 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b2ec47db-0f14-4aaf-ac91-71271bb31510 1073741824" returned: 0 in 0.472s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:37:24 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-dce0f14e-d81e-4374-9699-b8e93fbf9135 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b2ec47db-0f14-4aaf-ac91-71271bb31510 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:37:24 devstack sudo[105426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b2ec47db-0f14-4aaf-ac91-71271bb31510
Jul 30 20:37:24 devstack sudo[105426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:37:24 devstack sudo[105426]: pam_unix(sudo:session): session closed for user root
Jul 30 20:37:24 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-dce0f14e-d81e-4374-9699-b8e93fbf9135 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b2ec47db-0f14-4aaf-ac91-71271bb31510" returned: 0 in 0.242s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:37:24 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-dce0f14e-d81e-4374-9699-b8e93fbf9135 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] <== create_volume: return (759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:37:24 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-dce0f14e-d81e-4374-9699-b8e93fbf9135 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.763s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:37:24 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-dce0f14e-d81e-4374-9699-b8e93fbf9135 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d325378-47d9-47c8-aab4-f34f771ed52a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2ec47db-0f14-4aaf-ac91-71271bb31510', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:37:24 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-dce0f14e-d81e-4374-9699-b8e93fbf9135 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97998674-4b45-4c19-be82-a9cd7d3cf989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:37:24 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-dce0f14e-d81e-4374-9699-b8e93fbf9135 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Volume volume-b2ec47db-0f14-4aaf-ac91-71271bb31510 (b2ec47db-0f14-4aaf-ac91-71271bb31510): created successfully
Jul 30 20:37:24 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-dce0f14e-d81e-4374-9699-b8e93fbf9135 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97998674-4b45-4c19-be82-a9cd7d3cf989) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:37:24 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-dce0f14e-d81e-4374-9699-b8e93fbf9135 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Flow 'volume_create_manager' (b840cdec-9c5d-4a24-a061-523bd930d265) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:37:24 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-dce0f14e-d81e-4374-9699-b8e93fbf9135 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Created volume successfully.
Jul 30 20:37:25 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-cea1a160-3e12-4c1a-bda3-594e2ec363de tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Acquiring lock "cinder-b2ec47db-0f14-4aaf-ac91-71271bb31510-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:37:25 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-cea1a160-3e12-4c1a-bda3-594e2ec363de tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Lock "cinder-b2ec47db-0f14-4aaf-ac91-71271bb31510-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:37:25 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-cea1a160-3e12-4c1a-bda3-594e2ec363de tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Acquiring lock "cinder-quobyte-b2ec47db-0f14-4aaf-ac91-71271bb31510" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:37:25 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-cea1a160-3e12-4c1a-bda3-594e2ec363de tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Lock "cinder-quobyte-b2ec47db-0f14-4aaf-ac91-71271bb31510" acquired by "delete_volume" :: waited 0.019s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:37:25 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dc56f65-4301-4313-b958-ae4bc9ea49a7]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:37:25 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-cea1a160-3e12-4c1a-bda3-594e2ec363de tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b2ec47db-0f14-4aaf-ac91-71271bb31510 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:37:25 devstack sudo[105430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b2ec47db-0f14-4aaf-ac91-71271bb31510
Jul 30 20:37:25 devstack sudo[105430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:37:25 devstack sudo[105430]: pam_unix(sudo:session): session closed for user root
Jul 30 20:37:25 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-cea1a160-3e12-4c1a-bda3-594e2ec363de tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b2ec47db-0f14-4aaf-ac91-71271bb31510" returned: 0 in 0.409s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:37:25 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-cea1a160-3e12-4c1a-bda3-594e2ec363de tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b2ec47db-0f14-4aaf-ac91-71271bb31510 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:37:25 devstack sudo[105435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b2ec47db-0f14-4aaf-ac91-71271bb31510
Jul 30 20:37:25 devstack sudo[105435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:37:25 devstack sudo[105435]: pam_unix(sudo:session): session closed for user root
Jul 30 20:37:25 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-cea1a160-3e12-4c1a-bda3-594e2ec363de tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-b2ec47db-0f14-4aaf-ac91-71271bb31510" returned: 0 in 0.262s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:37:25 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-cea1a160-3e12-4c1a-bda3-594e2ec363de tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Lock "cinder-quobyte-b2ec47db-0f14-4aaf-ac91-71271bb31510" released by "delete_volume" :: held 0.720s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:37:25 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-cea1a160-3e12-4c1a-bda3-594e2ec363de tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Created reservations ['3d62ac2a-3a4a-4d62-ab2d-24a768c5e439', '035a99dd-20ba-4d54-98f0-a0de8f24f667', '3230a3c1-714c-49fe-89a5-571b86605c76', 'b46ca07f-b37c-44b0-9678-79855aa10640'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:37:26 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-cea1a160-3e12-4c1a-bda3-594e2ec363de tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:37:26 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-cea1a160-3e12-4c1a-bda3-594e2ec363de tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:37:26 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-cea1a160-3e12-4c1a-bda3-594e2ec363de tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:37:26 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-cea1a160-3e12-4c1a-bda3-594e2ec363de tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:37:26 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-cea1a160-3e12-4c1a-bda3-594e2ec363de tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:37:26 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-cea1a160-3e12-4c1a-bda3-594e2ec363de tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:37:26 devstack sudo[105438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:37:26 devstack sudo[105438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:37:26 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-dafb0a88-dda5-4afc-a1d7-b14eab5ef56c tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Acquiring lock "cinder-78fa8306-6f3a-444a-b861-8f1f7c3f0337-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:37:26 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-dafb0a88-dda5-4afc-a1d7-b14eab5ef56c tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Lock "cinder-78fa8306-6f3a-444a-b861-8f1f7c3f0337-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:37:26 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-dafb0a88-dda5-4afc-a1d7-b14eab5ef56c tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Acquiring lock "cinder-quobyte-78fa8306-6f3a-444a-b861-8f1f7c3f0337" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:37:26 devstack sudo[105438]: pam_unix(sudo:session): session closed for user root
Jul 30 20:37:26 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-cea1a160-3e12-4c1a-bda3-594e2ec363de tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.442s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:37:26 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-cea1a160-3e12-4c1a-bda3-594e2ec363de tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:37:26 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-dafb0a88-dda5-4afc-a1d7-b14eab5ef56c tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Lock "cinder-quobyte-78fa8306-6f3a-444a-b861-8f1f7c3f0337" acquired by "delete_volume" :: waited 0.031s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:37:26 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-cea1a160-3e12-4c1a-bda3-594e2ec363de tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Deleted volume successfully.
Jul 30 20:37:26 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[66c007e0-c55f-4460-a9c5-2c9594dcc53a]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:37:26 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-dafb0a88-dda5-4afc-a1d7-b14eab5ef56c tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-78fa8306-6f3a-444a-b861-8f1f7c3f0337 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:37:26 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-cea1a160-3e12-4c1a-bda3-594e2ec363de tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Lock "cinder-b2ec47db-0f14-4aaf-ac91-71271bb31510-delete_volume" released by "delete_volume" :: held 1.453s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:37:26 devstack sudo[105465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-78fa8306-6f3a-444a-b861-8f1f7c3f0337
Jul 30 20:37:26 devstack sudo[105465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:37:26 devstack sudo[105465]: pam_unix(sudo:session): session closed for user root
Jul 30 20:37:26 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-dafb0a88-dda5-4afc-a1d7-b14eab5ef56c tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-78fa8306-6f3a-444a-b861-8f1f7c3f0337" returned: 0 in 0.385s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:37:26 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-dafb0a88-dda5-4afc-a1d7-b14eab5ef56c tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-78fa8306-6f3a-444a-b861-8f1f7c3f0337 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:37:26 devstack sudo[105471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-78fa8306-6f3a-444a-b861-8f1f7c3f0337
Jul 30 20:37:26 devstack sudo[105471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:37:27 devstack sudo[105471]: pam_unix(sudo:session): session closed for user root
Jul 30 20:37:27 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-dafb0a88-dda5-4afc-a1d7-b14eab5ef56c tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-78fa8306-6f3a-444a-b861-8f1f7c3f0337" returned: 0 in 0.250s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:37:27 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-dafb0a88-dda5-4afc-a1d7-b14eab5ef56c tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Lock "cinder-quobyte-78fa8306-6f3a-444a-b861-8f1f7c3f0337" released by "delete_volume" :: held 0.719s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:37:27 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-dafb0a88-dda5-4afc-a1d7-b14eab5ef56c tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Created reservations ['946bef15-4bd1-4fe6-8537-a2a48eb8122a', '0327421b-85ca-4714-84d5-207157e6103c', 'b9d0e836-d724-4b33-bdb6-bd6fbe47aaee', 'cbcad4cb-0820-4e60-be58-aa2a5dc6f8af'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:37:27 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-dafb0a88-dda5-4afc-a1d7-b14eab5ef56c tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:37:27 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-dafb0a88-dda5-4afc-a1d7-b14eab5ef56c tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:37:27 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-dafb0a88-dda5-4afc-a1d7-b14eab5ef56c tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:37:27 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-dafb0a88-dda5-4afc-a1d7-b14eab5ef56c tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:37:27 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-dafb0a88-dda5-4afc-a1d7-b14eab5ef56c tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:37:27 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-dafb0a88-dda5-4afc-a1d7-b14eab5ef56c tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:37:27 devstack sudo[105474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:37:27 devstack sudo[105474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:37:27 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-bfc5796f-bbf3-4a3d-8ba6-9efc6905adf6 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Acquiring lock "cinder-288a49cd-b512-45b9-8c5a-3d5b3837a686-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:37:27 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-bfc5796f-bbf3-4a3d-8ba6-9efc6905adf6 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Lock "cinder-288a49cd-b512-45b9-8c5a-3d5b3837a686-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:37:27 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-bfc5796f-bbf3-4a3d-8ba6-9efc6905adf6 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Acquiring lock "cinder-quobyte-288a49cd-b512-45b9-8c5a-3d5b3837a686" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:37:27 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-bfc5796f-bbf3-4a3d-8ba6-9efc6905adf6 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Lock "cinder-quobyte-288a49cd-b512-45b9-8c5a-3d5b3837a686" acquired by "delete_volume" :: waited 0.024s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:37:27 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2ea96d3-2849-4135-b432-c9acae8e7ecd]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:37:27 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-bfc5796f-bbf3-4a3d-8ba6-9efc6905adf6 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-288a49cd-b512-45b9-8c5a-3d5b3837a686 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:37:27 devstack sudo[105474]: pam_unix(sudo:session): session closed for user root
Jul 30 20:37:27 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-dafb0a88-dda5-4afc-a1d7-b14eab5ef56c tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.387s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:37:27 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-dafb0a88-dda5-4afc-a1d7-b14eab5ef56c tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:37:27 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-dafb0a88-dda5-4afc-a1d7-b14eab5ef56c tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Deleted volume successfully.
Jul 30 20:37:27 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-dafb0a88-dda5-4afc-a1d7-b14eab5ef56c tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Lock "cinder-78fa8306-6f3a-444a-b861-8f1f7c3f0337-delete_volume" released by "delete_volume" :: held 1.404s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:37:27 devstack sudo[105477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-288a49cd-b512-45b9-8c5a-3d5b3837a686
Jul 30 20:37:27 devstack sudo[105477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:37:28 devstack sudo[105477]: pam_unix(sudo:session): session closed for user root
Jul 30 20:37:28 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-bfc5796f-bbf3-4a3d-8ba6-9efc6905adf6 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-288a49cd-b512-45b9-8c5a-3d5b3837a686" returned: 0 in 0.460s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:37:28 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-bfc5796f-bbf3-4a3d-8ba6-9efc6905adf6 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-288a49cd-b512-45b9-8c5a-3d5b3837a686 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:37:28 devstack sudo[105494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-288a49cd-b512-45b9-8c5a-3d5b3837a686
Jul 30 20:37:28 devstack sudo[105494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:37:28 devstack sudo[105494]: pam_unix(sudo:session): session closed for user root
Jul 30 20:37:28 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-bfc5796f-bbf3-4a3d-8ba6-9efc6905adf6 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-288a49cd-b512-45b9-8c5a-3d5b3837a686" returned: 0 in 0.307s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:37:28 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-bfc5796f-bbf3-4a3d-8ba6-9efc6905adf6 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Lock "cinder-quobyte-288a49cd-b512-45b9-8c5a-3d5b3837a686" released by "delete_volume" :: held 0.820s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:37:28 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-bfc5796f-bbf3-4a3d-8ba6-9efc6905adf6 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Created reservations ['5ab783cd-c63b-4dfe-bab7-dc3551b28a64', '76c25d13-ab61-40ed-8824-9051f6740320', '7a2b654f-409a-4aec-8896-46d7cabc95a5', '142e7291-ddc9-48d7-bc95-5f8c4a1d5167'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:37:28 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-bfc5796f-bbf3-4a3d-8ba6-9efc6905adf6 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:37:28 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-bfc5796f-bbf3-4a3d-8ba6-9efc6905adf6 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:37:28 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-bfc5796f-bbf3-4a3d-8ba6-9efc6905adf6 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:37:28 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-bfc5796f-bbf3-4a3d-8ba6-9efc6905adf6 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:37:28 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-bfc5796f-bbf3-4a3d-8ba6-9efc6905adf6 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:37:28 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-bfc5796f-bbf3-4a3d-8ba6-9efc6905adf6 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:37:28 devstack sudo[105498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:37:28 devstack sudo[105498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:37:28 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-76881a77-3842-46da-804e-03edbd32491e tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Acquiring lock "cinder-fd1cdd18-409c-4e72-93da-31ded229808b-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:37:28 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-76881a77-3842-46da-804e-03edbd32491e tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Lock "cinder-fd1cdd18-409c-4e72-93da-31ded229808b-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:37:28 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-76881a77-3842-46da-804e-03edbd32491e tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Acquiring lock "cinder-quobyte-fd1cdd18-409c-4e72-93da-31ded229808b" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:37:28 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-76881a77-3842-46da-804e-03edbd32491e tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Lock "cinder-quobyte-fd1cdd18-409c-4e72-93da-31ded229808b" acquired by "delete_volume" :: waited 0.019s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:37:28 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[abb79914-2210-4122-add2-5498303b8c85]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:37:28 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-76881a77-3842-46da-804e-03edbd32491e tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-fd1cdd18-409c-4e72-93da-31ded229808b {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:37:28 devstack sudo[105498]: pam_unix(sudo:session): session closed for user root
Jul 30 20:37:28 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-bfc5796f-bbf3-4a3d-8ba6-9efc6905adf6 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.326s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:37:28 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-bfc5796f-bbf3-4a3d-8ba6-9efc6905adf6 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:37:28 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-bfc5796f-bbf3-4a3d-8ba6-9efc6905adf6 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Deleted volume successfully.
Jul 30 20:37:29 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-bfc5796f-bbf3-4a3d-8ba6-9efc6905adf6 tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Lock "cinder-288a49cd-b512-45b9-8c5a-3d5b3837a686-delete_volume" released by "delete_volume" :: held 1.396s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:37:29 devstack sudo[105501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-fd1cdd18-409c-4e72-93da-31ded229808b
Jul 30 20:37:29 devstack sudo[105501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:37:29 devstack sudo[105501]: pam_unix(sudo:session): session closed for user root
Jul 30 20:37:29 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-76881a77-3842-46da-804e-03edbd32491e tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-fd1cdd18-409c-4e72-93da-31ded229808b" returned: 0 in 0.450s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:37:29 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-76881a77-3842-46da-804e-03edbd32491e tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-fd1cdd18-409c-4e72-93da-31ded229808b {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:37:29 devstack sudo[105506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-fd1cdd18-409c-4e72-93da-31ded229808b
Jul 30 20:37:29 devstack sudo[105506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:37:29 devstack sudo[105506]: pam_unix(sudo:session): session closed for user root
Jul 30 20:37:29 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-76881a77-3842-46da-804e-03edbd32491e tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-fd1cdd18-409c-4e72-93da-31ded229808b" returned: 0 in 0.272s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:37:29 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-76881a77-3842-46da-804e-03edbd32491e tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Lock "cinder-quobyte-fd1cdd18-409c-4e72-93da-31ded229808b" released by "delete_volume" :: held 0.779s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:37:29 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-76881a77-3842-46da-804e-03edbd32491e tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Created reservations ['0d22ce55-c544-466c-97e0-fa8b49aeb9b4', '0f3bf46e-36a6-455c-beda-78b8183412a2', 'bc3bedc4-1e4a-4eba-acac-0341dc0b95c2', '05646765-d8fc-42e9-97cd-3f13a32720eb'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:37:29 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-76881a77-3842-46da-804e-03edbd32491e tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:37:29 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-76881a77-3842-46da-804e-03edbd32491e tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:37:29 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-76881a77-3842-46da-804e-03edbd32491e tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:37:29 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-76881a77-3842-46da-804e-03edbd32491e tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:37:29 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-76881a77-3842-46da-804e-03edbd32491e tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:37:29 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-76881a77-3842-46da-804e-03edbd32491e tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:37:29 devstack sudo[105512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:37:29 devstack sudo[105512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:37:30 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-34d18e94-b5ce-47a0-a0db-565e819e4e3c tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Acquiring lock "cinder-9d2eebe8-fae5-4c05-9754-af3b3a897264-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:37:30 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-34d18e94-b5ce-47a0-a0db-565e819e4e3c tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Lock "cinder-9d2eebe8-fae5-4c05-9754-af3b3a897264-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:37:30 devstack sudo[105512]: pam_unix(sudo:session): session closed for user root
Jul 30 20:37:30 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-76881a77-3842-46da-804e-03edbd32491e tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.277s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:37:30 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-76881a77-3842-46da-804e-03edbd32491e tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:37:30 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-34d18e94-b5ce-47a0-a0db-565e819e4e3c tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Acquiring lock "cinder-quobyte-9d2eebe8-fae5-4c05-9754-af3b3a897264" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:37:30 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-76881a77-3842-46da-804e-03edbd32491e tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Deleted volume successfully.
Jul 30 20:37:30 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-34d18e94-b5ce-47a0-a0db-565e819e4e3c tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Lock "cinder-quobyte-9d2eebe8-fae5-4c05-9754-af3b3a897264" acquired by "delete_volume" :: waited 0.022s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:37:30 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-76881a77-3842-46da-804e-03edbd32491e tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Lock "cinder-fd1cdd18-409c-4e72-93da-31ded229808b-delete_volume" released by "delete_volume" :: held 1.321s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:37:30 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2f78f9d-6e9d-40a6-b03d-703917b77db7]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:37:30 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-34d18e94-b5ce-47a0-a0db-565e819e4e3c tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-9d2eebe8-fae5-4c05-9754-af3b3a897264 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:37:30 devstack sudo[105515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-9d2eebe8-fae5-4c05-9754-af3b3a897264
Jul 30 20:37:30 devstack sudo[105515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:37:30 devstack sudo[105515]: pam_unix(sudo:session): session closed for user root
Jul 30 20:37:30 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-34d18e94-b5ce-47a0-a0db-565e819e4e3c tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-9d2eebe8-fae5-4c05-9754-af3b3a897264" returned: 0 in 0.364s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:37:30 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-34d18e94-b5ce-47a0-a0db-565e819e4e3c tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-9d2eebe8-fae5-4c05-9754-af3b3a897264 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:37:30 devstack sudo[105520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-9d2eebe8-fae5-4c05-9754-af3b3a897264
Jul 30 20:37:30 devstack sudo[105520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:37:30 devstack sudo[105520]: pam_unix(sudo:session): session closed for user root
Jul 30 20:37:30 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-34d18e94-b5ce-47a0-a0db-565e819e4e3c tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-9d2eebe8-fae5-4c05-9754-af3b3a897264" returned: 0 in 0.246s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:37:30 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-34d18e94-b5ce-47a0-a0db-565e819e4e3c tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Lock "cinder-quobyte-9d2eebe8-fae5-4c05-9754-af3b3a897264" released by "delete_volume" :: held 0.657s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:37:30 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-34d18e94-b5ce-47a0-a0db-565e819e4e3c tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Created reservations ['95422d2d-2a47-4389-aeb6-0166d7014824', '6fe29096-a1f6-462b-ba69-b8f1bacba438', '00bbd4a2-0a1c-4e31-b380-9246a6d67da1', '5dd3ecba-f76e-4912-bce0-513facc3ac34'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:37:30 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-34d18e94-b5ce-47a0-a0db-565e819e4e3c tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:37:30 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-34d18e94-b5ce-47a0-a0db-565e819e4e3c tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:37:30 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-34d18e94-b5ce-47a0-a0db-565e819e4e3c tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:37:30 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-34d18e94-b5ce-47a0-a0db-565e819e4e3c tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:37:30 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-34d18e94-b5ce-47a0-a0db-565e819e4e3c tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:37:30 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-34d18e94-b5ce-47a0-a0db-565e819e4e3c tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:37:30 devstack sudo[105523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:37:30 devstack sudo[105523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:37:31 devstack sudo[105523]: pam_unix(sudo:session): session closed for user root
Jul 30 20:37:31 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-34d18e94-b5ce-47a0-a0db-565e819e4e3c tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.252s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:37:31 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-34d18e94-b5ce-47a0-a0db-565e819e4e3c tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:37:31 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-34d18e94-b5ce-47a0-a0db-565e819e4e3c tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Deleted volume successfully.
Jul 30 20:37:31 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-5f005bb4-8e2e-4ce4-aea6-f91bb87f0bbb tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Acquiring lock "cinder-541f00c5-33a4-47e7-b0b5-cb2c3fdde6a2-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:37:31 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-34d18e94-b5ce-47a0-a0db-565e819e4e3c tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Lock "cinder-9d2eebe8-fae5-4c05-9754-af3b3a897264-delete_volume" released by "delete_volume" :: held 1.164s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:37:31 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-5f005bb4-8e2e-4ce4-aea6-f91bb87f0bbb tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Lock "cinder-541f00c5-33a4-47e7-b0b5-cb2c3fdde6a2-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:37:31 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-5f005bb4-8e2e-4ce4-aea6-f91bb87f0bbb tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Acquiring lock "cinder-quobyte-541f00c5-33a4-47e7-b0b5-cb2c3fdde6a2" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:37:31 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-5f005bb4-8e2e-4ce4-aea6-f91bb87f0bbb tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Lock "cinder-quobyte-541f00c5-33a4-47e7-b0b5-cb2c3fdde6a2" acquired by "delete_volume" :: waited 0.014s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:37:31 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bbc459f-5f7c-4dc4-bda9-e3be416db402]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:37:31 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-5f005bb4-8e2e-4ce4-aea6-f91bb87f0bbb tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-541f00c5-33a4-47e7-b0b5-cb2c3fdde6a2 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:37:31 devstack sudo[105526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-541f00c5-33a4-47e7-b0b5-cb2c3fdde6a2
Jul 30 20:37:31 devstack sudo[105526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:37:31 devstack sudo[105526]: pam_unix(sudo:session): session closed for user root
Jul 30 20:37:31 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-5f005bb4-8e2e-4ce4-aea6-f91bb87f0bbb tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-541f00c5-33a4-47e7-b0b5-cb2c3fdde6a2" returned: 0 in 0.362s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:37:31 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-5f005bb4-8e2e-4ce4-aea6-f91bb87f0bbb tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-541f00c5-33a4-47e7-b0b5-cb2c3fdde6a2 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:37:31 devstack sudo[105531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-541f00c5-33a4-47e7-b0b5-cb2c3fdde6a2
Jul 30 20:37:31 devstack sudo[105531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:37:31 devstack sudo[105531]: pam_unix(sudo:session): session closed for user root
Jul 30 20:37:31 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-5f005bb4-8e2e-4ce4-aea6-f91bb87f0bbb tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-541f00c5-33a4-47e7-b0b5-cb2c3fdde6a2" returned: 0 in 0.241s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:37:31 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-5f005bb4-8e2e-4ce4-aea6-f91bb87f0bbb tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Lock "cinder-quobyte-541f00c5-33a4-47e7-b0b5-cb2c3fdde6a2" released by "delete_volume" :: held 0.646s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:37:31 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-5f005bb4-8e2e-4ce4-aea6-f91bb87f0bbb tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Created reservations ['249957b5-5ff2-41fc-b8bd-77951b932332', 'adca38c4-ca99-4d67-8d40-c7e6db09399c', '0bc48cbd-fd3e-4e6e-be8b-cad558f1294d', 'b99a9d43-96af-4419-9145-af96860c85a8'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:37:31 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-5f005bb4-8e2e-4ce4-aea6-f91bb87f0bbb tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:37:31 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-5f005bb4-8e2e-4ce4-aea6-f91bb87f0bbb tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:37:31 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-5f005bb4-8e2e-4ce4-aea6-f91bb87f0bbb tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:37:31 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-5f005bb4-8e2e-4ce4-aea6-f91bb87f0bbb tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:37:31 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-5f005bb4-8e2e-4ce4-aea6-f91bb87f0bbb tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:37:31 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-5f005bb4-8e2e-4ce4-aea6-f91bb87f0bbb tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:37:32 devstack sudo[105534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:37:32 devstack sudo[105534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:37:32 devstack sudo[105534]: pam_unix(sudo:session): session closed for user root
Jul 30 20:37:32 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-5f005bb4-8e2e-4ce4-aea6-f91bb87f0bbb tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.260s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:37:32 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-5f005bb4-8e2e-4ce4-aea6-f91bb87f0bbb tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:37:32 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-5f005bb4-8e2e-4ce4-aea6-f91bb87f0bbb tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Deleted volume successfully.
Jul 30 20:37:32 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-5f005bb4-8e2e-4ce4-aea6-f91bb87f0bbb tempest-CreateVolumesFromSourceVolumeTest-1051644290 None] Lock "cinder-541f00c5-33a4-47e7-b0b5-cb2c3fdde6a2-delete_volume" released by "delete_volume" :: held 1.092s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:37:35 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-646e8b99-d073-4d80-b97b-d1d86f080619 tempest-ProjectReaderTests-1952053541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:37:35 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-646e8b99-d073-4d80-b97b-d1d86f080619 tempest-ProjectReaderTests-1952053541 None] Flow 'volume_create_manager' (79be937c-89cc-4f34-bb37-bc0f918d7f57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:37:35 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-646e8b99-d073-4d80-b97b-d1d86f080619 tempest-ProjectReaderTests-1952053541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8566144e-f7c9-42e0-963f-63877e09eb53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:37:35 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-646e8b99-d073-4d80-b97b-d1d86f080619 tempest-ProjectReaderTests-1952053541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8566144e-f7c9-42e0-963f-63877e09eb53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:37:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-610764864',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03ea251d-71e2-4ab6-9a84-fb89d5924b7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03c0edfebe434fb2b263687e19cfe21e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:37:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:37:36Z,use_quota=True,user_id='eb8b6159e87b475f924feccd37616d32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:37:35 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-646e8b99-d073-4d80-b97b-d1d86f080619 tempest-ProjectReaderTests-1952053541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78962894-8d47-4b36-ad48-6c08361e8ac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:37:35 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-646e8b99-d073-4d80-b97b-d1d86f080619 tempest-ProjectReaderTests-1952053541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78962894-8d47-4b36-ad48-6c08361e8ac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:37:35 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-646e8b99-d073-4d80-b97b-d1d86f080619 tempest-ProjectReaderTests-1952053541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9407fd4f-c28d-41b1-bb7c-a2d666f2c065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:37:35 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-646e8b99-d073-4d80-b97b-d1d86f080619 tempest-ProjectReaderTests-1952053541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9407fd4f-c28d-41b1-bb7c-a2d666f2c065) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03ea251d-71e2-4ab6-9a84-fb89d5924b7d', 'volume_name': 'volume-03ea251d-71e2-4ab6-9a84-fb89d5924b7d', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:37:35 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-646e8b99-d073-4d80-b97b-d1d86f080619 tempest-ProjectReaderTests-1952053541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b577a3ce-ea18-4bbb-8a5a-e269490cd75a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:37:35 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-646e8b99-d073-4d80-b97b-d1d86f080619 tempest-ProjectReaderTests-1952053541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b577a3ce-ea18-4bbb-8a5a-e269490cd75a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:37:35 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-646e8b99-d073-4d80-b97b-d1d86f080619 tempest-ProjectReaderTests-1952053541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34fc4626-cbf6-4b80-bb46-4d02bf4d4fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:37:35 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-646e8b99-d073-4d80-b97b-d1d86f080619 tempest-ProjectReaderTests-1952053541 None] Volume 03ea251d-71e2-4ab6-9a84-fb89d5924b7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03ea251d-71e2-4ab6-9a84-fb89d5924b7d', 'volume_size': 1}
Jul 30 20:37:35 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-646e8b99-d073-4d80-b97b-d1d86f080619 tempest-ProjectReaderTests-1952053541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:37:35 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-646e8b99-d073-4d80-b97b-d1d86f080619 tempest-ProjectReaderTests-1952053541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:37:35 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-646e8b99-d073-4d80-b97b-d1d86f080619 tempest-ProjectReaderTests-1952053541 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:37:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-610764864',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03ea251d-71e2-4ab6-9a84-fb89d5924b7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03c0edfebe434fb2b263687e19cfe21e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:37:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:37:36Z,use_quota=True,user_id='eb8b6159e87b475f924feccd37616d32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:37:35 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-646e8b99-d073-4d80-b97b-d1d86f080619 tempest-ProjectReaderTests-1952053541 None] Creating volume 03ea251d-71e2-4ab6-9a84-fb89d5924b7d {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:37:35 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-646e8b99-d073-4d80-b97b-d1d86f080619 tempest-ProjectReaderTests-1952053541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:37:35 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-646e8b99-d073-4d80-b97b-d1d86f080619 tempest-ProjectReaderTests-1952053541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:37:35 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-646e8b99-d073-4d80-b97b-d1d86f080619 tempest-ProjectReaderTests-1952053541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:37:35 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-646e8b99-d073-4d80-b97b-d1d86f080619 tempest-ProjectReaderTests-1952053541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:37:35 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-646e8b99-d073-4d80-b97b-d1d86f080619 tempest-ProjectReaderTests-1952053541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:37:35 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-646e8b99-d073-4d80-b97b-d1d86f080619 tempest-ProjectReaderTests-1952053541 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:37:35 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-646e8b99-d073-4d80-b97b-d1d86f080619 tempest-ProjectReaderTests-1952053541 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:37:35 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-646e8b99-d073-4d80-b97b-d1d86f080619 tempest-ProjectReaderTests-1952053541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-03ea251d-71e2-4ab6-9a84-fb89d5924b7d 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:37:35 devstack sudo[105539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-03ea251d-71e2-4ab6-9a84-fb89d5924b7d 1073741824
Jul 30 20:37:35 devstack sudo[105539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:37:36 devstack sudo[105539]: pam_unix(sudo:session): session closed for user root
Jul 30 20:37:36 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-646e8b99-d073-4d80-b97b-d1d86f080619 tempest-ProjectReaderTests-1952053541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-03ea251d-71e2-4ab6-9a84-fb89d5924b7d 1073741824" returned: 0 in 0.423s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:37:36 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-646e8b99-d073-4d80-b97b-d1d86f080619 tempest-ProjectReaderTests-1952053541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-03ea251d-71e2-4ab6-9a84-fb89d5924b7d {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:37:36 devstack sudo[105545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-03ea251d-71e2-4ab6-9a84-fb89d5924b7d
Jul 30 20:37:36 devstack sudo[105545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:37:36 devstack sudo[105545]: pam_unix(sudo:session): session closed for user root
Jul 30 20:37:36 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-646e8b99-d073-4d80-b97b-d1d86f080619 tempest-ProjectReaderTests-1952053541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-03ea251d-71e2-4ab6-9a84-fb89d5924b7d" returned: 0 in 0.246s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:37:36 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-646e8b99-d073-4d80-b97b-d1d86f080619 tempest-ProjectReaderTests-1952053541 None] <== create_volume: return (710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:37:36 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-646e8b99-d073-4d80-b97b-d1d86f080619 tempest-ProjectReaderTests-1952053541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.713s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:37:36 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-646e8b99-d073-4d80-b97b-d1d86f080619 tempest-ProjectReaderTests-1952053541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34fc4626-cbf6-4b80-bb46-4d02bf4d4fb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03ea251d-71e2-4ab6-9a84-fb89d5924b7d', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:37:36 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-646e8b99-d073-4d80-b97b-d1d86f080619 tempest-ProjectReaderTests-1952053541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08362489-fe3d-45d5-bc46-5916c058f783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:37:36 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-646e8b99-d073-4d80-b97b-d1d86f080619 tempest-ProjectReaderTests-1952053541 None] Volume volume-03ea251d-71e2-4ab6-9a84-fb89d5924b7d (03ea251d-71e2-4ab6-9a84-fb89d5924b7d): created successfully
Jul 30 20:37:36 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-646e8b99-d073-4d80-b97b-d1d86f080619 tempest-ProjectReaderTests-1952053541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08362489-fe3d-45d5-bc46-5916c058f783) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:37:36 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-646e8b99-d073-4d80-b97b-d1d86f080619 tempest-ProjectReaderTests-1952053541 None] Flow 'volume_create_manager' (79be937c-89cc-4f34-bb37-bc0f918d7f57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:37:36 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-646e8b99-d073-4d80-b97b-d1d86f080619 tempest-ProjectReaderTests-1952053541 None] Created volume successfully.
Jul 30 20:37:36 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-4bae1637-b5b5-4276-bd2b-790fe9e25c27 tempest-ProjectReaderTests-1952053541 None] Acquiring lock "cinder-03ea251d-71e2-4ab6-9a84-fb89d5924b7d-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:37:36 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-4bae1637-b5b5-4276-bd2b-790fe9e25c27 tempest-ProjectReaderTests-1952053541 None] Lock "cinder-03ea251d-71e2-4ab6-9a84-fb89d5924b7d-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:37:37 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-4bae1637-b5b5-4276-bd2b-790fe9e25c27 tempest-ProjectReaderTests-1952053541 None] Acquiring lock "cinder-quobyte-03ea251d-71e2-4ab6-9a84-fb89d5924b7d" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:37:37 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-4bae1637-b5b5-4276-bd2b-790fe9e25c27 tempest-ProjectReaderTests-1952053541 None] Lock "cinder-quobyte-03ea251d-71e2-4ab6-9a84-fb89d5924b7d" acquired by "delete_volume" :: waited 0.016s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:37:37 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6d0c81b-798c-467f-86a8-5ffeb2d77df6]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:37:37 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-4bae1637-b5b5-4276-bd2b-790fe9e25c27 tempest-ProjectReaderTests-1952053541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-03ea251d-71e2-4ab6-9a84-fb89d5924b7d {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:37:37 devstack sudo[105548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-03ea251d-71e2-4ab6-9a84-fb89d5924b7d
Jul 30 20:37:37 devstack sudo[105548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:37:37 devstack sudo[105548]: pam_unix(sudo:session): session closed for user root
Jul 30 20:37:37 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-4bae1637-b5b5-4276-bd2b-790fe9e25c27 tempest-ProjectReaderTests-1952053541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-03ea251d-71e2-4ab6-9a84-fb89d5924b7d" returned: 0 in 0.386s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:37:37 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-4bae1637-b5b5-4276-bd2b-790fe9e25c27 tempest-ProjectReaderTests-1952053541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-03ea251d-71e2-4ab6-9a84-fb89d5924b7d {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:37:37 devstack sudo[105554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-03ea251d-71e2-4ab6-9a84-fb89d5924b7d
Jul 30 20:37:37 devstack sudo[105554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:37:37 devstack sudo[105554]: pam_unix(sudo:session): session closed for user root
Jul 30 20:37:37 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-4bae1637-b5b5-4276-bd2b-790fe9e25c27 tempest-ProjectReaderTests-1952053541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-03ea251d-71e2-4ab6-9a84-fb89d5924b7d" returned: 0 in 0.259s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:37:37 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-4bae1637-b5b5-4276-bd2b-790fe9e25c27 tempest-ProjectReaderTests-1952053541 None] Lock "cinder-quobyte-03ea251d-71e2-4ab6-9a84-fb89d5924b7d" released by "delete_volume" :: held 0.695s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:37:37 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-4bae1637-b5b5-4276-bd2b-790fe9e25c27 tempest-ProjectReaderTests-1952053541 None] Created reservations ['6603804e-5c31-44ff-8be2-a650fcff419f', '7c56e4fe-62cb-4ded-acbc-9e531a128fc2', '1ece6a90-fdb8-4415-b1d7-616b06592829', '142c40a9-a6bb-4174-a6e8-60ccac3ae36d'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:37:37 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-4bae1637-b5b5-4276-bd2b-790fe9e25c27 tempest-ProjectReaderTests-1952053541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:37:37 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-4bae1637-b5b5-4276-bd2b-790fe9e25c27 tempest-ProjectReaderTests-1952053541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:37:37 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-4bae1637-b5b5-4276-bd2b-790fe9e25c27 tempest-ProjectReaderTests-1952053541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:37:37 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-4bae1637-b5b5-4276-bd2b-790fe9e25c27 tempest-ProjectReaderTests-1952053541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:37:37 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-4bae1637-b5b5-4276-bd2b-790fe9e25c27 tempest-ProjectReaderTests-1952053541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:37:37 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-4bae1637-b5b5-4276-bd2b-790fe9e25c27 tempest-ProjectReaderTests-1952053541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:37:37 devstack sudo[105559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:37:37 devstack sudo[105559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:37:38 devstack sudo[105559]: pam_unix(sudo:session): session closed for user root
Jul 30 20:37:38 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-4bae1637-b5b5-4276-bd2b-790fe9e25c27 tempest-ProjectReaderTests-1952053541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.281s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:37:38 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-4bae1637-b5b5-4276-bd2b-790fe9e25c27 tempest-ProjectReaderTests-1952053541 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:37:38 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-4bae1637-b5b5-4276-bd2b-790fe9e25c27 tempest-ProjectReaderTests-1952053541 None] Deleted volume successfully.
Jul 30 20:37:38 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-4bae1637-b5b5-4276-bd2b-790fe9e25c27 tempest-ProjectReaderTests-1952053541 None] Lock "cinder-03ea251d-71e2-4ab6-9a84-fb89d5924b7d-delete_volume" released by "delete_volume" :: held 1.230s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:37:38 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d08b94b-4ba8-4762-a34d-13afd88036bf tempest-ProjectReaderTests-1952053541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:37:38 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-8d08b94b-4ba8-4762-a34d-13afd88036bf tempest-ProjectReaderTests-1952053541 None] Flow 'volume_create_manager' (44c44769-cf28-4ff7-81e9-37ea8aaa71bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:37:38 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-8d08b94b-4ba8-4762-a34d-13afd88036bf tempest-ProjectReaderTests-1952053541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (796b7900-0dd5-4646-b0c5-a419a0653f9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:37:38 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-8d08b94b-4ba8-4762-a34d-13afd88036bf tempest-ProjectReaderTests-1952053541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (796b7900-0dd5-4646-b0c5-a419a0653f9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:37:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-716834814',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2222a137-5de0-4acd-b3bf-11b41fd450ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03c0edfebe434fb2b263687e19cfe21e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:37:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:37:39Z,use_quota=True,user_id='eb8b6159e87b475f924feccd37616d32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:37:38 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-8d08b94b-4ba8-4762-a34d-13afd88036bf tempest-ProjectReaderTests-1952053541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ba05ff2-21a2-41f0-b9a9-cfd6df53b02a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:37:38 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-8d08b94b-4ba8-4762-a34d-13afd88036bf tempest-ProjectReaderTests-1952053541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ba05ff2-21a2-41f0-b9a9-cfd6df53b02a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:37:38 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-8d08b94b-4ba8-4762-a34d-13afd88036bf tempest-ProjectReaderTests-1952053541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c4849a1-341d-4cba-b396-cb472768d264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:37:38 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-8d08b94b-4ba8-4762-a34d-13afd88036bf tempest-ProjectReaderTests-1952053541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c4849a1-341d-4cba-b396-cb472768d264) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2222a137-5de0-4acd-b3bf-11b41fd450ec', 'volume_name': 'volume-2222a137-5de0-4acd-b3bf-11b41fd450ec', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:37:38 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-8d08b94b-4ba8-4762-a34d-13afd88036bf tempest-ProjectReaderTests-1952053541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36d14bbc-bfd7-4708-815b-4b51351669f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:37:38 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-8d08b94b-4ba8-4762-a34d-13afd88036bf tempest-ProjectReaderTests-1952053541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36d14bbc-bfd7-4708-815b-4b51351669f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:37:38 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-8d08b94b-4ba8-4762-a34d-13afd88036bf tempest-ProjectReaderTests-1952053541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb499b87-f645-44fa-98eb-7cabcaa1961e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:37:38 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-8d08b94b-4ba8-4762-a34d-13afd88036bf tempest-ProjectReaderTests-1952053541 None] Volume 2222a137-5de0-4acd-b3bf-11b41fd450ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2222a137-5de0-4acd-b3bf-11b41fd450ec', 'volume_size': 1}
Jul 30 20:37:38 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-8d08b94b-4ba8-4762-a34d-13afd88036bf tempest-ProjectReaderTests-1952053541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:37:38 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-8d08b94b-4ba8-4762-a34d-13afd88036bf tempest-ProjectReaderTests-1952053541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:37:38 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-8d08b94b-4ba8-4762-a34d-13afd88036bf tempest-ProjectReaderTests-1952053541 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:37:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-716834814',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2222a137-5de0-4acd-b3bf-11b41fd450ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03c0edfebe434fb2b263687e19cfe21e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:37:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:37:39Z,use_quota=True,user_id='eb8b6159e87b475f924feccd37616d32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:37:38 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-8d08b94b-4ba8-4762-a34d-13afd88036bf tempest-ProjectReaderTests-1952053541 None] Creating volume 2222a137-5de0-4acd-b3bf-11b41fd450ec {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:37:38 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-8d08b94b-4ba8-4762-a34d-13afd88036bf tempest-ProjectReaderTests-1952053541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:37:38 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-8d08b94b-4ba8-4762-a34d-13afd88036bf tempest-ProjectReaderTests-1952053541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:37:38 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-8d08b94b-4ba8-4762-a34d-13afd88036bf tempest-ProjectReaderTests-1952053541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:37:38 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-8d08b94b-4ba8-4762-a34d-13afd88036bf tempest-ProjectReaderTests-1952053541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:37:38 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-8d08b94b-4ba8-4762-a34d-13afd88036bf tempest-ProjectReaderTests-1952053541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:37:38 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-8d08b94b-4ba8-4762-a34d-13afd88036bf tempest-ProjectReaderTests-1952053541 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:37:38 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-8d08b94b-4ba8-4762-a34d-13afd88036bf tempest-ProjectReaderTests-1952053541 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:37:38 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8d08b94b-4ba8-4762-a34d-13afd88036bf tempest-ProjectReaderTests-1952053541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2222a137-5de0-4acd-b3bf-11b41fd450ec 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:37:38 devstack sudo[105562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2222a137-5de0-4acd-b3bf-11b41fd450ec 1073741824
Jul 30 20:37:38 devstack sudo[105562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:37:39 devstack sudo[105562]: pam_unix(sudo:session): session closed for user root
Jul 30 20:37:39 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8d08b94b-4ba8-4762-a34d-13afd88036bf tempest-ProjectReaderTests-1952053541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2222a137-5de0-4acd-b3bf-11b41fd450ec 1073741824" returned: 0 in 0.481s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:37:39 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8d08b94b-4ba8-4762-a34d-13afd88036bf tempest-ProjectReaderTests-1952053541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2222a137-5de0-4acd-b3bf-11b41fd450ec {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:37:39 devstack sudo[105571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2222a137-5de0-4acd-b3bf-11b41fd450ec
Jul 30 20:37:39 devstack sudo[105571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:37:39 devstack sudo[105571]: pam_unix(sudo:session): session closed for user root
Jul 30 20:37:39 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8d08b94b-4ba8-4762-a34d-13afd88036bf tempest-ProjectReaderTests-1952053541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2222a137-5de0-4acd-b3bf-11b41fd450ec" returned: 0 in 0.254s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:37:39 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-8d08b94b-4ba8-4762-a34d-13afd88036bf tempest-ProjectReaderTests-1952053541 None] <== create_volume: return (784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:37:39 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-8d08b94b-4ba8-4762-a34d-13afd88036bf tempest-ProjectReaderTests-1952053541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.787s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:37:39 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-8d08b94b-4ba8-4762-a34d-13afd88036bf tempest-ProjectReaderTests-1952053541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb499b87-f645-44fa-98eb-7cabcaa1961e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2222a137-5de0-4acd-b3bf-11b41fd450ec', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:37:39 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-8d08b94b-4ba8-4762-a34d-13afd88036bf tempest-ProjectReaderTests-1952053541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50a10bae-dea9-4059-a193-9e4ee41234df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:37:39 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-8d08b94b-4ba8-4762-a34d-13afd88036bf tempest-ProjectReaderTests-1952053541 None] Volume volume-2222a137-5de0-4acd-b3bf-11b41fd450ec (2222a137-5de0-4acd-b3bf-11b41fd450ec): created successfully
Jul 30 20:37:39 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-8d08b94b-4ba8-4762-a34d-13afd88036bf tempest-ProjectReaderTests-1952053541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50a10bae-dea9-4059-a193-9e4ee41234df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:37:39 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-8d08b94b-4ba8-4762-a34d-13afd88036bf tempest-ProjectReaderTests-1952053541 None] Flow 'volume_create_manager' (44c44769-cf28-4ff7-81e9-37ea8aaa71bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:37:39 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-8d08b94b-4ba8-4762-a34d-13afd88036bf tempest-ProjectReaderTests-1952053541 None] Created volume successfully.
Jul 30 20:37:40 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-c1ccbf29-e085-4df4-8ac8-ffc37bbd485b tempest-ProjectReaderTests-1952053541 None] Acquiring lock "cinder-2222a137-5de0-4acd-b3bf-11b41fd450ec-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:37:40 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-c1ccbf29-e085-4df4-8ac8-ffc37bbd485b tempest-ProjectReaderTests-1952053541 None] Lock "cinder-2222a137-5de0-4acd-b3bf-11b41fd450ec-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:37:40 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-c1ccbf29-e085-4df4-8ac8-ffc37bbd485b tempest-ProjectReaderTests-1952053541 None] Acquiring lock "cinder-quobyte-2222a137-5de0-4acd-b3bf-11b41fd450ec" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:37:40 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-c1ccbf29-e085-4df4-8ac8-ffc37bbd485b tempest-ProjectReaderTests-1952053541 None] Lock "cinder-quobyte-2222a137-5de0-4acd-b3bf-11b41fd450ec" acquired by "delete_volume" :: waited 0.014s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:37:40 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[b68cdeea-15ae-45bb-a81f-640f9bd6db86]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:37:40 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-c1ccbf29-e085-4df4-8ac8-ffc37bbd485b tempest-ProjectReaderTests-1952053541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2222a137-5de0-4acd-b3bf-11b41fd450ec {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:37:40 devstack sudo[105574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2222a137-5de0-4acd-b3bf-11b41fd450ec
Jul 30 20:37:40 devstack sudo[105574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:37:41 devstack sudo[105574]: pam_unix(sudo:session): session closed for user root
Jul 30 20:37:41 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-c1ccbf29-e085-4df4-8ac8-ffc37bbd485b tempest-ProjectReaderTests-1952053541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2222a137-5de0-4acd-b3bf-11b41fd450ec" returned: 0 in 0.362s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:37:41 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-c1ccbf29-e085-4df4-8ac8-ffc37bbd485b tempest-ProjectReaderTests-1952053541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2222a137-5de0-4acd-b3bf-11b41fd450ec {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:37:41 devstack sudo[105579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2222a137-5de0-4acd-b3bf-11b41fd450ec
Jul 30 20:37:41 devstack sudo[105579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:37:41 devstack sudo[105579]: pam_unix(sudo:session): session closed for user root
Jul 30 20:37:41 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-c1ccbf29-e085-4df4-8ac8-ffc37bbd485b tempest-ProjectReaderTests-1952053541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2222a137-5de0-4acd-b3bf-11b41fd450ec" returned: 0 in 0.259s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:37:41 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-c1ccbf29-e085-4df4-8ac8-ffc37bbd485b tempest-ProjectReaderTests-1952053541 None] Lock "cinder-quobyte-2222a137-5de0-4acd-b3bf-11b41fd450ec" released by "delete_volume" :: held 0.662s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:37:41 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-c1ccbf29-e085-4df4-8ac8-ffc37bbd485b tempest-ProjectReaderTests-1952053541 None] Created reservations ['73bea360-209a-459c-a848-e6f11ebdc0e2', 'b21e7512-24e7-4fb1-8308-5aab37cfc265', '88cdf1b4-c717-4c78-8bae-ea34ca18825f', 'fc25d672-f7ba-4283-8c02-6e51e116d3ae'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:37:41 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-c1ccbf29-e085-4df4-8ac8-ffc37bbd485b tempest-ProjectReaderTests-1952053541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:37:41 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-c1ccbf29-e085-4df4-8ac8-ffc37bbd485b tempest-ProjectReaderTests-1952053541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:37:41 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-c1ccbf29-e085-4df4-8ac8-ffc37bbd485b tempest-ProjectReaderTests-1952053541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:37:41 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-c1ccbf29-e085-4df4-8ac8-ffc37bbd485b tempest-ProjectReaderTests-1952053541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:37:41 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-c1ccbf29-e085-4df4-8ac8-ffc37bbd485b tempest-ProjectReaderTests-1952053541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:37:41 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-c1ccbf29-e085-4df4-8ac8-ffc37bbd485b tempest-ProjectReaderTests-1952053541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:37:41 devstack sudo[105586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:37:41 devstack sudo[105586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:37:41 devstack sudo[105586]: pam_unix(sudo:session): session closed for user root
Jul 30 20:37:41 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-c1ccbf29-e085-4df4-8ac8-ffc37bbd485b tempest-ProjectReaderTests-1952053541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.275s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:37:41 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-c1ccbf29-e085-4df4-8ac8-ffc37bbd485b tempest-ProjectReaderTests-1952053541 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:37:41 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-c1ccbf29-e085-4df4-8ac8-ffc37bbd485b tempest-ProjectReaderTests-1952053541 None] Deleted volume successfully.
Jul 30 20:37:41 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-c1ccbf29-e085-4df4-8ac8-ffc37bbd485b tempest-ProjectReaderTests-1952053541 None] Lock "cinder-2222a137-5de0-4acd-b3bf-11b41fd450ec-delete_volume" released by "delete_volume" :: held 1.140s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:37:42 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [req-4336736e-bbc6-46ed-9067-8578129bf9ec req-b7d70ecd-0410-4936-906d-0d26002911f7 tempest-TestInstancesWithCinderVolumes-554188937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:37:42 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [req-4336736e-bbc6-46ed-9067-8578129bf9ec req-b7d70ecd-0410-4936-906d-0d26002911f7 tempest-TestInstancesWithCinderVolumes-554188937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:37:42 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [req-4336736e-bbc6-46ed-9067-8578129bf9ec req-b7d70ecd-0410-4936-906d-0d26002911f7 tempest-TestInstancesWithCinderVolumes-554188937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:37:42 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [req-4336736e-bbc6-46ed-9067-8578129bf9ec req-b7d70ecd-0410-4936-906d-0d26002911f7 tempest-TestInstancesWithCinderVolumes-554188937 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5', 'name': 'volume-356bddb1-ac5b-4d88-8054-778bf75be628', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '05beae7f-534f-45d8-9564-eb4c1efbfd5e', 'enforce_multipath': True} {{(pid=88719) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 30 20:37:42 devstack cinder-volume[88719]: INFO cinder.volume.manager [req-4336736e-bbc6-46ed-9067-8578129bf9ec req-b7d70ecd-0410-4936-906d-0d26002911f7 tempest-TestInstancesWithCinderVolumes-554188937 None] attachment_update completed successfully.
Jul 30 20:37:45 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [req-aadd110d-eb2a-4d41-8d9e-a11d267a35fc req-5be17ab6-e00f-480a-b686-dc58c2c0b222 tempest-TestInstancesWithCinderVolumes-554188937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:37:45 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [req-aadd110d-eb2a-4d41-8d9e-a11d267a35fc req-5be17ab6-e00f-480a-b686-dc58c2c0b222 tempest-TestInstancesWithCinderVolumes-554188937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:37:45 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [req-aadd110d-eb2a-4d41-8d9e-a11d267a35fc req-5be17ab6-e00f-480a-b686-dc58c2c0b222 tempest-TestInstancesWithCinderVolumes-554188937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:37:45 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [req-aadd110d-eb2a-4d41-8d9e-a11d267a35fc req-5be17ab6-e00f-480a-b686-dc58c2c0b222 tempest-TestInstancesWithCinderVolumes-554188937 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5', 'name': 'volume-53c10edc-e1da-4367-a6f3-2d22d90764d6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7dbc6df7-c4e0-4202-812e-065ed0647d30', 'enforce_multipath': True} {{(pid=88719) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 30 20:37:45 devstack cinder-volume[88719]: INFO cinder.volume.manager [req-aadd110d-eb2a-4d41-8d9e-a11d267a35fc req-5be17ab6-e00f-480a-b686-dc58c2c0b222 tempest-TestInstancesWithCinderVolumes-554188937 None] attachment_update completed successfully.
Jul 30 20:37:51 devstack cinder-volume[88719]: INFO cinder.volume.manager [req-0bf68619-bde7-4d84-a617-435751beea5f req-e6f8067f-9e7e-4b46-b3c2-f177cdf07ed3 tempest-TestInstancesWithCinderVolumes-554188937 None] Terminate volume connection completed successfully.
Jul 30 20:37:51 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [req-0bf68619-bde7-4d84-a617-435751beea5f req-e6f8067f-9e7e-4b46-b3c2-f177cdf07ed3 tempest-TestInstancesWithCinderVolumes-554188937 None] Deleting attachment 05beae7f-534f-45d8-9564-eb4c1efbfd5e. {{(pid=88719) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 30 20:37:51 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-7f3258f4-5c7a-4fb9-a593-56fd9584bec2 tempest-TestInstancesWithCinderVolumes-554188937 None] Acquiring lock "cinder-356bddb1-ac5b-4d88-8054-778bf75be628-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:37:51 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-7f3258f4-5c7a-4fb9-a593-56fd9584bec2 tempest-TestInstancesWithCinderVolumes-554188937 None] Lock "cinder-356bddb1-ac5b-4d88-8054-778bf75be628-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:37:51 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-7f3258f4-5c7a-4fb9-a593-56fd9584bec2 tempest-TestInstancesWithCinderVolumes-554188937 None] Acquiring lock "cinder-quobyte-356bddb1-ac5b-4d88-8054-778bf75be628" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:37:51 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-7f3258f4-5c7a-4fb9-a593-56fd9584bec2 tempest-TestInstancesWithCinderVolumes-554188937 None] Lock "cinder-quobyte-356bddb1-ac5b-4d88-8054-778bf75be628" acquired by "delete_volume" :: waited 0.027s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:37:51 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[833ce88b-40d2-4974-9dc6-bf93fcd4e1de]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:37:51 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-7f3258f4-5c7a-4fb9-a593-56fd9584bec2 tempest-TestInstancesWithCinderVolumes-554188937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-356bddb1-ac5b-4d88-8054-778bf75be628 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:37:52 devstack sudo[105699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-356bddb1-ac5b-4d88-8054-778bf75be628
Jul 30 20:37:52 devstack sudo[105699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:37:52 devstack sudo[105699]: pam_unix(sudo:session): session closed for user root
Jul 30 20:37:52 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-7f3258f4-5c7a-4fb9-a593-56fd9584bec2 tempest-TestInstancesWithCinderVolumes-554188937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-356bddb1-ac5b-4d88-8054-778bf75be628" returned: 0 in 0.529s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:37:52 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-7f3258f4-5c7a-4fb9-a593-56fd9584bec2 tempest-TestInstancesWithCinderVolumes-554188937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-356bddb1-ac5b-4d88-8054-778bf75be628 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:37:52 devstack sudo[105705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-356bddb1-ac5b-4d88-8054-778bf75be628
Jul 30 20:37:52 devstack sudo[105705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:37:52 devstack sudo[105705]: pam_unix(sudo:session): session closed for user root
Jul 30 20:37:52 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-7f3258f4-5c7a-4fb9-a593-56fd9584bec2 tempest-TestInstancesWithCinderVolumes-554188937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-356bddb1-ac5b-4d88-8054-778bf75be628" returned: 0 in 0.404s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:37:52 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-7f3258f4-5c7a-4fb9-a593-56fd9584bec2 tempest-TestInstancesWithCinderVolumes-554188937 None] Lock "cinder-quobyte-356bddb1-ac5b-4d88-8054-778bf75be628" released by "delete_volume" :: held 0.988s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:37:52 devstack cinder-volume[88719]: WARNING cinder.quota [None req-7f3258f4-5c7a-4fb9-a593-56fd9584bec2 tempest-TestInstancesWithCinderVolumes-554188937 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1203014471-823211780 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1203014471-823211780, it is now deprecated. Please use the default quota class for default quota.
Jul 30 20:37:52 devstack cinder-volume[88719]: WARNING cinder.quota [None req-7f3258f4-5c7a-4fb9-a593-56fd9584bec2 tempest-TestInstancesWithCinderVolumes-554188937 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1203014471-823211780 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1203014471-823211780, it is now deprecated. Please use the default quota class for default quota.
Jul 30 20:37:53 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-7f3258f4-5c7a-4fb9-a593-56fd9584bec2 tempest-TestInstancesWithCinderVolumes-554188937 None] Created reservations ['b186270c-1b26-41c2-aa7b-874ba069dad0', 'b6e8b312-5d8c-4dc9-9e9b-7fc0fd9287e7', 'ab6877d5-a94e-4aa7-9cc5-e144c4baa319', '9ac1c54d-1b74-487c-bc5c-07144af6fa11'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:37:53 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-7f3258f4-5c7a-4fb9-a593-56fd9584bec2 tempest-TestInstancesWithCinderVolumes-554188937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:37:53 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-7f3258f4-5c7a-4fb9-a593-56fd9584bec2 tempest-TestInstancesWithCinderVolumes-554188937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:37:53 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-7f3258f4-5c7a-4fb9-a593-56fd9584bec2 tempest-TestInstancesWithCinderVolumes-554188937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:37:53 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-7f3258f4-5c7a-4fb9-a593-56fd9584bec2 tempest-TestInstancesWithCinderVolumes-554188937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:37:53 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-7f3258f4-5c7a-4fb9-a593-56fd9584bec2 tempest-TestInstancesWithCinderVolumes-554188937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:37:53 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-7f3258f4-5c7a-4fb9-a593-56fd9584bec2 tempest-TestInstancesWithCinderVolumes-554188937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:37:53 devstack sudo[105709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:37:53 devstack sudo[105709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:37:53 devstack cinder-volume[88719]: INFO cinder.volume.manager [req-98a9f3cb-e341-4507-87f7-81ea70d4b6b4 req-05f027db-1d9a-417b-8069-1b8d43d8bd60 tempest-TestShelveInstance-274392155 None] Terminate volume connection completed successfully.
Jul 30 20:37:53 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [req-98a9f3cb-e341-4507-87f7-81ea70d4b6b4 req-05f027db-1d9a-417b-8069-1b8d43d8bd60 tempest-TestShelveInstance-274392155 None] Deleting attachment 8d33d7ea-ef7b-4637-a902-1b2d1eb2cc64. {{(pid=88719) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 30 20:37:53 devstack sudo[105709]: pam_unix(sudo:session): session closed for user root
Jul 30 20:37:53 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-7f3258f4-5c7a-4fb9-a593-56fd9584bec2 tempest-TestInstancesWithCinderVolumes-554188937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.408s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:37:53 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-7f3258f4-5c7a-4fb9-a593-56fd9584bec2 tempest-TestInstancesWithCinderVolumes-554188937 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:37:53 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-7f3258f4-5c7a-4fb9-a593-56fd9584bec2 tempest-TestInstancesWithCinderVolumes-554188937 None] Deleted volume successfully.
Jul 30 20:37:53 devstack cinder-volume[88719]: DEBUG cinder.coordination [req-98a9f3cb-e341-4507-87f7-81ea70d4b6b4 req-92136af9-42e8-47ef-a261-a909b34ca8bb tempest-TestShelveInstance-274392155 None] Acquiring lock "cinder-4671154d-1d6a-4b5d-a064-aebe543423a0-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:37:53 devstack cinder-volume[88719]: DEBUG cinder.coordination [req-98a9f3cb-e341-4507-87f7-81ea70d4b6b4 req-92136af9-42e8-47ef-a261-a909b34ca8bb tempest-TestShelveInstance-274392155 None] Lock "cinder-4671154d-1d6a-4b5d-a064-aebe543423a0-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:37:53 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-7f3258f4-5c7a-4fb9-a593-56fd9584bec2 tempest-TestInstancesWithCinderVolumes-554188937 None] Lock "cinder-356bddb1-ac5b-4d88-8054-778bf75be628-delete_volume" released by "delete_volume" :: held 1.799s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:37:53 devstack cinder-volume[88719]: DEBUG cinder.coordination [req-98a9f3cb-e341-4507-87f7-81ea70d4b6b4 req-92136af9-42e8-47ef-a261-a909b34ca8bb tempest-TestShelveInstance-274392155 None] Acquiring lock "cinder-quobyte-4671154d-1d6a-4b5d-a064-aebe543423a0" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:37:53 devstack cinder-volume[88719]: DEBUG cinder.coordination [req-98a9f3cb-e341-4507-87f7-81ea70d4b6b4 req-92136af9-42e8-47ef-a261-a909b34ca8bb tempest-TestShelveInstance-274392155 None] Lock "cinder-quobyte-4671154d-1d6a-4b5d-a064-aebe543423a0" acquired by "delete_volume" :: waited 0.025s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:37:53 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[8be40ce1-8477-4554-aff3-eb9253862fdb]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:37:53 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [req-98a9f3cb-e341-4507-87f7-81ea70d4b6b4 req-92136af9-42e8-47ef-a261-a909b34ca8bb tempest-TestShelveInstance-274392155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-4671154d-1d6a-4b5d-a064-aebe543423a0 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:37:53 devstack sudo[105712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-4671154d-1d6a-4b5d-a064-aebe543423a0
Jul 30 20:37:53 devstack sudo[105712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:37:54 devstack sudo[105712]: pam_unix(sudo:session): session closed for user root
Jul 30 20:37:54 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [req-98a9f3cb-e341-4507-87f7-81ea70d4b6b4 req-92136af9-42e8-47ef-a261-a909b34ca8bb tempest-TestShelveInstance-274392155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-4671154d-1d6a-4b5d-a064-aebe543423a0" returned: 0 in 0.731s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:37:54 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [req-98a9f3cb-e341-4507-87f7-81ea70d4b6b4 req-92136af9-42e8-47ef-a261-a909b34ca8bb tempest-TestShelveInstance-274392155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-4671154d-1d6a-4b5d-a064-aebe543423a0 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:37:54 devstack sudo[105717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-4671154d-1d6a-4b5d-a064-aebe543423a0
Jul 30 20:37:54 devstack sudo[105717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:37:54 devstack sudo[105717]: pam_unix(sudo:session): session closed for user root
Jul 30 20:37:54 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [req-98a9f3cb-e341-4507-87f7-81ea70d4b6b4 req-92136af9-42e8-47ef-a261-a909b34ca8bb tempest-TestShelveInstance-274392155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-4671154d-1d6a-4b5d-a064-aebe543423a0" returned: 0 in 0.415s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:37:54 devstack cinder-volume[88719]: DEBUG cinder.coordination [req-98a9f3cb-e341-4507-87f7-81ea70d4b6b4 req-92136af9-42e8-47ef-a261-a909b34ca8bb tempest-TestShelveInstance-274392155 None] Lock "cinder-quobyte-4671154d-1d6a-4b5d-a064-aebe543423a0" released by "delete_volume" :: held 1.206s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:37:54 devstack cinder-volume[88719]: DEBUG cinder.quota [req-98a9f3cb-e341-4507-87f7-81ea70d4b6b4 req-92136af9-42e8-47ef-a261-a909b34ca8bb tempest-TestShelveInstance-274392155 None] Created reservations ['30a5bbc6-4548-4ce2-bada-020f4180e540', '4c9b627d-626b-4bf9-8792-238522ebe37a', '8fbc0106-8d20-456c-9453-8b6f7fda2cfc', 'a47b2a02-f63f-46d2-af6e-14beaf98c0b0'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:37:55 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [req-98a9f3cb-e341-4507-87f7-81ea70d4b6b4 req-92136af9-42e8-47ef-a261-a909b34ca8bb tempest-TestShelveInstance-274392155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:37:55 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [req-98a9f3cb-e341-4507-87f7-81ea70d4b6b4 req-92136af9-42e8-47ef-a261-a909b34ca8bb tempest-TestShelveInstance-274392155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:37:55 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [req-98a9f3cb-e341-4507-87f7-81ea70d4b6b4 req-92136af9-42e8-47ef-a261-a909b34ca8bb tempest-TestShelveInstance-274392155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:37:55 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [req-98a9f3cb-e341-4507-87f7-81ea70d4b6b4 req-92136af9-42e8-47ef-a261-a909b34ca8bb tempest-TestShelveInstance-274392155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:37:55 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [req-98a9f3cb-e341-4507-87f7-81ea70d4b6b4 req-92136af9-42e8-47ef-a261-a909b34ca8bb tempest-TestShelveInstance-274392155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:37:55 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [req-98a9f3cb-e341-4507-87f7-81ea70d4b6b4 req-92136af9-42e8-47ef-a261-a909b34ca8bb tempest-TestShelveInstance-274392155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:37:55 devstack sudo[105727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:37:55 devstack sudo[105727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:37:55 devstack sudo[105727]: pam_unix(sudo:session): session closed for user root
Jul 30 20:37:55 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [req-98a9f3cb-e341-4507-87f7-81ea70d4b6b4 req-92136af9-42e8-47ef-a261-a909b34ca8bb tempest-TestShelveInstance-274392155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.297s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:37:55 devstack cinder-volume[88719]: DEBUG cinder.manager [req-98a9f3cb-e341-4507-87f7-81ea70d4b6b4 req-92136af9-42e8-47ef-a261-a909b34ca8bb tempest-TestShelveInstance-274392155 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:37:55 devstack cinder-volume[88719]: INFO cinder.volume.manager [req-98a9f3cb-e341-4507-87f7-81ea70d4b6b4 req-92136af9-42e8-47ef-a261-a909b34ca8bb tempest-TestShelveInstance-274392155 None] Deleted volume successfully.
Jul 30 20:37:55 devstack cinder-volume[88719]: DEBUG cinder.coordination [req-98a9f3cb-e341-4507-87f7-81ea70d4b6b4 req-92136af9-42e8-47ef-a261-a909b34ca8bb tempest-TestShelveInstance-274392155 None] Lock "cinder-4671154d-1d6a-4b5d-a064-aebe543423a0-delete_volume" released by "delete_volume" :: held 1.765s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:37:57 devstack cinder-volume[88719]: INFO cinder.volume.manager [req-199afb26-730e-40c2-80eb-7f30be413ccf req-7192c93d-5594-4e98-94d8-8be138168a73 tempest-TestInstancesWithCinderVolumes-554188937 None] Terminate volume connection completed successfully.
Jul 30 20:37:57 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [req-199afb26-730e-40c2-80eb-7f30be413ccf req-7192c93d-5594-4e98-94d8-8be138168a73 tempest-TestInstancesWithCinderVolumes-554188937 None] Deleting attachment 7dbc6df7-c4e0-4202-812e-065ed0647d30. {{(pid=88719) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 30 20:37:57 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-56e4f28e-bfe5-4619-96c6-caf981e658ce tempest-TestInstancesWithCinderVolumes-554188937 None] Acquiring lock "cinder-53c10edc-e1da-4367-a6f3-2d22d90764d6-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:37:57 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-56e4f28e-bfe5-4619-96c6-caf981e658ce tempest-TestInstancesWithCinderVolumes-554188937 None] Lock "cinder-53c10edc-e1da-4367-a6f3-2d22d90764d6-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:37:57 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-56e4f28e-bfe5-4619-96c6-caf981e658ce tempest-TestInstancesWithCinderVolumes-554188937 None] Acquiring lock "cinder-quobyte-53c10edc-e1da-4367-a6f3-2d22d90764d6" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:37:57 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-56e4f28e-bfe5-4619-96c6-caf981e658ce tempest-TestInstancesWithCinderVolumes-554188937 None] Lock "cinder-quobyte-53c10edc-e1da-4367-a6f3-2d22d90764d6" acquired by "delete_volume" :: waited 0.025s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:37:57 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[60673a9c-b69d-4a0c-a33b-56da92da2e22]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:37:57 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-56e4f28e-bfe5-4619-96c6-caf981e658ce tempest-TestInstancesWithCinderVolumes-554188937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-53c10edc-e1da-4367-a6f3-2d22d90764d6 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:37:57 devstack sudo[105750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-53c10edc-e1da-4367-a6f3-2d22d90764d6
Jul 30 20:37:57 devstack sudo[105750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:37:58 devstack sudo[105750]: pam_unix(sudo:session): session closed for user root
Jul 30 20:37:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-56e4f28e-bfe5-4619-96c6-caf981e658ce tempest-TestInstancesWithCinderVolumes-554188937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-53c10edc-e1da-4367-a6f3-2d22d90764d6" returned: 0 in 0.486s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:37:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-56e4f28e-bfe5-4619-96c6-caf981e658ce tempest-TestInstancesWithCinderVolumes-554188937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-53c10edc-e1da-4367-a6f3-2d22d90764d6 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:37:58 devstack sudo[105756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-53c10edc-e1da-4367-a6f3-2d22d90764d6
Jul 30 20:37:58 devstack sudo[105756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:37:58 devstack sudo[105756]: pam_unix(sudo:session): session closed for user root
Jul 30 20:37:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-56e4f28e-bfe5-4619-96c6-caf981e658ce tempest-TestInstancesWithCinderVolumes-554188937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-53c10edc-e1da-4367-a6f3-2d22d90764d6" returned: 0 in 0.275s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:37:58 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-56e4f28e-bfe5-4619-96c6-caf981e658ce tempest-TestInstancesWithCinderVolumes-554188937 None] Lock "cinder-quobyte-53c10edc-e1da-4367-a6f3-2d22d90764d6" released by "delete_volume" :: held 0.819s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:37:58 devstack cinder-volume[88719]: WARNING cinder.quota [None req-56e4f28e-bfe5-4619-96c6-caf981e658ce tempest-TestInstancesWithCinderVolumes-554188937 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-349009759-1930750866 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-349009759-1930750866, it is now deprecated. Please use the default quota class for default quota.
Jul 30 20:37:58 devstack cinder-volume[88719]: WARNING cinder.quota [None req-56e4f28e-bfe5-4619-96c6-caf981e658ce tempest-TestInstancesWithCinderVolumes-554188937 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-349009759-1930750866 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-349009759-1930750866, it is now deprecated. Please use the default quota class for default quota.
Jul 30 20:37:58 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-56e4f28e-bfe5-4619-96c6-caf981e658ce tempest-TestInstancesWithCinderVolumes-554188937 None] Created reservations ['1f7ded3b-d4f6-4f14-a9e0-dcabf50cf107', 'dbe02d84-4a3d-48cc-beb9-7801f224ac60', '8b186220-425d-46cb-a055-62ad9b18cd81', '2e1c6250-e458-4058-9398-56be56eda49c'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:37:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-56e4f28e-bfe5-4619-96c6-caf981e658ce tempest-TestInstancesWithCinderVolumes-554188937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:37:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-56e4f28e-bfe5-4619-96c6-caf981e658ce tempest-TestInstancesWithCinderVolumes-554188937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:37:58 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-56e4f28e-bfe5-4619-96c6-caf981e658ce tempest-TestInstancesWithCinderVolumes-554188937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:37:58 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-56e4f28e-bfe5-4619-96c6-caf981e658ce tempest-TestInstancesWithCinderVolumes-554188937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:37:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-56e4f28e-bfe5-4619-96c6-caf981e658ce tempest-TestInstancesWithCinderVolumes-554188937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:37:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-56e4f28e-bfe5-4619-96c6-caf981e658ce tempest-TestInstancesWithCinderVolumes-554188937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:37:58 devstack sudo[105759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:37:58 devstack sudo[105759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:37:58 devstack sudo[105759]: pam_unix(sudo:session): session closed for user root
Jul 30 20:37:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-56e4f28e-bfe5-4619-96c6-caf981e658ce tempest-TestInstancesWithCinderVolumes-554188937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.268s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:37:58 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-56e4f28e-bfe5-4619-96c6-caf981e658ce tempest-TestInstancesWithCinderVolumes-554188937 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:37:58 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-56e4f28e-bfe5-4619-96c6-caf981e658ce tempest-TestInstancesWithCinderVolumes-554188937 None] Deleted volume successfully.
Jul 30 20:37:58 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-56e4f28e-bfe5-4619-96c6-caf981e658ce tempest-TestInstancesWithCinderVolumes-554188937 None] Lock "cinder-53c10edc-e1da-4367-a6f3-2d22d90764d6-delete_volume" released by "delete_volume" :: held 1.369s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:38:07 devstack cinder-volume[88719]: INFO cinder.volume.manager [req-ccc15b3f-75a3-4c31-bdec-e946476afe66 req-f641dcff-3b0f-48f4-953a-578870979a1e tempest-TestInstancesWithCinderVolumes-554188937 None] Terminate volume connection completed successfully.
Jul 30 20:38:07 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [req-ccc15b3f-75a3-4c31-bdec-e946476afe66 req-f641dcff-3b0f-48f4-953a-578870979a1e tempest-TestInstancesWithCinderVolumes-554188937 None] Deleting attachment 900e8964-34cb-4abf-959c-8fe014355423. {{(pid=88719) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 30 20:38:10 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-2fa03e3b-7f27-47d3-9518-55e5bd9e2f31 tempest-TestInstancesWithCinderVolumes-554188937 None] Acquiring lock "cinder-ec8a14b9-99f7-434b-85a6-499a7ed2f589-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:38:10 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-2fa03e3b-7f27-47d3-9518-55e5bd9e2f31 tempest-TestInstancesWithCinderVolumes-554188937 None] Lock "cinder-ec8a14b9-99f7-434b-85a6-499a7ed2f589-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:38:10 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-2fa03e3b-7f27-47d3-9518-55e5bd9e2f31 tempest-TestInstancesWithCinderVolumes-554188937 None] Acquiring lock "cinder-quobyte-ec8a14b9-99f7-434b-85a6-499a7ed2f589" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:38:10 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-2fa03e3b-7f27-47d3-9518-55e5bd9e2f31 tempest-TestInstancesWithCinderVolumes-554188937 None] Lock "cinder-quobyte-ec8a14b9-99f7-434b-85a6-499a7ed2f589" acquired by "delete_volume" :: waited 0.019s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:38:10 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[a382f4f9-c868-4813-b896-b2e817d03c52]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:38:10 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2fa03e3b-7f27-47d3-9518-55e5bd9e2f31 tempest-TestInstancesWithCinderVolumes-554188937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-ec8a14b9-99f7-434b-85a6-499a7ed2f589 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:38:10 devstack sudo[105840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-ec8a14b9-99f7-434b-85a6-499a7ed2f589
Jul 30 20:38:10 devstack sudo[105840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:38:10 devstack sudo[105840]: pam_unix(sudo:session): session closed for user root
Jul 30 20:38:10 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2fa03e3b-7f27-47d3-9518-55e5bd9e2f31 tempest-TestInstancesWithCinderVolumes-554188937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-ec8a14b9-99f7-434b-85a6-499a7ed2f589" returned: 0 in 0.449s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:38:10 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2fa03e3b-7f27-47d3-9518-55e5bd9e2f31 tempest-TestInstancesWithCinderVolumes-554188937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-ec8a14b9-99f7-434b-85a6-499a7ed2f589 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:38:10 devstack sudo[105845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-ec8a14b9-99f7-434b-85a6-499a7ed2f589
Jul 30 20:38:10 devstack sudo[105845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:38:11 devstack sudo[105845]: pam_unix(sudo:session): session closed for user root
Jul 30 20:38:11 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2fa03e3b-7f27-47d3-9518-55e5bd9e2f31 tempest-TestInstancesWithCinderVolumes-554188937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-ec8a14b9-99f7-434b-85a6-499a7ed2f589" returned: 0 in 0.323s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:38:11 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-2fa03e3b-7f27-47d3-9518-55e5bd9e2f31 tempest-TestInstancesWithCinderVolumes-554188937 None] Lock "cinder-quobyte-ec8a14b9-99f7-434b-85a6-499a7ed2f589" released by "delete_volume" :: held 0.822s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:38:11 devstack cinder-volume[88719]: WARNING cinder.quota [None req-2fa03e3b-7f27-47d3-9518-55e5bd9e2f31 tempest-TestInstancesWithCinderVolumes-554188937 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1309387737-2642421 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1309387737-2642421, it is now deprecated. Please use the default quota class for default quota.
Jul 30 20:38:11 devstack cinder-volume[88719]: WARNING cinder.quota [None req-2fa03e3b-7f27-47d3-9518-55e5bd9e2f31 tempest-TestInstancesWithCinderVolumes-554188937 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1309387737-2642421 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1309387737-2642421, it is now deprecated. Please use the default quota class for default quota.
Jul 30 20:38:11 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-2fa03e3b-7f27-47d3-9518-55e5bd9e2f31 tempest-TestInstancesWithCinderVolumes-554188937 None] Created reservations ['f89e7018-bf9e-4e8b-8d8b-4f9f9c0209e0', 'eb051e4f-15b1-4211-9f8a-1712b458f393', 'bfd773ea-cbe5-4d1f-a83f-8b40339257de', 'f4d511cc-7d30-4eb5-a821-f4f8d529c7f2'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:38:11 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-2fa03e3b-7f27-47d3-9518-55e5bd9e2f31 tempest-TestInstancesWithCinderVolumes-554188937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:38:11 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-2fa03e3b-7f27-47d3-9518-55e5bd9e2f31 tempest-TestInstancesWithCinderVolumes-554188937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:38:11 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-2fa03e3b-7f27-47d3-9518-55e5bd9e2f31 tempest-TestInstancesWithCinderVolumes-554188937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:38:11 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-2fa03e3b-7f27-47d3-9518-55e5bd9e2f31 tempest-TestInstancesWithCinderVolumes-554188937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:38:11 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-2fa03e3b-7f27-47d3-9518-55e5bd9e2f31 tempest-TestInstancesWithCinderVolumes-554188937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:38:11 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2fa03e3b-7f27-47d3-9518-55e5bd9e2f31 tempest-TestInstancesWithCinderVolumes-554188937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:38:11 devstack sudo[105849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:38:11 devstack sudo[105849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:38:11 devstack sudo[105849]: pam_unix(sudo:session): session closed for user root
Jul 30 20:38:11 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2fa03e3b-7f27-47d3-9518-55e5bd9e2f31 tempest-TestInstancesWithCinderVolumes-554188937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.413s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:38:11 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-2fa03e3b-7f27-47d3-9518-55e5bd9e2f31 tempest-TestInstancesWithCinderVolumes-554188937 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:38:11 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-2fa03e3b-7f27-47d3-9518-55e5bd9e2f31 tempest-TestInstancesWithCinderVolumes-554188937 None] Deleted volume successfully.
Jul 30 20:38:11 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-2fa03e3b-7f27-47d3-9518-55e5bd9e2f31 tempest-TestInstancesWithCinderVolumes-554188937 None] Lock "cinder-ec8a14b9-99f7-434b-85a6-499a7ed2f589-delete_volume" released by "delete_volume" :: held 1.574s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:38:12 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0dfb684-650f-4437-8af2-2be42485b1f6 tempest-SnapshotDependencyTests-62616082 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:38:12 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-b0dfb684-650f-4437-8af2-2be42485b1f6 tempest-SnapshotDependencyTests-62616082 None] Flow 'volume_create_manager' (58824dca-9169-455b-993a-566703abe48a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:38:12 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-b0dfb684-650f-4437-8af2-2be42485b1f6 tempest-SnapshotDependencyTests-62616082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (192aa47b-0b82-4ac7-a5ea-24fd09a92375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:38:12 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-b0dfb684-650f-4437-8af2-2be42485b1f6 tempest-SnapshotDependencyTests-62616082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (192aa47b-0b82-4ac7-a5ea-24fd09a92375) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:38:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-296571993',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a812e93-f298-4daa-b5ac-406db337cdb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba3a86d862b6484bab199516e2e24bd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:38:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:38:12Z,use_quota=True,user_id='20eb301d6daf4d9e80da835014ec2b9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:38:12 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-b0dfb684-650f-4437-8af2-2be42485b1f6 tempest-SnapshotDependencyTests-62616082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5184ac5-f9ba-4b4d-b08e-9fee54d2c325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:38:12 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-b0dfb684-650f-4437-8af2-2be42485b1f6 tempest-SnapshotDependencyTests-62616082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5184ac5-f9ba-4b4d-b08e-9fee54d2c325) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:38:12 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-b0dfb684-650f-4437-8af2-2be42485b1f6 tempest-SnapshotDependencyTests-62616082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8274542b-a3c5-40b9-8cee-d523301e07e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:38:12 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-b0dfb684-650f-4437-8af2-2be42485b1f6 tempest-SnapshotDependencyTests-62616082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8274542b-a3c5-40b9-8cee-d523301e07e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a812e93-f298-4daa-b5ac-406db337cdb6', 'volume_name': 'volume-5a812e93-f298-4daa-b5ac-406db337cdb6', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:38:12 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-b0dfb684-650f-4437-8af2-2be42485b1f6 tempest-SnapshotDependencyTests-62616082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad5ed731-1578-4bc1-8686-d8cd1fec53a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:38:12 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-b0dfb684-650f-4437-8af2-2be42485b1f6 tempest-SnapshotDependencyTests-62616082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad5ed731-1578-4bc1-8686-d8cd1fec53a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:38:12 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-b0dfb684-650f-4437-8af2-2be42485b1f6 tempest-SnapshotDependencyTests-62616082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7bbf94b-062f-4a07-8a02-e20e4adcce37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:38:12 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-b0dfb684-650f-4437-8af2-2be42485b1f6 tempest-SnapshotDependencyTests-62616082 None] Volume 5a812e93-f298-4daa-b5ac-406db337cdb6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a812e93-f298-4daa-b5ac-406db337cdb6', 'volume_size': 1}
Jul 30 20:38:12 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-b0dfb684-650f-4437-8af2-2be42485b1f6 tempest-SnapshotDependencyTests-62616082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:38:12 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-b0dfb684-650f-4437-8af2-2be42485b1f6 tempest-SnapshotDependencyTests-62616082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:38:12 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-b0dfb684-650f-4437-8af2-2be42485b1f6 tempest-SnapshotDependencyTests-62616082 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:38:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-296571993',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a812e93-f298-4daa-b5ac-406db337cdb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba3a86d862b6484bab199516e2e24bd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:38:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:38:12Z,use_quota=True,user_id='20eb301d6daf4d9e80da835014ec2b9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:38:12 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-b0dfb684-650f-4437-8af2-2be42485b1f6 tempest-SnapshotDependencyTests-62616082 None] Creating volume 5a812e93-f298-4daa-b5ac-406db337cdb6 {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:38:12 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-b0dfb684-650f-4437-8af2-2be42485b1f6 tempest-SnapshotDependencyTests-62616082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:38:12 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-b0dfb684-650f-4437-8af2-2be42485b1f6 tempest-SnapshotDependencyTests-62616082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:38:12 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-b0dfb684-650f-4437-8af2-2be42485b1f6 tempest-SnapshotDependencyTests-62616082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:38:12 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-b0dfb684-650f-4437-8af2-2be42485b1f6 tempest-SnapshotDependencyTests-62616082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:38:12 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-b0dfb684-650f-4437-8af2-2be42485b1f6 tempest-SnapshotDependencyTests-62616082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:38:12 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-b0dfb684-650f-4437-8af2-2be42485b1f6 tempest-SnapshotDependencyTests-62616082 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:38:12 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-b0dfb684-650f-4437-8af2-2be42485b1f6 tempest-SnapshotDependencyTests-62616082 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:38:12 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-b0dfb684-650f-4437-8af2-2be42485b1f6 tempest-SnapshotDependencyTests-62616082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5a812e93-f298-4daa-b5ac-406db337cdb6 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:38:12 devstack sudo[105852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5a812e93-f298-4daa-b5ac-406db337cdb6 1073741824
Jul 30 20:38:12 devstack sudo[105852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:38:12 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-484b3291-838f-466a-acaa-c21bcb66b889 tempest-CreateVolumesFromImageTest-1067456586 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:38:12 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-484b3291-838f-466a-acaa-c21bcb66b889 tempest-CreateVolumesFromImageTest-1067456586 None] Flow 'volume_create_manager' (eb363525-eec6-4262-9e66-13a5e21bbbb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:38:12 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-484b3291-838f-466a-acaa-c21bcb66b889 tempest-CreateVolumesFromImageTest-1067456586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fe25302-9c45-4291-a79b-027a4e070ef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:38:12 devstack sudo[105852]: pam_unix(sudo:session): session closed for user root
Jul 30 20:38:12 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-b0dfb684-650f-4437-8af2-2be42485b1f6 tempest-SnapshotDependencyTests-62616082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5a812e93-f298-4daa-b5ac-406db337cdb6 1073741824" returned: 0 in 0.548s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:38:12 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-484b3291-838f-466a-acaa-c21bcb66b889 tempest-CreateVolumesFromImageTest-1067456586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fe25302-9c45-4291-a79b-027a4e070ef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:38:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1624110543',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d625d6a-49b8-4e19-b1df-6d635310e414,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e77099fc273e4000bc6c9bada1da7ac6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:38:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:38:13Z,use_quota=True,user_id='a8ebb0c5e5584ca1a0dfc0c984bad74a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:38:12 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-484b3291-838f-466a-acaa-c21bcb66b889 tempest-CreateVolumesFromImageTest-1067456586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90b99b2d-3497-4115-8837-11368366ed92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:38:12 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-484b3291-838f-466a-acaa-c21bcb66b889 tempest-CreateVolumesFromImageTest-1067456586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90b99b2d-3497-4115-8837-11368366ed92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:38:12 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-484b3291-838f-466a-acaa-c21bcb66b889 tempest-CreateVolumesFromImageTest-1067456586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d92f7ca8-2cf7-45ea-a7c4-08658fea205a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:38:12 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-484b3291-838f-466a-acaa-c21bcb66b889 tempest-CreateVolumesFromImageTest-1067456586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d92f7ca8-2cf7-45ea-a7c4-08658fea205a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d625d6a-49b8-4e19-b1df-6d635310e414', 'volume_name': 'volume-6d625d6a-49b8-4e19-b1df-6d635310e414', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:38:12 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-484b3291-838f-466a-acaa-c21bcb66b889 tempest-CreateVolumesFromImageTest-1067456586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a685a8a7-e4cf-42ff-836e-481cf7cd5f9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:38:12 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-484b3291-838f-466a-acaa-c21bcb66b889 tempest-CreateVolumesFromImageTest-1067456586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a685a8a7-e4cf-42ff-836e-481cf7cd5f9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:38:12 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-484b3291-838f-466a-acaa-c21bcb66b889 tempest-CreateVolumesFromImageTest-1067456586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8806ea5d-ba7b-42ca-b798-9de1df2c7eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:38:12 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-484b3291-838f-466a-acaa-c21bcb66b889 tempest-CreateVolumesFromImageTest-1067456586 None] Volume 6d625d6a-49b8-4e19-b1df-6d635310e414: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d625d6a-49b8-4e19-b1df-6d635310e414', 'volume_size': 1}
Jul 30 20:38:12 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-484b3291-838f-466a-acaa-c21bcb66b889 tempest-CreateVolumesFromImageTest-1067456586 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:38:12 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-b0dfb684-650f-4437-8af2-2be42485b1f6 tempest-SnapshotDependencyTests-62616082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5a812e93-f298-4daa-b5ac-406db337cdb6 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:38:12 devstack sudo[105858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5a812e93-f298-4daa-b5ac-406db337cdb6
Jul 30 20:38:12 devstack sudo[105858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:38:13 devstack sudo[105858]: pam_unix(sudo:session): session closed for user root
Jul 30 20:38:13 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-b0dfb684-650f-4437-8af2-2be42485b1f6 tempest-SnapshotDependencyTests-62616082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5a812e93-f298-4daa-b5ac-406db337cdb6" returned: 0 in 0.317s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:38:13 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-b0dfb684-650f-4437-8af2-2be42485b1f6 tempest-SnapshotDependencyTests-62616082 None] <== create_volume: return (950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:38:13 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-b0dfb684-650f-4437-8af2-2be42485b1f6 tempest-SnapshotDependencyTests-62616082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:38:13 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-484b3291-838f-466a-acaa-c21bcb66b889 tempest-CreateVolumesFromImageTest-1067456586 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.369s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:38:13 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-484b3291-838f-466a-acaa-c21bcb66b889 tempest-CreateVolumesFromImageTest-1067456586 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:38:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1624110543',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d625d6a-49b8-4e19-b1df-6d635310e414,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e77099fc273e4000bc6c9bada1da7ac6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:38:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:38:13Z,use_quota=True,user_id='a8ebb0c5e5584ca1a0dfc0c984bad74a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:38:13 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-484b3291-838f-466a-acaa-c21bcb66b889 tempest-CreateVolumesFromImageTest-1067456586 None] Creating volume 6d625d6a-49b8-4e19-b1df-6d635310e414 {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:38:13 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-484b3291-838f-466a-acaa-c21bcb66b889 tempest-CreateVolumesFromImageTest-1067456586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:38:13 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-484b3291-838f-466a-acaa-c21bcb66b889 tempest-CreateVolumesFromImageTest-1067456586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:38:13 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-484b3291-838f-466a-acaa-c21bcb66b889 tempest-CreateVolumesFromImageTest-1067456586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:38:13 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-484b3291-838f-466a-acaa-c21bcb66b889 tempest-CreateVolumesFromImageTest-1067456586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:38:13 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-484b3291-838f-466a-acaa-c21bcb66b889 tempest-CreateVolumesFromImageTest-1067456586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:38:13 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-484b3291-838f-466a-acaa-c21bcb66b889 tempest-CreateVolumesFromImageTest-1067456586 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:38:13 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-484b3291-838f-466a-acaa-c21bcb66b889 tempest-CreateVolumesFromImageTest-1067456586 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:38:13 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-484b3291-838f-466a-acaa-c21bcb66b889 tempest-CreateVolumesFromImageTest-1067456586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6d625d6a-49b8-4e19-b1df-6d635310e414 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:38:13 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-b0dfb684-650f-4437-8af2-2be42485b1f6 tempest-SnapshotDependencyTests-62616082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7bbf94b-062f-4a07-8a02-e20e4adcce37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a812e93-f298-4daa-b5ac-406db337cdb6', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:38:13 devstack sudo[105861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6d625d6a-49b8-4e19-b1df-6d635310e414 1073741824
Jul 30 20:38:13 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-b0dfb684-650f-4437-8af2-2be42485b1f6 tempest-SnapshotDependencyTests-62616082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (945212ba-bd21-4d8a-9848-ce8a0915c66b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:38:13 devstack sudo[105861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:38:13 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-b0dfb684-650f-4437-8af2-2be42485b1f6 tempest-SnapshotDependencyTests-62616082 None] Volume volume-5a812e93-f298-4daa-b5ac-406db337cdb6 (5a812e93-f298-4daa-b5ac-406db337cdb6): created successfully
Jul 30 20:38:13 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-b0dfb684-650f-4437-8af2-2be42485b1f6 tempest-SnapshotDependencyTests-62616082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (945212ba-bd21-4d8a-9848-ce8a0915c66b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:38:13 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-b0dfb684-650f-4437-8af2-2be42485b1f6 tempest-SnapshotDependencyTests-62616082 None] Flow 'volume_create_manager' (58824dca-9169-455b-993a-566703abe48a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:38:13 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-26a53c0a-a9c7-4e9f-9666-79742ef2c2f1 tempest-CreateVolumesFromImageTest-1067456586 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:38:13 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-26a53c0a-a9c7-4e9f-9666-79742ef2c2f1 tempest-CreateVolumesFromImageTest-1067456586 None] Flow 'volume_create_manager' (c80eeb0d-7c49-467b-9e1c-6e099dec0154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:38:13 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-26a53c0a-a9c7-4e9f-9666-79742ef2c2f1 tempest-CreateVolumesFromImageTest-1067456586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39f83f53-adfb-4608-a58d-41e04f4779c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:38:13 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-b0dfb684-650f-4437-8af2-2be42485b1f6 tempest-SnapshotDependencyTests-62616082 None] Created volume successfully.
Jul 30 20:38:13 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-26a53c0a-a9c7-4e9f-9666-79742ef2c2f1 tempest-CreateVolumesFromImageTest-1067456586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39f83f53-adfb-4608-a58d-41e04f4779c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:38:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-931280378',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a433f541-f056-407d-bc0c-2fb761c783d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e77099fc273e4000bc6c9bada1da7ac6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:38:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:38:13Z,use_quota=True,user_id='a8ebb0c5e5584ca1a0dfc0c984bad74a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:38:13 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-26a53c0a-a9c7-4e9f-9666-79742ef2c2f1 tempest-CreateVolumesFromImageTest-1067456586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c23e7ed-1305-4c88-b6ec-ff22d3c1fdcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:38:13 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-26a53c0a-a9c7-4e9f-9666-79742ef2c2f1 tempest-CreateVolumesFromImageTest-1067456586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c23e7ed-1305-4c88-b6ec-ff22d3c1fdcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:38:13 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-26a53c0a-a9c7-4e9f-9666-79742ef2c2f1 tempest-CreateVolumesFromImageTest-1067456586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64431ccf-ca5d-46f6-b135-fe4ad5208df6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:38:13 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-26a53c0a-a9c7-4e9f-9666-79742ef2c2f1 tempest-CreateVolumesFromImageTest-1067456586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64431ccf-ca5d-46f6-b135-fe4ad5208df6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a433f541-f056-407d-bc0c-2fb761c783d3', 'volume_name': 'volume-a433f541-f056-407d-bc0c-2fb761c783d3', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:38:13 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-26a53c0a-a9c7-4e9f-9666-79742ef2c2f1 tempest-CreateVolumesFromImageTest-1067456586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ae9641f-7f22-423e-ae4e-ccb6e41bb1b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:38:13 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-26a53c0a-a9c7-4e9f-9666-79742ef2c2f1 tempest-CreateVolumesFromImageTest-1067456586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ae9641f-7f22-423e-ae4e-ccb6e41bb1b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:38:13 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-26a53c0a-a9c7-4e9f-9666-79742ef2c2f1 tempest-CreateVolumesFromImageTest-1067456586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84defd23-99d2-4360-bd9f-897a071c9f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:38:13 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-26a53c0a-a9c7-4e9f-9666-79742ef2c2f1 tempest-CreateVolumesFromImageTest-1067456586 None] Volume a433f541-f056-407d-bc0c-2fb761c783d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a433f541-f056-407d-bc0c-2fb761c783d3', 'volume_size': 1}
Jul 30 20:38:13 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-26a53c0a-a9c7-4e9f-9666-79742ef2c2f1 tempest-CreateVolumesFromImageTest-1067456586 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:38:13 devstack cinder-volume[88719]: DEBUG dbcounter [-] [88719] Writing DB stats cinder:UPDATE=126,cinder:SELECT=95,cinder:DELETE=9,cinder:INSERT=27 {{(pid=88719) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 30 20:38:13 devstack cinder-volume[88719]: DEBUG dbcounter [-] [88719] Writing DB stats cinder:SELECT=101,cinder:INSERT=30,cinder:UPDATE=129,cinder:DELETE=12 {{(pid=88719) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 30 20:38:13 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-345fe097-d06c-46bb-84cf-705f63eb612b tempest-CreateVolumesFromImageTest-1067456586 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:38:13 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-345fe097-d06c-46bb-84cf-705f63eb612b tempest-CreateVolumesFromImageTest-1067456586 None] Flow 'volume_create_manager' (f7ae7af3-f64b-48d1-9604-66d15eb5c338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:38:13 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-345fe097-d06c-46bb-84cf-705f63eb612b tempest-CreateVolumesFromImageTest-1067456586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f151fd67-c435-4831-88ca-baf83b4b06b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:38:13 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-345fe097-d06c-46bb-84cf-705f63eb612b tempest-CreateVolumesFromImageTest-1067456586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f151fd67-c435-4831-88ca-baf83b4b06b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:38:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-606391634',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3aa87b1-567f-441e-86a4-100572cda87c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e77099fc273e4000bc6c9bada1da7ac6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:38:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:38:14Z,use_quota=True,user_id='a8ebb0c5e5584ca1a0dfc0c984bad74a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:38:13 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-345fe097-d06c-46bb-84cf-705f63eb612b tempest-CreateVolumesFromImageTest-1067456586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00b9b5db-73b4-4c60-ae3d-140c7beff71f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:38:13 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-345fe097-d06c-46bb-84cf-705f63eb612b tempest-CreateVolumesFromImageTest-1067456586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00b9b5db-73b4-4c60-ae3d-140c7beff71f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:38:13 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-345fe097-d06c-46bb-84cf-705f63eb612b tempest-CreateVolumesFromImageTest-1067456586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9182f6e3-02c5-41a4-8208-e8844aea517a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:38:13 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-345fe097-d06c-46bb-84cf-705f63eb612b tempest-CreateVolumesFromImageTest-1067456586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9182f6e3-02c5-41a4-8208-e8844aea517a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3aa87b1-567f-441e-86a4-100572cda87c', 'volume_name': 'volume-f3aa87b1-567f-441e-86a4-100572cda87c', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:38:13 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-345fe097-d06c-46bb-84cf-705f63eb612b tempest-CreateVolumesFromImageTest-1067456586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc2fb8a1-5570-429e-b9cb-abfcde74f7b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:38:13 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-345fe097-d06c-46bb-84cf-705f63eb612b tempest-CreateVolumesFromImageTest-1067456586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc2fb8a1-5570-429e-b9cb-abfcde74f7b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:38:13 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-345fe097-d06c-46bb-84cf-705f63eb612b tempest-CreateVolumesFromImageTest-1067456586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e304561b-7a5b-4031-bbf6-c918952cab3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:38:13 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-345fe097-d06c-46bb-84cf-705f63eb612b tempest-CreateVolumesFromImageTest-1067456586 None] Volume f3aa87b1-567f-441e-86a4-100572cda87c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3aa87b1-567f-441e-86a4-100572cda87c', 'volume_size': 1}
Jul 30 20:38:13 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-345fe097-d06c-46bb-84cf-705f63eb612b tempest-CreateVolumesFromImageTest-1067456586 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:38:13 devstack sudo[105861]: pam_unix(sudo:session): session closed for user root
Jul 30 20:38:13 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-484b3291-838f-466a-acaa-c21bcb66b889 tempest-CreateVolumesFromImageTest-1067456586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6d625d6a-49b8-4e19-b1df-6d635310e414 1073741824" returned: 0 in 0.631s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:38:13 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-484b3291-838f-466a-acaa-c21bcb66b889 tempest-CreateVolumesFromImageTest-1067456586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6d625d6a-49b8-4e19-b1df-6d635310e414 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:38:14 devstack sudo[105869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6d625d6a-49b8-4e19-b1df-6d635310e414
Jul 30 20:38:14 devstack sudo[105869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:38:14 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-68f2a09f-2b1e-4c29-9c35-c92268cb2cf5 tempest-CreateVolumesFromImageTest-1067456586 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:38:14 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-68f2a09f-2b1e-4c29-9c35-c92268cb2cf5 tempest-CreateVolumesFromImageTest-1067456586 None] Flow 'volume_create_manager' (3394520f-2c5e-41d7-a1f5-e55f936eb85d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:38:14 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-68f2a09f-2b1e-4c29-9c35-c92268cb2cf5 tempest-CreateVolumesFromImageTest-1067456586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c132425-bc3d-4e57-960f-fdc715d71bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:38:14 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-68f2a09f-2b1e-4c29-9c35-c92268cb2cf5 tempest-CreateVolumesFromImageTest-1067456586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c132425-bc3d-4e57-960f-fdc715d71bdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:38:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1950956889',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5578d25-d4a3-4350-b8f4-d14cad2ba434,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e77099fc273e4000bc6c9bada1da7ac6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:38:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:38:14Z,use_quota=True,user_id='a8ebb0c5e5584ca1a0dfc0c984bad74a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:38:14 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-68f2a09f-2b1e-4c29-9c35-c92268cb2cf5 tempest-CreateVolumesFromImageTest-1067456586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6747684-915b-4c62-9346-c8259f482a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:38:14 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-68f2a09f-2b1e-4c29-9c35-c92268cb2cf5 tempest-CreateVolumesFromImageTest-1067456586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6747684-915b-4c62-9346-c8259f482a67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:38:14 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-68f2a09f-2b1e-4c29-9c35-c92268cb2cf5 tempest-CreateVolumesFromImageTest-1067456586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dafd65aa-d4a5-4340-884f-0b519e9e1cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:38:14 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-68f2a09f-2b1e-4c29-9c35-c92268cb2cf5 tempest-CreateVolumesFromImageTest-1067456586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dafd65aa-d4a5-4340-884f-0b519e9e1cb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5578d25-d4a3-4350-b8f4-d14cad2ba434', 'volume_name': 'volume-a5578d25-d4a3-4350-b8f4-d14cad2ba434', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:38:14 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-68f2a09f-2b1e-4c29-9c35-c92268cb2cf5 tempest-CreateVolumesFromImageTest-1067456586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd458a25-9668-4d5e-9858-562e92ab49e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:38:14 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-68f2a09f-2b1e-4c29-9c35-c92268cb2cf5 tempest-CreateVolumesFromImageTest-1067456586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd458a25-9668-4d5e-9858-562e92ab49e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:38:14 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-68f2a09f-2b1e-4c29-9c35-c92268cb2cf5 tempest-CreateVolumesFromImageTest-1067456586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a031a37f-c751-4814-8ffc-3b15ea70ab67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:38:14 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-68f2a09f-2b1e-4c29-9c35-c92268cb2cf5 tempest-CreateVolumesFromImageTest-1067456586 None] Volume a5578d25-d4a3-4350-b8f4-d14cad2ba434: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5578d25-d4a3-4350-b8f4-d14cad2ba434', 'volume_size': 1}
Jul 30 20:38:14 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-68f2a09f-2b1e-4c29-9c35-c92268cb2cf5 tempest-CreateVolumesFromImageTest-1067456586 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:38:14 devstack sudo[105869]: pam_unix(sudo:session): session closed for user root
Jul 30 20:38:14 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-484b3291-838f-466a-acaa-c21bcb66b889 tempest-CreateVolumesFromImageTest-1067456586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6d625d6a-49b8-4e19-b1df-6d635310e414" returned: 0 in 0.385s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:38:14 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-484b3291-838f-466a-acaa-c21bcb66b889 tempest-CreateVolumesFromImageTest-1067456586 None] <== create_volume: return (1069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:38:14 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-484b3291-838f-466a-acaa-c21bcb66b889 tempest-CreateVolumesFromImageTest-1067456586 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.072s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:38:14 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-26a53c0a-a9c7-4e9f-9666-79742ef2c2f1 tempest-CreateVolumesFromImageTest-1067456586 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.848s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:38:14 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-26a53c0a-a9c7-4e9f-9666-79742ef2c2f1 tempest-CreateVolumesFromImageTest-1067456586 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:38:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-931280378',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a433f541-f056-407d-bc0c-2fb761c783d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e77099fc273e4000bc6c9bada1da7ac6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:38:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:38:13Z,use_quota=True,user_id='a8ebb0c5e5584ca1a0dfc0c984bad74a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:38:14 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-26a53c0a-a9c7-4e9f-9666-79742ef2c2f1 tempest-CreateVolumesFromImageTest-1067456586 None] Creating volume a433f541-f056-407d-bc0c-2fb761c783d3 {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:38:14 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-26a53c0a-a9c7-4e9f-9666-79742ef2c2f1 tempest-CreateVolumesFromImageTest-1067456586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:38:14 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-26a53c0a-a9c7-4e9f-9666-79742ef2c2f1 tempest-CreateVolumesFromImageTest-1067456586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:38:14 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-26a53c0a-a9c7-4e9f-9666-79742ef2c2f1 tempest-CreateVolumesFromImageTest-1067456586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:38:14 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-26a53c0a-a9c7-4e9f-9666-79742ef2c2f1 tempest-CreateVolumesFromImageTest-1067456586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:38:14 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-26a53c0a-a9c7-4e9f-9666-79742ef2c2f1 tempest-CreateVolumesFromImageTest-1067456586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:38:14 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-26a53c0a-a9c7-4e9f-9666-79742ef2c2f1 tempest-CreateVolumesFromImageTest-1067456586 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:38:14 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-26a53c0a-a9c7-4e9f-9666-79742ef2c2f1 tempest-CreateVolumesFromImageTest-1067456586 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:38:14 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-26a53c0a-a9c7-4e9f-9666-79742ef2c2f1 tempest-CreateVolumesFromImageTest-1067456586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-a433f541-f056-407d-bc0c-2fb761c783d3 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:38:14 devstack sudo[105872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-a433f541-f056-407d-bc0c-2fb761c783d3 1073741824
Jul 30 20:38:14 devstack sudo[105872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:38:14 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-484b3291-838f-466a-acaa-c21bcb66b889 tempest-CreateVolumesFromImageTest-1067456586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8806ea5d-ba7b-42ca-b798-9de1df2c7eee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d625d6a-49b8-4e19-b1df-6d635310e414', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:38:14 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-484b3291-838f-466a-acaa-c21bcb66b889 tempest-CreateVolumesFromImageTest-1067456586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d9926a5-16c8-4cf5-8721-50e4a4750c0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:38:14 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-484b3291-838f-466a-acaa-c21bcb66b889 tempest-CreateVolumesFromImageTest-1067456586 None] Volume volume-6d625d6a-49b8-4e19-b1df-6d635310e414 (6d625d6a-49b8-4e19-b1df-6d635310e414): created successfully
Jul 30 20:38:14 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-484b3291-838f-466a-acaa-c21bcb66b889 tempest-CreateVolumesFromImageTest-1067456586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d9926a5-16c8-4cf5-8721-50e4a4750c0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:38:14 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-484b3291-838f-466a-acaa-c21bcb66b889 tempest-CreateVolumesFromImageTest-1067456586 None] Flow 'volume_create_manager' (eb363525-eec6-4262-9e66-13a5e21bbbb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:38:14 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-484b3291-838f-466a-acaa-c21bcb66b889 tempest-CreateVolumesFromImageTest-1067456586 None] Created volume successfully.
Jul 30 20:38:14 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe48693f-88e0-483e-8cf5-51964b8fc22b tempest-CreateVolumesFromImageTest-1067456586 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:38:14 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-fe48693f-88e0-483e-8cf5-51964b8fc22b tempest-CreateVolumesFromImageTest-1067456586 None] Flow 'volume_create_manager' (ecb49ea1-3292-4390-9568-1865e41ccf50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:38:14 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-fe48693f-88e0-483e-8cf5-51964b8fc22b tempest-CreateVolumesFromImageTest-1067456586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a1a3ff4-276e-4b26-814e-f3d157af721a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:38:14 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-fe48693f-88e0-483e-8cf5-51964b8fc22b tempest-CreateVolumesFromImageTest-1067456586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a1a3ff4-276e-4b26-814e-f3d157af721a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:38:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-759915614',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8274b9b2-04ec-4049-8cab-e220ad97578d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e77099fc273e4000bc6c9bada1da7ac6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:38:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:38:15Z,use_quota=True,user_id='a8ebb0c5e5584ca1a0dfc0c984bad74a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:38:14 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-fe48693f-88e0-483e-8cf5-51964b8fc22b tempest-CreateVolumesFromImageTest-1067456586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f63cbded-a77a-4a27-bd14-e2f179dacdd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:38:14 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-fe48693f-88e0-483e-8cf5-51964b8fc22b tempest-CreateVolumesFromImageTest-1067456586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f63cbded-a77a-4a27-bd14-e2f179dacdd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:38:14 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-fe48693f-88e0-483e-8cf5-51964b8fc22b tempest-CreateVolumesFromImageTest-1067456586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffc27ef1-9f5f-4176-9c88-c9a0f421bb09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:38:14 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-fe48693f-88e0-483e-8cf5-51964b8fc22b tempest-CreateVolumesFromImageTest-1067456586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffc27ef1-9f5f-4176-9c88-c9a0f421bb09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8274b9b2-04ec-4049-8cab-e220ad97578d', 'volume_name': 'volume-8274b9b2-04ec-4049-8cab-e220ad97578d', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:38:14 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-fe48693f-88e0-483e-8cf5-51964b8fc22b tempest-CreateVolumesFromImageTest-1067456586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77e6b339-78a6-4976-bef0-dbb2c309f1f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:38:14 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-fe48693f-88e0-483e-8cf5-51964b8fc22b tempest-CreateVolumesFromImageTest-1067456586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77e6b339-78a6-4976-bef0-dbb2c309f1f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:38:14 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-fe48693f-88e0-483e-8cf5-51964b8fc22b tempest-CreateVolumesFromImageTest-1067456586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38022236-9c8f-4c12-a94c-a02976b623bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:38:14 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-fe48693f-88e0-483e-8cf5-51964b8fc22b tempest-CreateVolumesFromImageTest-1067456586 None] Volume 8274b9b2-04ec-4049-8cab-e220ad97578d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8274b9b2-04ec-4049-8cab-e220ad97578d', 'volume_size': 1}
Jul 30 20:38:14 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-fe48693f-88e0-483e-8cf5-51964b8fc22b tempest-CreateVolumesFromImageTest-1067456586 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:38:14 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-a4991756-2971-4c3e-b40e-dd828214e389 tempest-SnapshotDependencyTests-62616082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:38:14 devstack sudo[105872]: pam_unix(sudo:session): session closed for user root
Jul 30 20:38:14 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-26a53c0a-a9c7-4e9f-9666-79742ef2c2f1 tempest-CreateVolumesFromImageTest-1067456586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-a433f541-f056-407d-bc0c-2fb761c783d3 1073741824" returned: 0 in 0.502s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:38:14 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-26a53c0a-a9c7-4e9f-9666-79742ef2c2f1 tempest-CreateVolumesFromImageTest-1067456586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-a433f541-f056-407d-bc0c-2fb761c783d3 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:38:14 devstack sudo[105878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-a433f541-f056-407d-bc0c-2fb761c783d3
Jul 30 20:38:14 devstack sudo[105878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:38:15 devstack sudo[105878]: pam_unix(sudo:session): session closed for user root
Jul 30 20:38:15 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-26a53c0a-a9c7-4e9f-9666-79742ef2c2f1 tempest-CreateVolumesFromImageTest-1067456586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-a433f541-f056-407d-bc0c-2fb761c783d3" returned: 0 in 0.301s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:38:15 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-26a53c0a-a9c7-4e9f-9666-79742ef2c2f1 tempest-CreateVolumesFromImageTest-1067456586 None] <== create_volume: return (857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:38:15 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-26a53c0a-a9c7-4e9f-9666-79742ef2c2f1 tempest-CreateVolumesFromImageTest-1067456586 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.860s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:38:15 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-345fe097-d06c-46bb-84cf-705f63eb612b tempest-CreateVolumesFromImageTest-1067456586 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.422s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:38:15 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-345fe097-d06c-46bb-84cf-705f63eb612b tempest-CreateVolumesFromImageTest-1067456586 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:38:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-606391634',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3aa87b1-567f-441e-86a4-100572cda87c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e77099fc273e4000bc6c9bada1da7ac6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:38:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:38:14Z,use_quota=True,user_id='a8ebb0c5e5584ca1a0dfc0c984bad74a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:38:15 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-345fe097-d06c-46bb-84cf-705f63eb612b tempest-CreateVolumesFromImageTest-1067456586 None] Creating volume f3aa87b1-567f-441e-86a4-100572cda87c {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:38:15 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-345fe097-d06c-46bb-84cf-705f63eb612b tempest-CreateVolumesFromImageTest-1067456586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:38:15 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-345fe097-d06c-46bb-84cf-705f63eb612b tempest-CreateVolumesFromImageTest-1067456586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:38:15 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-345fe097-d06c-46bb-84cf-705f63eb612b tempest-CreateVolumesFromImageTest-1067456586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:38:15 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-345fe097-d06c-46bb-84cf-705f63eb612b tempest-CreateVolumesFromImageTest-1067456586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:38:15 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-345fe097-d06c-46bb-84cf-705f63eb612b tempest-CreateVolumesFromImageTest-1067456586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:38:15 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-345fe097-d06c-46bb-84cf-705f63eb612b tempest-CreateVolumesFromImageTest-1067456586 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:38:15 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-345fe097-d06c-46bb-84cf-705f63eb612b tempest-CreateVolumesFromImageTest-1067456586 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:38:15 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-345fe097-d06c-46bb-84cf-705f63eb612b tempest-CreateVolumesFromImageTest-1067456586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f3aa87b1-567f-441e-86a4-100572cda87c 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:38:15 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-26a53c0a-a9c7-4e9f-9666-79742ef2c2f1 tempest-CreateVolumesFromImageTest-1067456586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84defd23-99d2-4360-bd9f-897a071c9f1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a433f541-f056-407d-bc0c-2fb761c783d3', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:38:15 devstack sudo[105882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f3aa87b1-567f-441e-86a4-100572cda87c 1073741824
Jul 30 20:38:15 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-26a53c0a-a9c7-4e9f-9666-79742ef2c2f1 tempest-CreateVolumesFromImageTest-1067456586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ccefa8e-4be9-4c6f-ab97-0bf0a1e41b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:38:15 devstack sudo[105882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:38:15 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-26a53c0a-a9c7-4e9f-9666-79742ef2c2f1 tempest-CreateVolumesFromImageTest-1067456586 None] Volume volume-a433f541-f056-407d-bc0c-2fb761c783d3 (a433f541-f056-407d-bc0c-2fb761c783d3): created successfully
Jul 30 20:38:15 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-26a53c0a-a9c7-4e9f-9666-79742ef2c2f1 tempest-CreateVolumesFromImageTest-1067456586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ccefa8e-4be9-4c6f-ab97-0bf0a1e41b59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:38:15 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-26a53c0a-a9c7-4e9f-9666-79742ef2c2f1 tempest-CreateVolumesFromImageTest-1067456586 None] Flow 'volume_create_manager' (c80eeb0d-7c49-467b-9e1c-6e099dec0154) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:38:15 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-26a53c0a-a9c7-4e9f-9666-79742ef2c2f1 tempest-CreateVolumesFromImageTest-1067456586 None] Created volume successfully.
Jul 30 20:38:15 devstack sudo[105882]: pam_unix(sudo:session): session closed for user root
Jul 30 20:38:15 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-345fe097-d06c-46bb-84cf-705f63eb612b tempest-CreateVolumesFromImageTest-1067456586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f3aa87b1-567f-441e-86a4-100572cda87c 1073741824" returned: 0 in 0.586s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:38:15 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-345fe097-d06c-46bb-84cf-705f63eb612b tempest-CreateVolumesFromImageTest-1067456586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f3aa87b1-567f-441e-86a4-100572cda87c {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:38:15 devstack sudo[105888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f3aa87b1-567f-441e-86a4-100572cda87c
Jul 30 20:38:15 devstack sudo[105888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:38:16 devstack sudo[105888]: pam_unix(sudo:session): session closed for user root
Jul 30 20:38:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-345fe097-d06c-46bb-84cf-705f63eb612b tempest-CreateVolumesFromImageTest-1067456586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f3aa87b1-567f-441e-86a4-100572cda87c" returned: 0 in 0.262s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:38:16 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-345fe097-d06c-46bb-84cf-705f63eb612b tempest-CreateVolumesFromImageTest-1067456586 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:38:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-345fe097-d06c-46bb-84cf-705f63eb612b tempest-CreateVolumesFromImageTest-1067456586 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.897s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:38:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-68f2a09f-2b1e-4c29-9c35-c92268cb2cf5 tempest-CreateVolumesFromImageTest-1067456586 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.849s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:38:16 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-68f2a09f-2b1e-4c29-9c35-c92268cb2cf5 tempest-CreateVolumesFromImageTest-1067456586 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:38:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1950956889',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5578d25-d4a3-4350-b8f4-d14cad2ba434,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e77099fc273e4000bc6c9bada1da7ac6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:38:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:38:14Z,use_quota=True,user_id='a8ebb0c5e5584ca1a0dfc0c984bad74a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:38:16 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-68f2a09f-2b1e-4c29-9c35-c92268cb2cf5 tempest-CreateVolumesFromImageTest-1067456586 None] Creating volume a5578d25-d4a3-4350-b8f4-d14cad2ba434 {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:38:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-68f2a09f-2b1e-4c29-9c35-c92268cb2cf5 tempest-CreateVolumesFromImageTest-1067456586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:38:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-68f2a09f-2b1e-4c29-9c35-c92268cb2cf5 tempest-CreateVolumesFromImageTest-1067456586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:38:16 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-68f2a09f-2b1e-4c29-9c35-c92268cb2cf5 tempest-CreateVolumesFromImageTest-1067456586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:38:16 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-68f2a09f-2b1e-4c29-9c35-c92268cb2cf5 tempest-CreateVolumesFromImageTest-1067456586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:38:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-68f2a09f-2b1e-4c29-9c35-c92268cb2cf5 tempest-CreateVolumesFromImageTest-1067456586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:38:16 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-68f2a09f-2b1e-4c29-9c35-c92268cb2cf5 tempest-CreateVolumesFromImageTest-1067456586 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:38:16 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-68f2a09f-2b1e-4c29-9c35-c92268cb2cf5 tempest-CreateVolumesFromImageTest-1067456586 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:38:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-68f2a09f-2b1e-4c29-9c35-c92268cb2cf5 tempest-CreateVolumesFromImageTest-1067456586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-a5578d25-d4a3-4350-b8f4-d14cad2ba434 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:38:16 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-345fe097-d06c-46bb-84cf-705f63eb612b tempest-CreateVolumesFromImageTest-1067456586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e304561b-7a5b-4031-bbf6-c918952cab3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3aa87b1-567f-441e-86a4-100572cda87c', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:38:16 devstack sudo[105891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-a5578d25-d4a3-4350-b8f4-d14cad2ba434 1073741824
Jul 30 20:38:16 devstack sudo[105891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:38:16 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-345fe097-d06c-46bb-84cf-705f63eb612b tempest-CreateVolumesFromImageTest-1067456586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2693d762-6933-4f4c-a759-241d9f12a4c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:38:16 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-345fe097-d06c-46bb-84cf-705f63eb612b tempest-CreateVolumesFromImageTest-1067456586 None] Volume volume-f3aa87b1-567f-441e-86a4-100572cda87c (f3aa87b1-567f-441e-86a4-100572cda87c): created successfully
Jul 30 20:38:16 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-345fe097-d06c-46bb-84cf-705f63eb612b tempest-CreateVolumesFromImageTest-1067456586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2693d762-6933-4f4c-a759-241d9f12a4c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:38:16 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-345fe097-d06c-46bb-84cf-705f63eb612b tempest-CreateVolumesFromImageTest-1067456586 None] Flow 'volume_create_manager' (f7ae7af3-f64b-48d1-9604-66d15eb5c338) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:38:16 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-345fe097-d06c-46bb-84cf-705f63eb612b tempest-CreateVolumesFromImageTest-1067456586 None] Created volume successfully.
Jul 30 20:38:16 devstack cinder-volume[88719]: DEBUG oslo_service.periodic_task [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88719) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 30 20:38:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:38:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:38:16 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:38:16 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:38:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:38:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:38:16 devstack sudo[105897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:38:16 devstack sudo[105897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:38:16 devstack sudo[105891]: pam_unix(sudo:session): session closed for user root
Jul 30 20:38:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-68f2a09f-2b1e-4c29-9c35-c92268cb2cf5 tempest-CreateVolumesFromImageTest-1067456586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-a5578d25-d4a3-4350-b8f4-d14cad2ba434 1073741824" returned: 0 in 0.523s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:38:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-68f2a09f-2b1e-4c29-9c35-c92268cb2cf5 tempest-CreateVolumesFromImageTest-1067456586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-a5578d25-d4a3-4350-b8f4-d14cad2ba434 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:38:16 devstack sudo[105901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-a5578d25-d4a3-4350-b8f4-d14cad2ba434
Jul 30 20:38:16 devstack sudo[105901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:38:16 devstack sudo[105897]: pam_unix(sudo:session): session closed for user root
Jul 30 20:38:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.298s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:38:16 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:38:16 devstack cinder-volume[88719]: DEBUG oslo_service.periodic_task [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Running periodic task VolumeManager._thread_info {{(pid=88719) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 30 20:38:16 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] thread count: 28 {{(pid=88719) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 30 20:38:16 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] thread info: [<_MainThread(MainThread, started 132390416908416)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132390306497536)>, <Thread(Thread-3 (stat_writer), started daemon 132390304471680)>, <Thread(Rabbit-heartbeat, started daemon 132390303393408)>, <Thread(Thread-5 (_runner), started daemon 132390303543168)>, <Thread(Thread-7 (_runner), started daemon 132390303563392)>, <Thread(fd_logger, started daemon 132390301344640)>, <Thread(privsep_reader, started daemon 132390301560640)>, <Thread(tpool_thread_0, started daemon 132390291470016)>, <Thread(tpool_thread_1, started daemon 132390283077312)>, <Thread(tpool_thread_2, started daemon 132390274684608)>, <Thread(tpool_thread_3, started daemon 132390266291904)>, <Thread(tpool_thread_4, started daemon 132390257899200)>, <Thread(tpool_thread_5, started daemon 132390249506496)>, <Thread(tpool_thread_6, started daemon 132390241113792)>, <Thread(tpool_thread_7, started daemon 132390232721088)>, <Thread(tpool_thread_8, started daemon 132390224328384)>, <Thread(tpool_thread_9, started daemon 132390215919296)>, <Thread(tpool_thread_10, started daemon 132390207510208)>, <Thread(tpool_thread_11, started daemon 132390199101120)>, <Thread(tpool_thread_12, started daemon 132390190692032)>, <Thread(tpool_thread_13, started daemon 132390182282944)>, <Thread(tpool_thread_14, started daemon 132390173873856)>, <Thread(tpool_thread_15, started daemon 132390165464768)>, <Thread(tpool_thread_16, started daemon 132390157055680)>, <Thread(tpool_thread_17, started daemon 132390148646592)>, <Thread(tpool_thread_18, started daemon 132390140237504)>, <Thread(tpool_thread_19, started daemon 132390131828416)>] {{(pid=88719) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 30 20:38:16 devstack sudo[105901]: pam_unix(sudo:session): session closed for user root
Jul 30 20:38:17 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-68f2a09f-2b1e-4c29-9c35-c92268cb2cf5 tempest-CreateVolumesFromImageTest-1067456586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-a5578d25-d4a3-4350-b8f4-d14cad2ba434" returned: 0 in 0.297s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:38:17 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-68f2a09f-2b1e-4c29-9c35-c92268cb2cf5 tempest-CreateVolumesFromImageTest-1067456586 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:38:17 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-68f2a09f-2b1e-4c29-9c35-c92268cb2cf5 tempest-CreateVolumesFromImageTest-1067456586 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:38:17 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-fe48693f-88e0-483e-8cf5-51964b8fc22b tempest-CreateVolumesFromImageTest-1067456586 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.269s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:38:17 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-fe48693f-88e0-483e-8cf5-51964b8fc22b tempest-CreateVolumesFromImageTest-1067456586 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:38:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-759915614',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8274b9b2-04ec-4049-8cab-e220ad97578d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e77099fc273e4000bc6c9bada1da7ac6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:38:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:38:15Z,use_quota=True,user_id='a8ebb0c5e5584ca1a0dfc0c984bad74a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:38:17 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-fe48693f-88e0-483e-8cf5-51964b8fc22b tempest-CreateVolumesFromImageTest-1067456586 None] Creating volume 8274b9b2-04ec-4049-8cab-e220ad97578d {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:38:17 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-fe48693f-88e0-483e-8cf5-51964b8fc22b tempest-CreateVolumesFromImageTest-1067456586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:38:17 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-fe48693f-88e0-483e-8cf5-51964b8fc22b tempest-CreateVolumesFromImageTest-1067456586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:38:17 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-fe48693f-88e0-483e-8cf5-51964b8fc22b tempest-CreateVolumesFromImageTest-1067456586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:38:17 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-fe48693f-88e0-483e-8cf5-51964b8fc22b tempest-CreateVolumesFromImageTest-1067456586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:38:17 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-fe48693f-88e0-483e-8cf5-51964b8fc22b tempest-CreateVolumesFromImageTest-1067456586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:38:17 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-fe48693f-88e0-483e-8cf5-51964b8fc22b tempest-CreateVolumesFromImageTest-1067456586 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:38:17 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-fe48693f-88e0-483e-8cf5-51964b8fc22b tempest-CreateVolumesFromImageTest-1067456586 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:38:17 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-fe48693f-88e0-483e-8cf5-51964b8fc22b tempest-CreateVolumesFromImageTest-1067456586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-8274b9b2-04ec-4049-8cab-e220ad97578d 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:38:17 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-68f2a09f-2b1e-4c29-9c35-c92268cb2cf5 tempest-CreateVolumesFromImageTest-1067456586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a031a37f-c751-4814-8ffc-3b15ea70ab67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5578d25-d4a3-4350-b8f4-d14cad2ba434', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:38:17 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-68f2a09f-2b1e-4c29-9c35-c92268cb2cf5 tempest-CreateVolumesFromImageTest-1067456586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d029812a-80b4-408f-8352-86eb9fe8954b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:38:17 devstack sudo[105904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-8274b9b2-04ec-4049-8cab-e220ad97578d 1073741824
Jul 30 20:38:17 devstack sudo[105904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:38:17 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-68f2a09f-2b1e-4c29-9c35-c92268cb2cf5 tempest-CreateVolumesFromImageTest-1067456586 None] Volume volume-a5578d25-d4a3-4350-b8f4-d14cad2ba434 (a5578d25-d4a3-4350-b8f4-d14cad2ba434): created successfully
Jul 30 20:38:17 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-68f2a09f-2b1e-4c29-9c35-c92268cb2cf5 tempest-CreateVolumesFromImageTest-1067456586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d029812a-80b4-408f-8352-86eb9fe8954b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:38:17 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-68f2a09f-2b1e-4c29-9c35-c92268cb2cf5 tempest-CreateVolumesFromImageTest-1067456586 None] Flow 'volume_create_manager' (3394520f-2c5e-41d7-a1f5-e55f936eb85d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:38:17 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-68f2a09f-2b1e-4c29-9c35-c92268cb2cf5 tempest-CreateVolumesFromImageTest-1067456586 None] Created volume successfully.
Jul 30 20:38:17 devstack sudo[105904]: pam_unix(sudo:session): session closed for user root
Jul 30 20:38:17 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-fe48693f-88e0-483e-8cf5-51964b8fc22b tempest-CreateVolumesFromImageTest-1067456586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-8274b9b2-04ec-4049-8cab-e220ad97578d 1073741824" returned: 0 in 0.467s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:38:17 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-fe48693f-88e0-483e-8cf5-51964b8fc22b tempest-CreateVolumesFromImageTest-1067456586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-8274b9b2-04ec-4049-8cab-e220ad97578d {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:38:17 devstack sudo[105910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-8274b9b2-04ec-4049-8cab-e220ad97578d
Jul 30 20:38:17 devstack sudo[105910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:38:17 devstack sudo[105910]: pam_unix(sudo:session): session closed for user root
Jul 30 20:38:17 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-fe48693f-88e0-483e-8cf5-51964b8fc22b tempest-CreateVolumesFromImageTest-1067456586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-8274b9b2-04ec-4049-8cab-e220ad97578d" returned: 0 in 0.249s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:38:17 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-fe48693f-88e0-483e-8cf5-51964b8fc22b tempest-CreateVolumesFromImageTest-1067456586 None] <== create_volume: return (755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:38:17 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-fe48693f-88e0-483e-8cf5-51964b8fc22b tempest-CreateVolumesFromImageTest-1067456586 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.759s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:38:17 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-a4991756-2971-4c3e-b40e-dd828214e389 tempest-SnapshotDependencyTests-62616082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.008s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:38:17 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-fe48693f-88e0-483e-8cf5-51964b8fc22b tempest-CreateVolumesFromImageTest-1067456586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38022236-9c8f-4c12-a94c-a02976b623bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8274b9b2-04ec-4049-8cab-e220ad97578d', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:38:17 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-fe48693f-88e0-483e-8cf5-51964b8fc22b tempest-CreateVolumesFromImageTest-1067456586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6817c86a-8bd3-4f08-abba-ba81a1377b06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:38:17 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-a4991756-2971-4c3e-b40e-dd828214e389 tempest-SnapshotDependencyTests-62616082 None] Creating offline snapshot e3dc2953-e7cc-490c-a79c-f4ec41c8c67a of volume 5a812e93-f298-4daa-b5ac-406db337cdb6 {{(pid=88719) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 30 20:38:17 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-fe48693f-88e0-483e-8cf5-51964b8fc22b tempest-CreateVolumesFromImageTest-1067456586 None] Volume volume-8274b9b2-04ec-4049-8cab-e220ad97578d (8274b9b2-04ec-4049-8cab-e220ad97578d): created successfully
Jul 30 20:38:17 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-fe48693f-88e0-483e-8cf5-51964b8fc22b tempest-CreateVolumesFromImageTest-1067456586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6817c86a-8bd3-4f08-abba-ba81a1377b06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:38:17 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-fe48693f-88e0-483e-8cf5-51964b8fc22b tempest-CreateVolumesFromImageTest-1067456586 None] Flow 'volume_create_manager' (ecb49ea1-3292-4390-9568-1865e41ccf50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:38:17 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[322196d8-c382-4cda-af61-136acaf5004f]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:38:17 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-a4991756-2971-4c3e-b40e-dd828214e389 tempest-SnapshotDependencyTests-62616082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5a812e93-f298-4daa-b5ac-406db337cdb6 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:38:17 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-fe48693f-88e0-483e-8cf5-51964b8fc22b tempest-CreateVolumesFromImageTest-1067456586 None] Created volume successfully.
Jul 30 20:38:17 devstack sudo[105914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5a812e93-f298-4daa-b5ac-406db337cdb6
Jul 30 20:38:17 devstack sudo[105914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:38:18 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-51e2ee35-1a7d-45e1-aa6a-1078430a8581 tempest-CreateVolumesFromImageTest-1067456586 None] Acquiring lock "cinder-8274b9b2-04ec-4049-8cab-e220ad97578d-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:38:18 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-51e2ee35-1a7d-45e1-aa6a-1078430a8581 tempest-CreateVolumesFromImageTest-1067456586 None] Lock "cinder-8274b9b2-04ec-4049-8cab-e220ad97578d-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:38:18 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-51e2ee35-1a7d-45e1-aa6a-1078430a8581 tempest-CreateVolumesFromImageTest-1067456586 None] Acquiring lock "cinder-quobyte-8274b9b2-04ec-4049-8cab-e220ad97578d" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:38:18 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-51e2ee35-1a7d-45e1-aa6a-1078430a8581 tempest-CreateVolumesFromImageTest-1067456586 None] Lock "cinder-quobyte-8274b9b2-04ec-4049-8cab-e220ad97578d" acquired by "delete_volume" :: waited 0.020s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:38:18 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb9f3307-284d-4b27-919b-21341215bb6d]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:38:18 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-51e2ee35-1a7d-45e1-aa6a-1078430a8581 tempest-CreateVolumesFromImageTest-1067456586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-8274b9b2-04ec-4049-8cab-e220ad97578d {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:38:18 devstack sudo[105914]: pam_unix(sudo:session): session closed for user root
Jul 30 20:38:18 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-a4991756-2971-4c3e-b40e-dd828214e389 tempest-SnapshotDependencyTests-62616082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5a812e93-f298-4daa-b5ac-406db337cdb6" returned: 0 in 0.515s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:38:18 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-a4991756-2971-4c3e-b40e-dd828214e389 tempest-SnapshotDependencyTests-62616082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5a812e93-f298-4daa-b5ac-406db337cdb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5a812e93-f298-4daa-b5ac-406db337cdb6.e3dc2953-e7cc-490c-a79c-f4ec41c8c67a 1G {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:38:18 devstack sudo[105920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5a812e93-f298-4daa-b5ac-406db337cdb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5a812e93-f298-4daa-b5ac-406db337cdb6.e3dc2953-e7cc-490c-a79c-f4ec41c8c67a 1G
Jul 30 20:38:18 devstack sudo[105920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:38:18 devstack sudo[105917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-8274b9b2-04ec-4049-8cab-e220ad97578d
Jul 30 20:38:18 devstack sudo[105917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:38:18 devstack sudo[105917]: pam_unix(sudo:session): session closed for user root
Jul 30 20:38:18 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-51e2ee35-1a7d-45e1-aa6a-1078430a8581 tempest-CreateVolumesFromImageTest-1067456586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-8274b9b2-04ec-4049-8cab-e220ad97578d" returned: 0 in 0.417s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:38:18 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-51e2ee35-1a7d-45e1-aa6a-1078430a8581 tempest-CreateVolumesFromImageTest-1067456586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-8274b9b2-04ec-4049-8cab-e220ad97578d {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:38:18 devstack sudo[105930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-8274b9b2-04ec-4049-8cab-e220ad97578d
Jul 30 20:38:18 devstack sudo[105930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:38:18 devstack sudo[105920]: pam_unix(sudo:session): session closed for user root
Jul 30 20:38:18 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-a4991756-2971-4c3e-b40e-dd828214e389 tempest-SnapshotDependencyTests-62616082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5a812e93-f298-4daa-b5ac-406db337cdb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5a812e93-f298-4daa-b5ac-406db337cdb6.e3dc2953-e7cc-490c-a79c-f4ec41c8c67a 1G" returned: 0 in 0.442s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:38:18 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-a4991756-2971-4c3e-b40e-dd828214e389 tempest-SnapshotDependencyTests-62616082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a812e93-f298-4daa-b5ac-406db337cdb6 -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5a812e93-f298-4daa-b5ac-406db337cdb6.e3dc2953-e7cc-490c-a79c-f4ec41c8c67a {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:38:18 devstack sudo[105933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a812e93-f298-4daa-b5ac-406db337cdb6 -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5a812e93-f298-4daa-b5ac-406db337cdb6.e3dc2953-e7cc-490c-a79c-f4ec41c8c67a
Jul 30 20:38:18 devstack sudo[105933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:38:18 devstack sudo[105930]: pam_unix(sudo:session): session closed for user root
Jul 30 20:38:18 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-51e2ee35-1a7d-45e1-aa6a-1078430a8581 tempest-CreateVolumesFromImageTest-1067456586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-8274b9b2-04ec-4049-8cab-e220ad97578d" returned: 0 in 0.271s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:38:18 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-51e2ee35-1a7d-45e1-aa6a-1078430a8581 tempest-CreateVolumesFromImageTest-1067456586 None] Lock "cinder-quobyte-8274b9b2-04ec-4049-8cab-e220ad97578d" released by "delete_volume" :: held 0.773s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:38:19 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-51e2ee35-1a7d-45e1-aa6a-1078430a8581 tempest-CreateVolumesFromImageTest-1067456586 None] Created reservations ['fc1d9007-8696-478f-ab7f-8a50f21bd831', '04494d07-1ca2-42b5-97f7-7be7558bb752', '67d7d467-6ac6-4ed6-96b5-d036389b2dce', 'c8b661b1-c134-4df4-a059-de16fe8816f3'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:38:19 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-51e2ee35-1a7d-45e1-aa6a-1078430a8581 tempest-CreateVolumesFromImageTest-1067456586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:38:19 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-51e2ee35-1a7d-45e1-aa6a-1078430a8581 tempest-CreateVolumesFromImageTest-1067456586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:38:19 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-51e2ee35-1a7d-45e1-aa6a-1078430a8581 tempest-CreateVolumesFromImageTest-1067456586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:38:19 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-51e2ee35-1a7d-45e1-aa6a-1078430a8581 tempest-CreateVolumesFromImageTest-1067456586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:38:19 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-51e2ee35-1a7d-45e1-aa6a-1078430a8581 tempest-CreateVolumesFromImageTest-1067456586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:38:19 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-51e2ee35-1a7d-45e1-aa6a-1078430a8581 tempest-CreateVolumesFromImageTest-1067456586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:38:19 devstack sudo[105933]: pam_unix(sudo:session): session closed for user root
Jul 30 20:38:19 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-a4991756-2971-4c3e-b40e-dd828214e389 tempest-SnapshotDependencyTests-62616082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a812e93-f298-4daa-b5ac-406db337cdb6 -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5a812e93-f298-4daa-b5ac-406db337cdb6.e3dc2953-e7cc-490c-a79c-f4ec41c8c67a" returned: 0 in 0.371s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:38:19 devstack cinder-volume[88719]: WARNING cinder.volume.drivers.remotefs [None req-a4991756-2971-4c3e-b40e-dd828214e389 tempest-SnapshotDependencyTests-62616082 None] /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5a812e93-f298-4daa-b5ac-406db337cdb6.e3dc2953-e7cc-490c-a79c-f4ec41c8c67a is being set with open permissions: ugo+rw
Jul 30 20:38:19 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-a4991756-2971-4c3e-b40e-dd828214e389 tempest-SnapshotDependencyTests-62616082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5a812e93-f298-4daa-b5ac-406db337cdb6.e3dc2953-e7cc-490c-a79c-f4ec41c8c67a {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:38:19 devstack sudo[105940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:38:19 devstack sudo[105940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:38:19 devstack sudo[105941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5a812e93-f298-4daa-b5ac-406db337cdb6.e3dc2953-e7cc-490c-a79c-f4ec41c8c67a
Jul 30 20:38:19 devstack sudo[105941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:38:19 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-2daeadb4-efc6-4045-a18d-e2bc7b2c0c12 tempest-CreateVolumesFromImageTest-1067456586 None] Acquiring lock "cinder-a5578d25-d4a3-4350-b8f4-d14cad2ba434-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:38:19 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-2daeadb4-efc6-4045-a18d-e2bc7b2c0c12 tempest-CreateVolumesFromImageTest-1067456586 None] Lock "cinder-a5578d25-d4a3-4350-b8f4-d14cad2ba434-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:38:19 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-2daeadb4-efc6-4045-a18d-e2bc7b2c0c12 tempest-CreateVolumesFromImageTest-1067456586 None] Acquiring lock "cinder-quobyte-a5578d25-d4a3-4350-b8f4-d14cad2ba434" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:38:19 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-2daeadb4-efc6-4045-a18d-e2bc7b2c0c12 tempest-CreateVolumesFromImageTest-1067456586 None] Lock "cinder-quobyte-a5578d25-d4a3-4350-b8f4-d14cad2ba434" acquired by "delete_volume" :: waited 0.027s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:38:19 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b141c21-e709-486a-9ee5-d0029070aa3c]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:38:19 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2daeadb4-efc6-4045-a18d-e2bc7b2c0c12 tempest-CreateVolumesFromImageTest-1067456586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-a5578d25-d4a3-4350-b8f4-d14cad2ba434 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:38:19 devstack sudo[105940]: pam_unix(sudo:session): session closed for user root
Jul 30 20:38:19 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-51e2ee35-1a7d-45e1-aa6a-1078430a8581 tempest-CreateVolumesFromImageTest-1067456586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.408s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:38:19 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-51e2ee35-1a7d-45e1-aa6a-1078430a8581 tempest-CreateVolumesFromImageTest-1067456586 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:38:19 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-51e2ee35-1a7d-45e1-aa6a-1078430a8581 tempest-CreateVolumesFromImageTest-1067456586 None] Deleted volume successfully.
Jul 30 20:38:19 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-51e2ee35-1a7d-45e1-aa6a-1078430a8581 tempest-CreateVolumesFromImageTest-1067456586 None] Lock "cinder-8274b9b2-04ec-4049-8cab-e220ad97578d-delete_volume" released by "delete_volume" :: held 1.496s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:38:19 devstack sudo[105941]: pam_unix(sudo:session): session closed for user root
Jul 30 20:38:19 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-a4991756-2971-4c3e-b40e-dd828214e389 tempest-SnapshotDependencyTests-62616082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5a812e93-f298-4daa-b5ac-406db337cdb6.e3dc2953-e7cc-490c-a79c-f4ec41c8c67a" returned: 0 in 0.445s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:38:19 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-a4991756-2971-4c3e-b40e-dd828214e389 tempest-SnapshotDependencyTests-62616082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5a812e93-f298-4daa-b5ac-406db337cdb6.info {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:38:19 devstack sudo[105946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-a5578d25-d4a3-4350-b8f4-d14cad2ba434
Jul 30 20:38:19 devstack sudo[105946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:38:19 devstack sudo[105947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5a812e93-f298-4daa-b5ac-406db337cdb6.info
Jul 30 20:38:19 devstack sudo[105947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:38:19 devstack sudo[105947]: pam_unix(sudo:session): session closed for user root
Jul 30 20:38:19 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-a4991756-2971-4c3e-b40e-dd828214e389 tempest-SnapshotDependencyTests-62616082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5a812e93-f298-4daa-b5ac-406db337cdb6.info" returned: 0 in 0.276s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:38:19 devstack cinder-volume[88719]: WARNING cinder.volume.drivers.remotefs [None req-a4991756-2971-4c3e-b40e-dd828214e389 tempest-SnapshotDependencyTests-62616082 None] /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5a812e93-f298-4daa-b5ac-406db337cdb6.info is being set with open permissions: ugo+rw
Jul 30 20:38:19 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-a4991756-2971-4c3e-b40e-dd828214e389 tempest-SnapshotDependencyTests-62616082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5a812e93-f298-4daa-b5ac-406db337cdb6.info {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:38:19 devstack sudo[105955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5a812e93-f298-4daa-b5ac-406db337cdb6.info
Jul 30 20:38:19 devstack sudo[105955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:38:19 devstack sudo[105946]: pam_unix(sudo:session): session closed for user root
Jul 30 20:38:19 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2daeadb4-efc6-4045-a18d-e2bc7b2c0c12 tempest-CreateVolumesFromImageTest-1067456586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-a5578d25-d4a3-4350-b8f4-d14cad2ba434" returned: 0 in 0.495s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:38:19 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2daeadb4-efc6-4045-a18d-e2bc7b2c0c12 tempest-CreateVolumesFromImageTest-1067456586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-a5578d25-d4a3-4350-b8f4-d14cad2ba434 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:38:19 devstack sudo[105957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-a5578d25-d4a3-4350-b8f4-d14cad2ba434
Jul 30 20:38:19 devstack sudo[105957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:38:20 devstack sudo[105955]: pam_unix(sudo:session): session closed for user root
Jul 30 20:38:20 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-a4991756-2971-4c3e-b40e-dd828214e389 tempest-SnapshotDependencyTests-62616082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5a812e93-f298-4daa-b5ac-406db337cdb6.info" returned: 0 in 0.261s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:38:20 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-a4991756-2971-4c3e-b40e-dd828214e389 tempest-SnapshotDependencyTests-62616082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.446s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:38:20 devstack sudo[105957]: pam_unix(sudo:session): session closed for user root
Jul 30 20:38:20 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-a4991756-2971-4c3e-b40e-dd828214e389 tempest-SnapshotDependencyTests-62616082 None] Create snapshot completed successfully
Jul 30 20:38:20 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2daeadb4-efc6-4045-a18d-e2bc7b2c0c12 tempest-CreateVolumesFromImageTest-1067456586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-a5578d25-d4a3-4350-b8f4-d14cad2ba434" returned: 0 in 0.321s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:38:20 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-2daeadb4-efc6-4045-a18d-e2bc7b2c0c12 tempest-CreateVolumesFromImageTest-1067456586 None] Lock "cinder-quobyte-a5578d25-d4a3-4350-b8f4-d14cad2ba434" released by "delete_volume" :: held 0.901s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:38:20 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-2daeadb4-efc6-4045-a18d-e2bc7b2c0c12 tempest-CreateVolumesFromImageTest-1067456586 None] Created reservations ['a7b59df2-8609-4cd4-9bcd-0cbd246c01b0', 'fbe89c24-16f5-4f33-8ad7-37bfdacfe278', '2e80e75a-7c02-4a8e-9a54-ec6fd0997b85', '45d3a02d-5263-4821-9f4c-1bef1f4b9f06'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:38:20 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-2daeadb4-efc6-4045-a18d-e2bc7b2c0c12 tempest-CreateVolumesFromImageTest-1067456586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:38:20 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-2daeadb4-efc6-4045-a18d-e2bc7b2c0c12 tempest-CreateVolumesFromImageTest-1067456586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:38:20 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-2daeadb4-efc6-4045-a18d-e2bc7b2c0c12 tempest-CreateVolumesFromImageTest-1067456586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:38:20 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-2daeadb4-efc6-4045-a18d-e2bc7b2c0c12 tempest-CreateVolumesFromImageTest-1067456586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:38:20 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-2daeadb4-efc6-4045-a18d-e2bc7b2c0c12 tempest-CreateVolumesFromImageTest-1067456586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:38:20 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2daeadb4-efc6-4045-a18d-e2bc7b2c0c12 tempest-CreateVolumesFromImageTest-1067456586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:38:20 devstack sudo[105962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:38:20 devstack sudo[105962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:38:20 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-57a866b3-5b55-428a-8975-fb94c3dda665 tempest-CreateVolumesFromImageTest-1067456586 None] Acquiring lock "cinder-f3aa87b1-567f-441e-86a4-100572cda87c-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:38:20 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-57a866b3-5b55-428a-8975-fb94c3dda665 tempest-CreateVolumesFromImageTest-1067456586 None] Lock "cinder-f3aa87b1-567f-441e-86a4-100572cda87c-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:38:20 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-57a866b3-5b55-428a-8975-fb94c3dda665 tempest-CreateVolumesFromImageTest-1067456586 None] Acquiring lock "cinder-quobyte-f3aa87b1-567f-441e-86a4-100572cda87c" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:38:20 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-57a866b3-5b55-428a-8975-fb94c3dda665 tempest-CreateVolumesFromImageTest-1067456586 None] Lock "cinder-quobyte-f3aa87b1-567f-441e-86a4-100572cda87c" acquired by "delete_volume" :: waited 0.014s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:38:20 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fd2f56f-c0a1-44eb-b62b-93c8af11c63c]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:38:20 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-57a866b3-5b55-428a-8975-fb94c3dda665 tempest-CreateVolumesFromImageTest-1067456586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f3aa87b1-567f-441e-86a4-100572cda87c {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:38:20 devstack sudo[105962]: pam_unix(sudo:session): session closed for user root
Jul 30 20:38:20 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2daeadb4-efc6-4045-a18d-e2bc7b2c0c12 tempest-CreateVolumesFromImageTest-1067456586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.270s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:38:20 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-2daeadb4-efc6-4045-a18d-e2bc7b2c0c12 tempest-CreateVolumesFromImageTest-1067456586 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:38:20 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-2daeadb4-efc6-4045-a18d-e2bc7b2c0c12 tempest-CreateVolumesFromImageTest-1067456586 None] Deleted volume successfully.
Jul 30 20:38:20 devstack sudo[105964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f3aa87b1-567f-441e-86a4-100572cda87c
Jul 30 20:38:20 devstack sudo[105964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:38:20 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-2daeadb4-efc6-4045-a18d-e2bc7b2c0c12 tempest-CreateVolumesFromImageTest-1067456586 None] Lock "cinder-a5578d25-d4a3-4350-b8f4-d14cad2ba434-delete_volume" released by "delete_volume" :: held 1.463s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:38:21 devstack sudo[105964]: pam_unix(sudo:session): session closed for user root
Jul 30 20:38:21 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-57a866b3-5b55-428a-8975-fb94c3dda665 tempest-CreateVolumesFromImageTest-1067456586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f3aa87b1-567f-441e-86a4-100572cda87c" returned: 0 in 0.419s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:38:21 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-57a866b3-5b55-428a-8975-fb94c3dda665 tempest-CreateVolumesFromImageTest-1067456586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f3aa87b1-567f-441e-86a4-100572cda87c {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:38:21 devstack sudo[105970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f3aa87b1-567f-441e-86a4-100572cda87c
Jul 30 20:38:21 devstack sudo[105970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:38:21 devstack sudo[105970]: pam_unix(sudo:session): session closed for user root
Jul 30 20:38:21 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-57a866b3-5b55-428a-8975-fb94c3dda665 tempest-CreateVolumesFromImageTest-1067456586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f3aa87b1-567f-441e-86a4-100572cda87c" returned: 0 in 0.290s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:38:21 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-57a866b3-5b55-428a-8975-fb94c3dda665 tempest-CreateVolumesFromImageTest-1067456586 None] Lock "cinder-quobyte-f3aa87b1-567f-441e-86a4-100572cda87c" released by "delete_volume" :: held 0.758s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:38:21 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-57a866b3-5b55-428a-8975-fb94c3dda665 tempest-CreateVolumesFromImageTest-1067456586 None] Created reservations ['a718e8d3-13fc-48cc-a6bf-fe25c1c31d5e', '98c2b94c-2a4e-42dc-9cad-ae5f5556947c', '90a764b4-10d4-465e-a90f-82233aef68e4', '67528ef0-cdd0-4b88-b16a-47953ab08cdf'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:38:21 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-57a866b3-5b55-428a-8975-fb94c3dda665 tempest-CreateVolumesFromImageTest-1067456586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:38:21 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-57a866b3-5b55-428a-8975-fb94c3dda665 tempest-CreateVolumesFromImageTest-1067456586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:38:21 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-57a866b3-5b55-428a-8975-fb94c3dda665 tempest-CreateVolumesFromImageTest-1067456586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:38:21 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-57a866b3-5b55-428a-8975-fb94c3dda665 tempest-CreateVolumesFromImageTest-1067456586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:38:21 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-57a866b3-5b55-428a-8975-fb94c3dda665 tempest-CreateVolumesFromImageTest-1067456586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:38:21 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-57a866b3-5b55-428a-8975-fb94c3dda665 tempest-CreateVolumesFromImageTest-1067456586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:38:21 devstack sudo[105973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:38:21 devstack sudo[105973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:38:21 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-1b3d72b6-acd4-40e5-8d79-4988fe5cf54a tempest-CreateVolumesFromImageTest-1067456586 None] Acquiring lock "cinder-a433f541-f056-407d-bc0c-2fb761c783d3-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:38:21 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-1b3d72b6-acd4-40e5-8d79-4988fe5cf54a tempest-CreateVolumesFromImageTest-1067456586 None] Lock "cinder-a433f541-f056-407d-bc0c-2fb761c783d3-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:38:21 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-2688179a-ad86-4561-b8aa-b1eec131e97e tempest-SnapshotDependencyTests-62616082 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:38:21 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2688179a-ad86-4561-b8aa-b1eec131e97e tempest-SnapshotDependencyTests-62616082 None] Flow 'volume_create_manager' (f96a9bb8-63db-4c72-931a-56a90487ae10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:38:21 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2688179a-ad86-4561-b8aa-b1eec131e97e tempest-SnapshotDependencyTests-62616082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce0ae45f-e4c7-4e87-93d0-af1aebab683f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:38:21 devstack sudo[105973]: pam_unix(sudo:session): session closed for user root
Jul 30 20:38:21 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-57a866b3-5b55-428a-8975-fb94c3dda665 tempest-CreateVolumesFromImageTest-1067456586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.339s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:38:21 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-57a866b3-5b55-428a-8975-fb94c3dda665 tempest-CreateVolumesFromImageTest-1067456586 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:38:21 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-1b3d72b6-acd4-40e5-8d79-4988fe5cf54a tempest-CreateVolumesFromImageTest-1067456586 None] Acquiring lock "cinder-quobyte-a433f541-f056-407d-bc0c-2fb761c783d3" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:38:21 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2688179a-ad86-4561-b8aa-b1eec131e97e tempest-SnapshotDependencyTests-62616082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce0ae45f-e4c7-4e87-93d0-af1aebab683f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:38:21Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61e4fe85-591d-4319-a9d4-cc9f875801c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba3a86d862b6484bab199516e2e24bd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:38:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e3dc2953-e7cc-490c-a79c-f4ec41c8c67a,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:38:22Z,use_quota=True,user_id='20eb301d6daf4d9e80da835014ec2b9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:38:21 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2688179a-ad86-4561-b8aa-b1eec131e97e tempest-SnapshotDependencyTests-62616082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20c475b1-0470-4c0b-b7da-e44c9da3b859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:38:21 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2688179a-ad86-4561-b8aa-b1eec131e97e tempest-SnapshotDependencyTests-62616082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20c475b1-0470-4c0b-b7da-e44c9da3b859) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:38:21 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2688179a-ad86-4561-b8aa-b1eec131e97e tempest-SnapshotDependencyTests-62616082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04f4d642-6f0f-4202-9062-3d16f8e8ca1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:38:21 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2688179a-ad86-4561-b8aa-b1eec131e97e tempest-SnapshotDependencyTests-62616082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04f4d642-6f0f-4202-9062-3d16f8e8ca1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '61e4fe85-591d-4319-a9d4-cc9f875801c1', 'volume_name': 'volume-61e4fe85-591d-4319-a9d4-cc9f875801c1', 'volume_size': 1, 'snapshot_id': 'e3dc2953-e7cc-490c-a79c-f4ec41c8c67a'}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:38:21 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2688179a-ad86-4561-b8aa-b1eec131e97e tempest-SnapshotDependencyTests-62616082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1729df56-a61f-42ab-a0d8-bfd6a209b23b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:38:21 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2688179a-ad86-4561-b8aa-b1eec131e97e tempest-SnapshotDependencyTests-62616082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1729df56-a61f-42ab-a0d8-bfd6a209b23b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:38:21 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2688179a-ad86-4561-b8aa-b1eec131e97e tempest-SnapshotDependencyTests-62616082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc579dfa-d091-4d84-bd25-605d6e3fd5ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:38:21 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-2688179a-ad86-4561-b8aa-b1eec131e97e tempest-SnapshotDependencyTests-62616082 None] Volume 61e4fe85-591d-4319-a9d4-cc9f875801c1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-61e4fe85-591d-4319-a9d4-cc9f875801c1', 'volume_size': 1, 'snapshot_id': 'e3dc2953-e7cc-490c-a79c-f4ec41c8c67a'}
Jul 30 20:38:21 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-57a866b3-5b55-428a-8975-fb94c3dda665 tempest-CreateVolumesFromImageTest-1067456586 None] Deleted volume successfully.
Jul 30 20:38:21 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-2688179a-ad86-4561-b8aa-b1eec131e97e tempest-SnapshotDependencyTests-62616082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:38:21 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-2688179a-ad86-4561-b8aa-b1eec131e97e tempest-SnapshotDependencyTests-62616082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:38:21 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-2688179a-ad86-4561-b8aa-b1eec131e97e tempest-SnapshotDependencyTests-62616082 None] Acquiring lock "cinder-quobyte-e3dc2953-e7cc-490c-a79c-f4ec41c8c67a-61e4fe85-591d-4319-a9d4-cc9f875801c1" by "_create_volume_from_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:38:21 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-57a866b3-5b55-428a-8975-fb94c3dda665 tempest-CreateVolumesFromImageTest-1067456586 None] Lock "cinder-f3aa87b1-567f-441e-86a4-100572cda87c-delete_volume" released by "delete_volume" :: held 1.383s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:38:21 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-1b3d72b6-acd4-40e5-8d79-4988fe5cf54a tempest-CreateVolumesFromImageTest-1067456586 None] Lock "cinder-quobyte-a433f541-f056-407d-bc0c-2fb761c783d3" acquired by "delete_volume" :: waited 0.091s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:38:21 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-2688179a-ad86-4561-b8aa-b1eec131e97e tempest-SnapshotDependencyTests-62616082 None] Lock "cinder-quobyte-e3dc2953-e7cc-490c-a79c-f4ec41c8c67a-61e4fe85-591d-4319-a9d4-cc9f875801c1" acquired by "_create_volume_from_snapshot" :: waited 0.046s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:38:21 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-2688179a-ad86-4561-b8aa-b1eec131e97e tempest-SnapshotDependencyTests-62616082 None] Creating volume 61e4fe85-591d-4319-a9d4-cc9f875801c1 from snapshot e3dc2953-e7cc-490c-a79c-f4ec41c8c67a {{(pid=88719) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Jul 30 20:38:21 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-2688179a-ad86-4561-b8aa-b1eec131e97e tempest-SnapshotDependencyTests-62616082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:38:21 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-2688179a-ad86-4561-b8aa-b1eec131e97e tempest-SnapshotDependencyTests-62616082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:38:21 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-2688179a-ad86-4561-b8aa-b1eec131e97e tempest-SnapshotDependencyTests-62616082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:38:21 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-2688179a-ad86-4561-b8aa-b1eec131e97e tempest-SnapshotDependencyTests-62616082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:38:21 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-2688179a-ad86-4561-b8aa-b1eec131e97e tempest-SnapshotDependencyTests-62616082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:38:21 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-2688179a-ad86-4561-b8aa-b1eec131e97e tempest-SnapshotDependencyTests-62616082 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:38:21 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-2688179a-ad86-4561-b8aa-b1eec131e97e tempest-SnapshotDependencyTests-62616082 None] Acquiring lock "cinder-quobyte-61e4fe85-591d-4319-a9d4-cc9f875801c1" by "_copy_volume_from_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:38:21 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[25950bf0-e46c-403b-b696-d2613c675150]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:38:21 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-1b3d72b6-acd4-40e5-8d79-4988fe5cf54a tempest-CreateVolumesFromImageTest-1067456586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-a433f541-f056-407d-bc0c-2fb761c783d3 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:38:22 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-2688179a-ad86-4561-b8aa-b1eec131e97e tempest-SnapshotDependencyTests-62616082 None] Lock "cinder-quobyte-61e4fe85-591d-4319-a9d4-cc9f875801c1" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:38:22 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-2688179a-ad86-4561-b8aa-b1eec131e97e tempest-SnapshotDependencyTests-62616082 None] snapshot: e3dc2953-e7cc-490c-a79c-f4ec41c8c67a, volume: 61e4fe85-591d-4319-a9d4-cc9f875801c1,  {{(pid=88719) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}}
Jul 30 20:38:22 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-2688179a-ad86-4561-b8aa-b1eec131e97e tempest-SnapshotDependencyTests-62616082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:38:22 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-2688179a-ad86-4561-b8aa-b1eec131e97e tempest-SnapshotDependencyTests-62616082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:38:22 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-2688179a-ad86-4561-b8aa-b1eec131e97e tempest-SnapshotDependencyTests-62616082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:38:22 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-2688179a-ad86-4561-b8aa-b1eec131e97e tempest-SnapshotDependencyTests-62616082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:38:22 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-2688179a-ad86-4561-b8aa-b1eec131e97e tempest-SnapshotDependencyTests-62616082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:38:22 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e09b4cf-5d47-4da1-9da6-51bc8f148d8f]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:38:22 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2688179a-ad86-4561-b8aa-b1eec131e97e tempest-SnapshotDependencyTests-62616082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5a812e93-f298-4daa-b5ac-406db337cdb6.e3dc2953-e7cc-490c-a79c-f4ec41c8c67a {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:38:22 devstack sudo[105976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-a433f541-f056-407d-bc0c-2fb761c783d3
Jul 30 20:38:22 devstack sudo[105976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:38:22 devstack sudo[105977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5a812e93-f298-4daa-b5ac-406db337cdb6.e3dc2953-e7cc-490c-a79c-f4ec41c8c67a
Jul 30 20:38:22 devstack sudo[105977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:38:22 devstack sudo[105976]: pam_unix(sudo:session): session closed for user root
Jul 30 20:38:22 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-1b3d72b6-acd4-40e5-8d79-4988fe5cf54a tempest-CreateVolumesFromImageTest-1067456586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-a433f541-f056-407d-bc0c-2fb761c783d3" returned: 0 in 0.450s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:38:22 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-1b3d72b6-acd4-40e5-8d79-4988fe5cf54a tempest-CreateVolumesFromImageTest-1067456586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-a433f541-f056-407d-bc0c-2fb761c783d3 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:38:22 devstack sudo[105977]: pam_unix(sudo:session): session closed for user root
Jul 30 20:38:22 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2688179a-ad86-4561-b8aa-b1eec131e97e tempest-SnapshotDependencyTests-62616082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5a812e93-f298-4daa-b5ac-406db337cdb6.e3dc2953-e7cc-490c-a79c-f4ec41c8c67a" returned: 0 in 0.393s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:38:22 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-2688179a-ad86-4561-b8aa-b1eec131e97e tempest-SnapshotDependencyTests-62616082 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5a812e93-f298-4daa-b5ac-406db337cdb6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88719) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 30 20:38:22 devstack sudo[105986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-a433f541-f056-407d-bc0c-2fb761c783d3
Jul 30 20:38:22 devstack sudo[105986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:38:22 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[a989a3c7-2b50-4169-8b00-0ab08af1a868]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:38:22 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2688179a-ad86-4561-b8aa-b1eec131e97e tempest-SnapshotDependencyTests-62616082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5a812e93-f298-4daa-b5ac-406db337cdb6 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:38:22 devstack sudo[105988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5a812e93-f298-4daa-b5ac-406db337cdb6
Jul 30 20:38:22 devstack sudo[105988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:38:22 devstack sudo[105986]: pam_unix(sudo:session): session closed for user root
Jul 30 20:38:22 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-1b3d72b6-acd4-40e5-8d79-4988fe5cf54a tempest-CreateVolumesFromImageTest-1067456586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-a433f541-f056-407d-bc0c-2fb761c783d3" returned: 0 in 0.287s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:38:22 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-1b3d72b6-acd4-40e5-8d79-4988fe5cf54a tempest-CreateVolumesFromImageTest-1067456586 None] Lock "cinder-quobyte-a433f541-f056-407d-bc0c-2fb761c783d3" released by "delete_volume" :: held 0.791s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:38:22 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-1b3d72b6-acd4-40e5-8d79-4988fe5cf54a tempest-CreateVolumesFromImageTest-1067456586 None] Created reservations ['19b3e66d-43df-4e24-a745-0df115fab02f', '9ad757df-a34c-41f8-a058-5e745467e68a', 'c001da68-6bd0-4cb5-9ccc-4559f513b226', '0bbf9702-2566-4568-9966-3744bcb37ae0'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:38:22 devstack sudo[105988]: pam_unix(sudo:session): session closed for user root
Jul 30 20:38:22 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2688179a-ad86-4561-b8aa-b1eec131e97e tempest-SnapshotDependencyTests-62616082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5a812e93-f298-4daa-b5ac-406db337cdb6" returned: 0 in 0.405s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:38:22 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-2688179a-ad86-4561-b8aa-b1eec131e97e tempest-SnapshotDependencyTests-62616082 None] will copy from snapshot at /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5a812e93-f298-4daa-b5ac-406db337cdb6 {{(pid=88719) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}}
Jul 30 20:38:22 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-2688179a-ad86-4561-b8aa-b1eec131e97e tempest-SnapshotDependencyTests-62616082 None] Creating direct copy from snapshot {{(pid=88719) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}}
Jul 30 20:38:22 devstack cinder-volume[88719]: DEBUG cinder.utils [None req-2688179a-ad86-4561-b8aa-b1eec131e97e tempest-SnapshotDependencyTests-62616082 None] Path /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-61e4fe85-591d-4319-a9d4-cc9f875801c1 not found in is_blk_device check {{(pid=88719) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 30 20:38:22 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2688179a-ad86-4561-b8aa-b1eec131e97e tempest-SnapshotDependencyTests-62616082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5a812e93-f298-4daa-b5ac-406db337cdb6 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-61e4fe85-591d-4319-a9d4-cc9f875801c1 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:38:22 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-1b3d72b6-acd4-40e5-8d79-4988fe5cf54a tempest-CreateVolumesFromImageTest-1067456586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:38:22 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-1b3d72b6-acd4-40e5-8d79-4988fe5cf54a tempest-CreateVolumesFromImageTest-1067456586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:38:22 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-1b3d72b6-acd4-40e5-8d79-4988fe5cf54a tempest-CreateVolumesFromImageTest-1067456586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:38:22 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-1b3d72b6-acd4-40e5-8d79-4988fe5cf54a tempest-CreateVolumesFromImageTest-1067456586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:38:22 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-1b3d72b6-acd4-40e5-8d79-4988fe5cf54a tempest-CreateVolumesFromImageTest-1067456586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:38:22 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-1b3d72b6-acd4-40e5-8d79-4988fe5cf54a tempest-CreateVolumesFromImageTest-1067456586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:38:22 devstack sudo[105994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5a812e93-f298-4daa-b5ac-406db337cdb6 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-61e4fe85-591d-4319-a9d4-cc9f875801c1
Jul 30 20:38:22 devstack sudo[105994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:38:22 devstack sudo[105995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:38:22 devstack sudo[105995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:38:22 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-c074327b-4c94-4a00-90cc-5194b5b946ef tempest-CreateVolumesFromImageTest-1067456586 None] Acquiring lock "cinder-6d625d6a-49b8-4e19-b1df-6d635310e414-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:38:22 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-c074327b-4c94-4a00-90cc-5194b5b946ef tempest-CreateVolumesFromImageTest-1067456586 None] Lock "cinder-6d625d6a-49b8-4e19-b1df-6d635310e414-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:38:23 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-c074327b-4c94-4a00-90cc-5194b5b946ef tempest-CreateVolumesFromImageTest-1067456586 None] Acquiring lock "cinder-quobyte-6d625d6a-49b8-4e19-b1df-6d635310e414" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:38:23 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-c074327b-4c94-4a00-90cc-5194b5b946ef tempest-CreateVolumesFromImageTest-1067456586 None] Lock "cinder-quobyte-6d625d6a-49b8-4e19-b1df-6d635310e414" acquired by "delete_volume" :: waited 0.024s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:38:23 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dc2a91d-2039-4c3f-8816-e773afe8fefc]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:38:23 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-c074327b-4c94-4a00-90cc-5194b5b946ef tempest-CreateVolumesFromImageTest-1067456586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6d625d6a-49b8-4e19-b1df-6d635310e414 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:38:23 devstack sudo[105995]: pam_unix(sudo:session): session closed for user root
Jul 30 20:38:23 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-1b3d72b6-acd4-40e5-8d79-4988fe5cf54a tempest-CreateVolumesFromImageTest-1067456586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.305s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:38:23 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-1b3d72b6-acd4-40e5-8d79-4988fe5cf54a tempest-CreateVolumesFromImageTest-1067456586 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:38:23 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-1b3d72b6-acd4-40e5-8d79-4988fe5cf54a tempest-CreateVolumesFromImageTest-1067456586 None] Deleted volume successfully.
Jul 30 20:38:23 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-1b3d72b6-acd4-40e5-8d79-4988fe5cf54a tempest-CreateVolumesFromImageTest-1067456586 None] Lock "cinder-a433f541-f056-407d-bc0c-2fb761c783d3-delete_volume" released by "delete_volume" :: held 1.489s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:38:23 devstack sudo[105999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6d625d6a-49b8-4e19-b1df-6d635310e414
Jul 30 20:38:23 devstack sudo[105999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:38:23 devstack sudo[105999]: pam_unix(sudo:session): session closed for user root
Jul 30 20:38:23 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-c074327b-4c94-4a00-90cc-5194b5b946ef tempest-CreateVolumesFromImageTest-1067456586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6d625d6a-49b8-4e19-b1df-6d635310e414" returned: 0 in 0.596s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:38:23 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-c074327b-4c94-4a00-90cc-5194b5b946ef tempest-CreateVolumesFromImageTest-1067456586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6d625d6a-49b8-4e19-b1df-6d635310e414 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:38:23 devstack sudo[106014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6d625d6a-49b8-4e19-b1df-6d635310e414
Jul 30 20:38:23 devstack sudo[106014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:38:24 devstack sudo[106014]: pam_unix(sudo:session): session closed for user root
Jul 30 20:38:24 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-c074327b-4c94-4a00-90cc-5194b5b946ef tempest-CreateVolumesFromImageTest-1067456586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6d625d6a-49b8-4e19-b1df-6d635310e414" returned: 0 in 0.664s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:38:24 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-c074327b-4c94-4a00-90cc-5194b5b946ef tempest-CreateVolumesFromImageTest-1067456586 None] Lock "cinder-quobyte-6d625d6a-49b8-4e19-b1df-6d635310e414" released by "delete_volume" :: held 1.346s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:38:24 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-c074327b-4c94-4a00-90cc-5194b5b946ef tempest-CreateVolumesFromImageTest-1067456586 None] Created reservations ['ff46965d-df52-491c-a9b1-c36895422532', '17da85c9-05d3-453c-b8cf-85ffa7a2866d', '5b4771f3-83c1-4775-b3d9-d97f8de8e974', '097ec010-9a98-4842-9666-5a8a5b821ade'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:38:24 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-c074327b-4c94-4a00-90cc-5194b5b946ef tempest-CreateVolumesFromImageTest-1067456586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:38:24 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-c074327b-4c94-4a00-90cc-5194b5b946ef tempest-CreateVolumesFromImageTest-1067456586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:38:24 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-c074327b-4c94-4a00-90cc-5194b5b946ef tempest-CreateVolumesFromImageTest-1067456586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:38:24 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-c074327b-4c94-4a00-90cc-5194b5b946ef tempest-CreateVolumesFromImageTest-1067456586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:38:24 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-c074327b-4c94-4a00-90cc-5194b5b946ef tempest-CreateVolumesFromImageTest-1067456586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:38:24 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-c074327b-4c94-4a00-90cc-5194b5b946ef tempest-CreateVolumesFromImageTest-1067456586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:38:24 devstack sudo[106018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:38:24 devstack sudo[106018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:38:25 devstack sudo[106018]: pam_unix(sudo:session): session closed for user root
Jul 30 20:38:25 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-c074327b-4c94-4a00-90cc-5194b5b946ef tempest-CreateVolumesFromImageTest-1067456586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.650s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:38:25 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-c074327b-4c94-4a00-90cc-5194b5b946ef tempest-CreateVolumesFromImageTest-1067456586 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:38:25 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-c074327b-4c94-4a00-90cc-5194b5b946ef tempest-CreateVolumesFromImageTest-1067456586 None] Deleted volume successfully.
Jul 30 20:38:25 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-c074327b-4c94-4a00-90cc-5194b5b946ef tempest-CreateVolumesFromImageTest-1067456586 None] Lock "cinder-6d625d6a-49b8-4e19-b1df-6d635310e414-delete_volume" released by "delete_volume" :: held 2.519s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:38:28 devstack sudo[105994]: pam_unix(sudo:session): session closed for user root
Jul 30 20:38:28 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2688179a-ad86-4561-b8aa-b1eec131e97e tempest-SnapshotDependencyTests-62616082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5a812e93-f298-4daa-b5ac-406db337cdb6 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-61e4fe85-591d-4319-a9d4-cc9f875801c1" returned: 0 in 5.690s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:38:28 devstack cinder-volume[88719]: DEBUG cinder.image.image_utils [None req-2688179a-ad86-4561-b8aa-b1eec131e97e tempest-SnapshotDependencyTests-62616082 None] Image conversion details: src /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5a812e93-f298-4daa-b5ac-406db337cdb6, size 1024.00 MB, duration 5.69 sec, destination /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-61e4fe85-591d-4319-a9d4-cc9f875801c1 {{(pid=88719) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 30 20:38:28 devstack cinder-volume[88719]: INFO cinder.image.image_utils [None req-2688179a-ad86-4561-b8aa-b1eec131e97e tempest-SnapshotDependencyTests-62616082 None] Converted 1024.00 MB image at 179.92 MB/s
Jul 30 20:38:28 devstack cinder-volume[88719]: WARNING cinder.volume.drivers.remotefs [None req-2688179a-ad86-4561-b8aa-b1eec131e97e tempest-SnapshotDependencyTests-62616082 None] /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-61e4fe85-591d-4319-a9d4-cc9f875801c1 is being set with open permissions: ugo+rw
Jul 30 20:38:28 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2688179a-ad86-4561-b8aa-b1eec131e97e tempest-SnapshotDependencyTests-62616082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-61e4fe85-591d-4319-a9d4-cc9f875801c1 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:38:28 devstack sudo[106022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-61e4fe85-591d-4319-a9d4-cc9f875801c1
Jul 30 20:38:28 devstack sudo[106022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:38:28 devstack sudo[106022]: pam_unix(sudo:session): session closed for user root
Jul 30 20:38:28 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2688179a-ad86-4561-b8aa-b1eec131e97e tempest-SnapshotDependencyTests-62616082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-61e4fe85-591d-4319-a9d4-cc9f875801c1" returned: 0 in 0.257s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:38:28 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-2688179a-ad86-4561-b8aa-b1eec131e97e tempest-SnapshotDependencyTests-62616082 None] Lock "cinder-quobyte-61e4fe85-591d-4319-a9d4-cc9f875801c1" released by "_copy_volume_from_snapshot" :: held 6.844s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:38:28 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-2688179a-ad86-4561-b8aa-b1eec131e97e tempest-SnapshotDependencyTests-62616082 None] Lock "cinder-quobyte-e3dc2953-e7cc-490c-a79c-f4ec41c8c67a-61e4fe85-591d-4319-a9d4-cc9f875801c1" released by "_create_volume_from_snapshot" :: held 6.916s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:38:28 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-2688179a-ad86-4561-b8aa-b1eec131e97e tempest-SnapshotDependencyTests-62616082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.964s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:38:28 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2688179a-ad86-4561-b8aa-b1eec131e97e tempest-SnapshotDependencyTests-62616082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc579dfa-d091-4d84-bd25-605d6e3fd5ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61e4fe85-591d-4319-a9d4-cc9f875801c1', 'volume_size': 1, 'snapshot_id': 'e3dc2953-e7cc-490c-a79c-f4ec41c8c67a'}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:38:28 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2688179a-ad86-4561-b8aa-b1eec131e97e tempest-SnapshotDependencyTests-62616082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eebaa087-d7b4-4dd5-9902-fbb41cc437ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:38:28 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-2688179a-ad86-4561-b8aa-b1eec131e97e tempest-SnapshotDependencyTests-62616082 None] Volume volume-61e4fe85-591d-4319-a9d4-cc9f875801c1 (61e4fe85-591d-4319-a9d4-cc9f875801c1): created successfully
Jul 30 20:38:28 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2688179a-ad86-4561-b8aa-b1eec131e97e tempest-SnapshotDependencyTests-62616082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eebaa087-d7b4-4dd5-9902-fbb41cc437ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:38:28 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2688179a-ad86-4561-b8aa-b1eec131e97e tempest-SnapshotDependencyTests-62616082 None] Flow 'volume_create_manager' (f96a9bb8-63db-4c72-931a-56a90487ae10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:38:28 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-2688179a-ad86-4561-b8aa-b1eec131e97e tempest-SnapshotDependencyTests-62616082 None] Created volume successfully.
Jul 30 20:38:29 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-8689b8bd-8e37-44dc-9705-de8bede96b39 tempest-SnapshotDependencyTests-62616082 None] Acquiring lock "cinder-e3dc2953-e7cc-490c-a79c-f4ec41c8c67a-delete_snapshot" by "delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:38:29 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-8689b8bd-8e37-44dc-9705-de8bede96b39 tempest-SnapshotDependencyTests-62616082 None] Lock "cinder-e3dc2953-e7cc-490c-a79c-f4ec41c8c67a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:38:29 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-8689b8bd-8e37-44dc-9705-de8bede96b39 tempest-SnapshotDependencyTests-62616082 None] Acquiring lock "cinder-quobyte-5a812e93-f298-4daa-b5ac-406db337cdb6" by "delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:38:29 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-8689b8bd-8e37-44dc-9705-de8bede96b39 tempest-SnapshotDependencyTests-62616082 None] Lock "cinder-quobyte-5a812e93-f298-4daa-b5ac-406db337cdb6" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:38:29 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-8689b8bd-8e37-44dc-9705-de8bede96b39 tempest-SnapshotDependencyTests-62616082 None] Acquiring lock "cinder-quobyte-e3dc2953-e7cc-490c-a79c-f4ec41c8c67a" by "_delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:38:29 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-8689b8bd-8e37-44dc-9705-de8bede96b39 tempest-SnapshotDependencyTests-62616082 None] Lock "cinder-quobyte-e3dc2953-e7cc-490c-a79c-f4ec41c8c67a" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:38:29 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-8689b8bd-8e37-44dc-9705-de8bede96b39 tempest-SnapshotDependencyTests-62616082 None] Deleting offline snapshot e3dc2953-e7cc-490c-a79c-f4ec41c8c67a of volume 5a812e93-f298-4daa-b5ac-406db337cdb6 {{(pid=88719) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 30 20:38:29 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-8689b8bd-8e37-44dc-9705-de8bede96b39 tempest-SnapshotDependencyTests-62616082 None] snapshot_file for this snap is: volume-5a812e93-f298-4daa-b5ac-406db337cdb6.e3dc2953-e7cc-490c-a79c-f4ec41c8c67a {{(pid=88719) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 30 20:38:29 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[670b6ad7-6d25-4279-bcc5-422f78435001]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:38:29 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8689b8bd-8e37-44dc-9705-de8bede96b39 tempest-SnapshotDependencyTests-62616082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5a812e93-f298-4daa-b5ac-406db337cdb6.e3dc2953-e7cc-490c-a79c-f4ec41c8c67a {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:38:29 devstack sudo[106025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5a812e93-f298-4daa-b5ac-406db337cdb6.e3dc2953-e7cc-490c-a79c-f4ec41c8c67a
Jul 30 20:38:29 devstack sudo[106025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:38:30 devstack sudo[106025]: pam_unix(sudo:session): session closed for user root
Jul 30 20:38:30 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8689b8bd-8e37-44dc-9705-de8bede96b39 tempest-SnapshotDependencyTests-62616082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5a812e93-f298-4daa-b5ac-406db337cdb6.e3dc2953-e7cc-490c-a79c-f4ec41c8c67a" returned: 0 in 0.511s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:38:30 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-8689b8bd-8e37-44dc-9705-de8bede96b39 tempest-SnapshotDependencyTests-62616082 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5a812e93-f298-4daa-b5ac-406db337cdb6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88719) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 30 20:38:30 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[48aa197a-fdc0-42a1-80bd-ca4d0318719d]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:38:30 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8689b8bd-8e37-44dc-9705-de8bede96b39 tempest-SnapshotDependencyTests-62616082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5a812e93-f298-4daa-b5ac-406db337cdb6 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:38:30 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-bebcf4c0-9662-460a-a59f-226e2b979027 tempest-CreateVolumesFromSnapshotTest-652166221 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:38:30 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-bebcf4c0-9662-460a-a59f-226e2b979027 tempest-CreateVolumesFromSnapshotTest-652166221 None] Flow 'volume_create_manager' (24ded807-26e3-4f19-8e5e-3c416b81d027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:38:30 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-bebcf4c0-9662-460a-a59f-226e2b979027 tempest-CreateVolumesFromSnapshotTest-652166221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0472868-0784-4d9b-bcc1-cd1158f9c429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:38:30 devstack sudo[106030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5a812e93-f298-4daa-b5ac-406db337cdb6
Jul 30 20:38:30 devstack sudo[106030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:38:30 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-bebcf4c0-9662-460a-a59f-226e2b979027 tempest-CreateVolumesFromSnapshotTest-652166221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0472868-0784-4d9b-bcc1-cd1158f9c429) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:38:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-733465402',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e21e34b-c8af-4395-adc2-5baeb0a0daed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='843b20e3780d4308857eef4183fc8403',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:38:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:38:30Z,use_quota=True,user_id='97a0fbca162549c1ac7d9cb299108864',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:38:30 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-bebcf4c0-9662-460a-a59f-226e2b979027 tempest-CreateVolumesFromSnapshotTest-652166221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aef81569-1a06-4333-9976-444f1860b11f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:38:30 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-bebcf4c0-9662-460a-a59f-226e2b979027 tempest-CreateVolumesFromSnapshotTest-652166221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aef81569-1a06-4333-9976-444f1860b11f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:38:30 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-bebcf4c0-9662-460a-a59f-226e2b979027 tempest-CreateVolumesFromSnapshotTest-652166221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bad81b81-d0c3-4832-90da-4e8bc65ab790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:38:30 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-bebcf4c0-9662-460a-a59f-226e2b979027 tempest-CreateVolumesFromSnapshotTest-652166221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bad81b81-d0c3-4832-90da-4e8bc65ab790) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e21e34b-c8af-4395-adc2-5baeb0a0daed', 'volume_name': 'volume-6e21e34b-c8af-4395-adc2-5baeb0a0daed', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:38:30 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-bebcf4c0-9662-460a-a59f-226e2b979027 tempest-CreateVolumesFromSnapshotTest-652166221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afba6255-be6e-4b65-8bc8-94bfe9763d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:38:30 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-bebcf4c0-9662-460a-a59f-226e2b979027 tempest-CreateVolumesFromSnapshotTest-652166221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afba6255-be6e-4b65-8bc8-94bfe9763d76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:38:30 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-bebcf4c0-9662-460a-a59f-226e2b979027 tempest-CreateVolumesFromSnapshotTest-652166221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35910d79-2afa-4848-a279-e5533d4dfd1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:38:30 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-bebcf4c0-9662-460a-a59f-226e2b979027 tempest-CreateVolumesFromSnapshotTest-652166221 None] Volume 6e21e34b-c8af-4395-adc2-5baeb0a0daed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e21e34b-c8af-4395-adc2-5baeb0a0daed', 'volume_size': 1}
Jul 30 20:38:30 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-bebcf4c0-9662-460a-a59f-226e2b979027 tempest-CreateVolumesFromSnapshotTest-652166221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:38:30 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-bebcf4c0-9662-460a-a59f-226e2b979027 tempest-CreateVolumesFromSnapshotTest-652166221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:38:30 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-bebcf4c0-9662-460a-a59f-226e2b979027 tempest-CreateVolumesFromSnapshotTest-652166221 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:38:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-733465402',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e21e34b-c8af-4395-adc2-5baeb0a0daed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='843b20e3780d4308857eef4183fc8403',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:38:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:38:30Z,use_quota=True,user_id='97a0fbca162549c1ac7d9cb299108864',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:38:30 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-bebcf4c0-9662-460a-a59f-226e2b979027 tempest-CreateVolumesFromSnapshotTest-652166221 None] Creating volume 6e21e34b-c8af-4395-adc2-5baeb0a0daed {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:38:30 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-bebcf4c0-9662-460a-a59f-226e2b979027 tempest-CreateVolumesFromSnapshotTest-652166221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:38:30 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-bebcf4c0-9662-460a-a59f-226e2b979027 tempest-CreateVolumesFromSnapshotTest-652166221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:38:30 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-bebcf4c0-9662-460a-a59f-226e2b979027 tempest-CreateVolumesFromSnapshotTest-652166221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:38:30 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-bebcf4c0-9662-460a-a59f-226e2b979027 tempest-CreateVolumesFromSnapshotTest-652166221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:38:30 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-bebcf4c0-9662-460a-a59f-226e2b979027 tempest-CreateVolumesFromSnapshotTest-652166221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:38:30 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-bebcf4c0-9662-460a-a59f-226e2b979027 tempest-CreateVolumesFromSnapshotTest-652166221 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:38:30 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-bebcf4c0-9662-460a-a59f-226e2b979027 tempest-CreateVolumesFromSnapshotTest-652166221 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:38:30 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-bebcf4c0-9662-460a-a59f-226e2b979027 tempest-CreateVolumesFromSnapshotTest-652166221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6e21e34b-c8af-4395-adc2-5baeb0a0daed 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:38:30 devstack sudo[106032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6e21e34b-c8af-4395-adc2-5baeb0a0daed 1073741824
Jul 30 20:38:30 devstack sudo[106032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:38:30 devstack sudo[106030]: pam_unix(sudo:session): session closed for user root
Jul 30 20:38:30 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8689b8bd-8e37-44dc-9705-de8bede96b39 tempest-SnapshotDependencyTests-62616082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5a812e93-f298-4daa-b5ac-406db337cdb6" returned: 0 in 0.565s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:38:30 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8689b8bd-8e37-44dc-9705-de8bede96b39 tempest-SnapshotDependencyTests-62616082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5a812e93-f298-4daa-b5ac-406db337cdb6.e3dc2953-e7cc-490c-a79c-f4ec41c8c67a {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:38:30 devstack sudo[106041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5a812e93-f298-4daa-b5ac-406db337cdb6.e3dc2953-e7cc-490c-a79c-f4ec41c8c67a
Jul 30 20:38:30 devstack sudo[106041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:38:31 devstack sudo[106032]: pam_unix(sudo:session): session closed for user root
Jul 30 20:38:31 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-bebcf4c0-9662-460a-a59f-226e2b979027 tempest-CreateVolumesFromSnapshotTest-652166221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6e21e34b-c8af-4395-adc2-5baeb0a0daed 1073741824" returned: 0 in 0.500s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:38:31 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-bebcf4c0-9662-460a-a59f-226e2b979027 tempest-CreateVolumesFromSnapshotTest-652166221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6e21e34b-c8af-4395-adc2-5baeb0a0daed {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:38:31 devstack sudo[106043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6e21e34b-c8af-4395-adc2-5baeb0a0daed
Jul 30 20:38:31 devstack sudo[106043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:38:31 devstack sudo[106041]: pam_unix(sudo:session): session closed for user root
Jul 30 20:38:31 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8689b8bd-8e37-44dc-9705-de8bede96b39 tempest-SnapshotDependencyTests-62616082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5a812e93-f298-4daa-b5ac-406db337cdb6.e3dc2953-e7cc-490c-a79c-f4ec41c8c67a" returned: 0 in 0.404s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:38:31 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8689b8bd-8e37-44dc-9705-de8bede96b39 tempest-SnapshotDependencyTests-62616082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5a812e93-f298-4daa-b5ac-406db337cdb6.e3dc2953-e7cc-490c-a79c-f4ec41c8c67a {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:38:31 devstack sudo[106043]: pam_unix(sudo:session): session closed for user root
Jul 30 20:38:31 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-bebcf4c0-9662-460a-a59f-226e2b979027 tempest-CreateVolumesFromSnapshotTest-652166221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6e21e34b-c8af-4395-adc2-5baeb0a0daed" returned: 0 in 0.289s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:38:31 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-bebcf4c0-9662-460a-a59f-226e2b979027 tempest-CreateVolumesFromSnapshotTest-652166221 None] <== create_volume: return (836ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:38:31 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-bebcf4c0-9662-460a-a59f-226e2b979027 tempest-CreateVolumesFromSnapshotTest-652166221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.843s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:38:31 devstack sudo[106050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5a812e93-f298-4daa-b5ac-406db337cdb6.e3dc2953-e7cc-490c-a79c-f4ec41c8c67a
Jul 30 20:38:31 devstack sudo[106050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:38:31 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-bebcf4c0-9662-460a-a59f-226e2b979027 tempest-CreateVolumesFromSnapshotTest-652166221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35910d79-2afa-4848-a279-e5533d4dfd1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e21e34b-c8af-4395-adc2-5baeb0a0daed', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:38:31 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-bebcf4c0-9662-460a-a59f-226e2b979027 tempest-CreateVolumesFromSnapshotTest-652166221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff8fea72-20f8-4096-bc40-0d55cbcb7a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:38:31 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-bebcf4c0-9662-460a-a59f-226e2b979027 tempest-CreateVolumesFromSnapshotTest-652166221 None] Volume volume-6e21e34b-c8af-4395-adc2-5baeb0a0daed (6e21e34b-c8af-4395-adc2-5baeb0a0daed): created successfully
Jul 30 20:38:31 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-bebcf4c0-9662-460a-a59f-226e2b979027 tempest-CreateVolumesFromSnapshotTest-652166221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff8fea72-20f8-4096-bc40-0d55cbcb7a7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:38:31 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-bebcf4c0-9662-460a-a59f-226e2b979027 tempest-CreateVolumesFromSnapshotTest-652166221 None] Flow 'volume_create_manager' (24ded807-26e3-4f19-8e5e-3c416b81d027) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:38:31 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-bebcf4c0-9662-460a-a59f-226e2b979027 tempest-CreateVolumesFromSnapshotTest-652166221 None] Created volume successfully.
Jul 30 20:38:31 devstack sudo[106050]: pam_unix(sudo:session): session closed for user root
Jul 30 20:38:31 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8689b8bd-8e37-44dc-9705-de8bede96b39 tempest-SnapshotDependencyTests-62616082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5a812e93-f298-4daa-b5ac-406db337cdb6.e3dc2953-e7cc-490c-a79c-f4ec41c8c67a" returned: 0 in 0.346s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:38:31 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-8689b8bd-8e37-44dc-9705-de8bede96b39 tempest-SnapshotDependencyTests-62616082 None] Lock "cinder-quobyte-e3dc2953-e7cc-490c-a79c-f4ec41c8c67a" released by "_delete_snapshot" :: held 1.948s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:38:31 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-8689b8bd-8e37-44dc-9705-de8bede96b39 tempest-SnapshotDependencyTests-62616082 None] Lock "cinder-quobyte-5a812e93-f298-4daa-b5ac-406db337cdb6" released by "delete_snapshot" :: held 1.974s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:38:31 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-8689b8bd-8e37-44dc-9705-de8bede96b39 tempest-SnapshotDependencyTests-62616082 None] Created reservations ['9592808e-cb3e-4571-a057-83d8441feef5', '25580b3f-113b-4cb3-9596-86f0195e7dbf', 'b2be104c-5b4c-4943-a511-7f6508e0b443', '1c26cd56-a01f-4461-af0a-a84402cecb33'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:38:31 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-8689b8bd-8e37-44dc-9705-de8bede96b39 tempest-SnapshotDependencyTests-62616082 None] Delete snapshot completed successfully.
Jul 30 20:38:31 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-8689b8bd-8e37-44dc-9705-de8bede96b39 tempest-SnapshotDependencyTests-62616082 None] Lock "cinder-e3dc2953-e7cc-490c-a79c-f4ec41c8c67a-delete_snapshot" released by "delete_snapshot" :: held 2.132s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:38:32 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-41158ada-f3fa-433a-b601-e5f0b57abd40 tempest-CreateVolumesFromSnapshotTest-652166221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:38:32 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-41158ada-f3fa-433a-b601-e5f0b57abd40 tempest-CreateVolumesFromSnapshotTest-652166221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:38:32 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-41158ada-f3fa-433a-b601-e5f0b57abd40 tempest-CreateVolumesFromSnapshotTest-652166221 None] Creating offline snapshot 961d1894-df50-46cc-99a2-b547f1c24a36 of volume 6e21e34b-c8af-4395-adc2-5baeb0a0daed {{(pid=88719) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 30 20:38:32 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[78e56b43-9ce7-4055-bde6-9663eb0e8279]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:38:32 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-41158ada-f3fa-433a-b601-e5f0b57abd40 tempest-CreateVolumesFromSnapshotTest-652166221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6e21e34b-c8af-4395-adc2-5baeb0a0daed {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:38:32 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-cda87ef3-3ec1-4220-9f65-d32cb9cf50bd tempest-SnapshotDependencyTests-62616082 None] Acquiring lock "cinder-5a812e93-f298-4daa-b5ac-406db337cdb6-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:38:32 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-cda87ef3-3ec1-4220-9f65-d32cb9cf50bd tempest-SnapshotDependencyTests-62616082 None] Lock "cinder-5a812e93-f298-4daa-b5ac-406db337cdb6-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:38:32 devstack sudo[106053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6e21e34b-c8af-4395-adc2-5baeb0a0daed
Jul 30 20:38:32 devstack sudo[106053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:38:33 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-cda87ef3-3ec1-4220-9f65-d32cb9cf50bd tempest-SnapshotDependencyTests-62616082 None] Acquiring lock "cinder-quobyte-5a812e93-f298-4daa-b5ac-406db337cdb6" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:38:33 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-cda87ef3-3ec1-4220-9f65-d32cb9cf50bd tempest-SnapshotDependencyTests-62616082 None] Lock "cinder-quobyte-5a812e93-f298-4daa-b5ac-406db337cdb6" acquired by "delete_volume" :: waited 0.025s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:38:33 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[e00e48ea-adcc-43ed-b3e3-779ba918cb39]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:38:33 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-cda87ef3-3ec1-4220-9f65-d32cb9cf50bd tempest-SnapshotDependencyTests-62616082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5a812e93-f298-4daa-b5ac-406db337cdb6 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:38:33 devstack sudo[106055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5a812e93-f298-4daa-b5ac-406db337cdb6
Jul 30 20:38:33 devstack sudo[106055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:38:33 devstack sudo[106053]: pam_unix(sudo:session): session closed for user root
Jul 30 20:38:33 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-41158ada-f3fa-433a-b601-e5f0b57abd40 tempest-CreateVolumesFromSnapshotTest-652166221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6e21e34b-c8af-4395-adc2-5baeb0a0daed" returned: 0 in 0.511s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:38:33 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-41158ada-f3fa-433a-b601-e5f0b57abd40 tempest-CreateVolumesFromSnapshotTest-652166221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6e21e34b-c8af-4395-adc2-5baeb0a0daed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6e21e34b-c8af-4395-adc2-5baeb0a0daed.961d1894-df50-46cc-99a2-b547f1c24a36 1G {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:38:33 devstack sudo[106060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6e21e34b-c8af-4395-adc2-5baeb0a0daed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6e21e34b-c8af-4395-adc2-5baeb0a0daed.961d1894-df50-46cc-99a2-b547f1c24a36 1G
Jul 30 20:38:33 devstack sudo[106060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:38:33 devstack sudo[106055]: pam_unix(sudo:session): session closed for user root
Jul 30 20:38:33 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-cda87ef3-3ec1-4220-9f65-d32cb9cf50bd tempest-SnapshotDependencyTests-62616082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5a812e93-f298-4daa-b5ac-406db337cdb6" returned: 0 in 0.466s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:38:33 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-cda87ef3-3ec1-4220-9f65-d32cb9cf50bd tempest-SnapshotDependencyTests-62616082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5a812e93-f298-4daa-b5ac-406db337cdb6 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:38:33 devstack sudo[106065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5a812e93-f298-4daa-b5ac-406db337cdb6
Jul 30 20:38:33 devstack sudo[106065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:38:33 devstack sudo[106060]: pam_unix(sudo:session): session closed for user root
Jul 30 20:38:33 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-41158ada-f3fa-433a-b601-e5f0b57abd40 tempest-CreateVolumesFromSnapshotTest-652166221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6e21e34b-c8af-4395-adc2-5baeb0a0daed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6e21e34b-c8af-4395-adc2-5baeb0a0daed.961d1894-df50-46cc-99a2-b547f1c24a36 1G" returned: 0 in 0.608s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:38:33 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-41158ada-f3fa-433a-b601-e5f0b57abd40 tempest-CreateVolumesFromSnapshotTest-652166221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e21e34b-c8af-4395-adc2-5baeb0a0daed -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6e21e34b-c8af-4395-adc2-5baeb0a0daed.961d1894-df50-46cc-99a2-b547f1c24a36 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:38:33 devstack sudo[106065]: pam_unix(sudo:session): session closed for user root
Jul 30 20:38:33 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-cda87ef3-3ec1-4220-9f65-d32cb9cf50bd tempest-SnapshotDependencyTests-62616082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5a812e93-f298-4daa-b5ac-406db337cdb6" returned: 0 in 0.393s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:38:33 devstack sudo[106075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e21e34b-c8af-4395-adc2-5baeb0a0daed -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6e21e34b-c8af-4395-adc2-5baeb0a0daed.961d1894-df50-46cc-99a2-b547f1c24a36
Jul 30 20:38:33 devstack sudo[106075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:38:34 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-cda87ef3-3ec1-4220-9f65-d32cb9cf50bd tempest-SnapshotDependencyTests-62616082 None] Lock "cinder-quobyte-5a812e93-f298-4daa-b5ac-406db337cdb6" released by "delete_volume" :: held 0.954s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:38:34 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-cda87ef3-3ec1-4220-9f65-d32cb9cf50bd tempest-SnapshotDependencyTests-62616082 None] Created reservations ['004cc9b1-09fd-42f4-9f13-18ed25922d82', 'eaf01df8-796d-4f8a-af14-d7762d34e029', 'fc0bd45b-8659-4f6f-9aee-5c1846a9848a', '3e42e1d1-86a7-42ee-8fec-25efde7ef99b'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:38:34 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-cda87ef3-3ec1-4220-9f65-d32cb9cf50bd tempest-SnapshotDependencyTests-62616082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:38:34 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-cda87ef3-3ec1-4220-9f65-d32cb9cf50bd tempest-SnapshotDependencyTests-62616082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:38:34 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-cda87ef3-3ec1-4220-9f65-d32cb9cf50bd tempest-SnapshotDependencyTests-62616082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:38:34 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-cda87ef3-3ec1-4220-9f65-d32cb9cf50bd tempest-SnapshotDependencyTests-62616082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:38:34 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-cda87ef3-3ec1-4220-9f65-d32cb9cf50bd tempest-SnapshotDependencyTests-62616082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:38:34 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-cda87ef3-3ec1-4220-9f65-d32cb9cf50bd tempest-SnapshotDependencyTests-62616082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:38:34 devstack sudo[106077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:38:34 devstack sudo[106077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:38:34 devstack sudo[106075]: pam_unix(sudo:session): session closed for user root
Jul 30 20:38:34 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-41158ada-f3fa-433a-b601-e5f0b57abd40 tempest-CreateVolumesFromSnapshotTest-652166221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e21e34b-c8af-4395-adc2-5baeb0a0daed -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6e21e34b-c8af-4395-adc2-5baeb0a0daed.961d1894-df50-46cc-99a2-b547f1c24a36" returned: 0 in 0.413s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:38:34 devstack cinder-volume[88719]: WARNING cinder.volume.drivers.remotefs [None req-41158ada-f3fa-433a-b601-e5f0b57abd40 tempest-CreateVolumesFromSnapshotTest-652166221 None] /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6e21e34b-c8af-4395-adc2-5baeb0a0daed.961d1894-df50-46cc-99a2-b547f1c24a36 is being set with open permissions: ugo+rw
Jul 30 20:38:34 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-41158ada-f3fa-433a-b601-e5f0b57abd40 tempest-CreateVolumesFromSnapshotTest-652166221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6e21e34b-c8af-4395-adc2-5baeb0a0daed.961d1894-df50-46cc-99a2-b547f1c24a36 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:38:34 devstack sudo[106082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6e21e34b-c8af-4395-adc2-5baeb0a0daed.961d1894-df50-46cc-99a2-b547f1c24a36
Jul 30 20:38:34 devstack sudo[106082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:38:34 devstack sudo[106077]: pam_unix(sudo:session): session closed for user root
Jul 30 20:38:34 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-cda87ef3-3ec1-4220-9f65-d32cb9cf50bd tempest-SnapshotDependencyTests-62616082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.324s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:38:34 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-cda87ef3-3ec1-4220-9f65-d32cb9cf50bd tempest-SnapshotDependencyTests-62616082 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:38:34 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-cda87ef3-3ec1-4220-9f65-d32cb9cf50bd tempest-SnapshotDependencyTests-62616082 None] Deleted volume successfully.
Jul 30 20:38:34 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-cda87ef3-3ec1-4220-9f65-d32cb9cf50bd tempest-SnapshotDependencyTests-62616082 None] Lock "cinder-5a812e93-f298-4daa-b5ac-406db337cdb6-delete_volume" released by "delete_volume" :: held 1.587s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:38:34 devstack sudo[106082]: pam_unix(sudo:session): session closed for user root
Jul 30 20:38:34 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-41158ada-f3fa-433a-b601-e5f0b57abd40 tempest-CreateVolumesFromSnapshotTest-652166221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6e21e34b-c8af-4395-adc2-5baeb0a0daed.961d1894-df50-46cc-99a2-b547f1c24a36" returned: 0 in 0.297s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:38:34 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-41158ada-f3fa-433a-b601-e5f0b57abd40 tempest-CreateVolumesFromSnapshotTest-652166221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6e21e34b-c8af-4395-adc2-5baeb0a0daed.info {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:38:34 devstack sudo[106086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6e21e34b-c8af-4395-adc2-5baeb0a0daed.info
Jul 30 20:38:34 devstack sudo[106086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:38:34 devstack sudo[106086]: pam_unix(sudo:session): session closed for user root
Jul 30 20:38:34 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-41158ada-f3fa-433a-b601-e5f0b57abd40 tempest-CreateVolumesFromSnapshotTest-652166221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6e21e34b-c8af-4395-adc2-5baeb0a0daed.info" returned: 0 in 0.275s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:38:34 devstack cinder-volume[88719]: WARNING cinder.volume.drivers.remotefs [None req-41158ada-f3fa-433a-b601-e5f0b57abd40 tempest-CreateVolumesFromSnapshotTest-652166221 None] /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6e21e34b-c8af-4395-adc2-5baeb0a0daed.info is being set with open permissions: ugo+rw
Jul 30 20:38:34 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-41158ada-f3fa-433a-b601-e5f0b57abd40 tempest-CreateVolumesFromSnapshotTest-652166221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6e21e34b-c8af-4395-adc2-5baeb0a0daed.info {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:38:35 devstack sudo[106090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6e21e34b-c8af-4395-adc2-5baeb0a0daed.info
Jul 30 20:38:35 devstack sudo[106090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:38:35 devstack sudo[106090]: pam_unix(sudo:session): session closed for user root
Jul 30 20:38:35 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-41158ada-f3fa-433a-b601-e5f0b57abd40 tempest-CreateVolumesFromSnapshotTest-652166221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6e21e34b-c8af-4395-adc2-5baeb0a0daed.info" returned: 0 in 0.252s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:38:35 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-41158ada-f3fa-433a-b601-e5f0b57abd40 tempest-CreateVolumesFromSnapshotTest-652166221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.470s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:38:35 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-060a6608-b71a-4def-bebc-5254848a01cf tempest-SnapshotDependencyTests-62616082 None] Acquiring lock "cinder-61e4fe85-591d-4319-a9d4-cc9f875801c1-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:38:35 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-060a6608-b71a-4def-bebc-5254848a01cf tempest-SnapshotDependencyTests-62616082 None] Lock "cinder-61e4fe85-591d-4319-a9d4-cc9f875801c1-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:38:35 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-41158ada-f3fa-433a-b601-e5f0b57abd40 tempest-CreateVolumesFromSnapshotTest-652166221 None] Create snapshot completed successfully
Jul 30 20:38:35 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-060a6608-b71a-4def-bebc-5254848a01cf tempest-SnapshotDependencyTests-62616082 None] Acquiring lock "cinder-quobyte-61e4fe85-591d-4319-a9d4-cc9f875801c1" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:38:35 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-060a6608-b71a-4def-bebc-5254848a01cf tempest-SnapshotDependencyTests-62616082 None] Lock "cinder-quobyte-61e4fe85-591d-4319-a9d4-cc9f875801c1" acquired by "delete_volume" :: waited 0.016s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:38:35 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[69c0c001-29e9-4eed-bff4-033f31129ca8]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:38:35 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-060a6608-b71a-4def-bebc-5254848a01cf tempest-SnapshotDependencyTests-62616082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-61e4fe85-591d-4319-a9d4-cc9f875801c1 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:38:35 devstack sudo[106094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-61e4fe85-591d-4319-a9d4-cc9f875801c1
Jul 30 20:38:35 devstack sudo[106094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:38:35 devstack sudo[106094]: pam_unix(sudo:session): session closed for user root
Jul 30 20:38:35 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-060a6608-b71a-4def-bebc-5254848a01cf tempest-SnapshotDependencyTests-62616082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-61e4fe85-591d-4319-a9d4-cc9f875801c1" returned: 0 in 0.357s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:38:35 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-060a6608-b71a-4def-bebc-5254848a01cf tempest-SnapshotDependencyTests-62616082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-61e4fe85-591d-4319-a9d4-cc9f875801c1 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:38:35 devstack sudo[106099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-61e4fe85-591d-4319-a9d4-cc9f875801c1
Jul 30 20:38:35 devstack sudo[106099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:38:35 devstack sudo[106099]: pam_unix(sudo:session): session closed for user root
Jul 30 20:38:36 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-060a6608-b71a-4def-bebc-5254848a01cf tempest-SnapshotDependencyTests-62616082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-61e4fe85-591d-4319-a9d4-cc9f875801c1" returned: 0 in 0.270s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:38:36 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-060a6608-b71a-4def-bebc-5254848a01cf tempest-SnapshotDependencyTests-62616082 None] Lock "cinder-quobyte-61e4fe85-591d-4319-a9d4-cc9f875801c1" released by "delete_volume" :: held 0.696s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:38:36 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-060a6608-b71a-4def-bebc-5254848a01cf tempest-SnapshotDependencyTests-62616082 None] Created reservations ['6f6ab3cf-8f2e-4cca-93d6-857d019b913c', 'cb5b2d99-c3b8-4692-b8f6-0ab0ebd6017b', '8fce2998-b1df-4a31-a7e5-cfc27e815ee8', 'ed8711ba-c18d-42a9-9195-dfd04373a0b2'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:38:36 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-060a6608-b71a-4def-bebc-5254848a01cf tempest-SnapshotDependencyTests-62616082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:38:36 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-060a6608-b71a-4def-bebc-5254848a01cf tempest-SnapshotDependencyTests-62616082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:38:36 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-060a6608-b71a-4def-bebc-5254848a01cf tempest-SnapshotDependencyTests-62616082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:38:36 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-060a6608-b71a-4def-bebc-5254848a01cf tempest-SnapshotDependencyTests-62616082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:38:36 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-060a6608-b71a-4def-bebc-5254848a01cf tempest-SnapshotDependencyTests-62616082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:38:36 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-060a6608-b71a-4def-bebc-5254848a01cf tempest-SnapshotDependencyTests-62616082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:38:36 devstack sudo[106102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:38:36 devstack sudo[106102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:38:36 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ea99304-2a6c-40e4-be6d-d0cb2ee0482e tempest-CreateVolumesFromSnapshotTest-652166221 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:38:36 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-0ea99304-2a6c-40e4-be6d-d0cb2ee0482e tempest-CreateVolumesFromSnapshotTest-652166221 None] Flow 'volume_create_manager' (b6d958b6-c35b-4a7d-b7ea-4960d766386b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:38:36 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-0ea99304-2a6c-40e4-be6d-d0cb2ee0482e tempest-CreateVolumesFromSnapshotTest-652166221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4e6d775-c1ee-4870-a484-e7f6df3b4310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:38:36 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-0ea99304-2a6c-40e4-be6d-d0cb2ee0482e tempest-CreateVolumesFromSnapshotTest-652166221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4e6d775-c1ee-4870-a484-e7f6df3b4310) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:38:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-845997144',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2349a94-eafd-49c5-9b63-dc2775dfdc90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='843b20e3780d4308857eef4183fc8403',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:38:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:38:37Z,use_quota=True,user_id='97a0fbca162549c1ac7d9cb299108864',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:38:36 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-0ea99304-2a6c-40e4-be6d-d0cb2ee0482e tempest-CreateVolumesFromSnapshotTest-652166221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fb339da-8c2e-4177-af12-33710e28d6bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:38:36 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-0ea99304-2a6c-40e4-be6d-d0cb2ee0482e tempest-CreateVolumesFromSnapshotTest-652166221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fb339da-8c2e-4177-af12-33710e28d6bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:38:36 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-0ea99304-2a6c-40e4-be6d-d0cb2ee0482e tempest-CreateVolumesFromSnapshotTest-652166221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6b499b7-4960-4bb1-a610-693236ca90d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:38:36 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-0ea99304-2a6c-40e4-be6d-d0cb2ee0482e tempest-CreateVolumesFromSnapshotTest-652166221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6b499b7-4960-4bb1-a610-693236ca90d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2349a94-eafd-49c5-9b63-dc2775dfdc90', 'volume_name': 'volume-e2349a94-eafd-49c5-9b63-dc2775dfdc90', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:38:36 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-0ea99304-2a6c-40e4-be6d-d0cb2ee0482e tempest-CreateVolumesFromSnapshotTest-652166221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e91d507e-a7b0-4103-b70a-5d4adc864c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:38:36 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-0ea99304-2a6c-40e4-be6d-d0cb2ee0482e tempest-CreateVolumesFromSnapshotTest-652166221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e91d507e-a7b0-4103-b70a-5d4adc864c1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:38:36 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-0ea99304-2a6c-40e4-be6d-d0cb2ee0482e tempest-CreateVolumesFromSnapshotTest-652166221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6e33691-5d3f-4e3f-a8b4-3fbdd2379dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:38:36 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-0ea99304-2a6c-40e4-be6d-d0cb2ee0482e tempest-CreateVolumesFromSnapshotTest-652166221 None] Volume e2349a94-eafd-49c5-9b63-dc2775dfdc90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2349a94-eafd-49c5-9b63-dc2775dfdc90', 'volume_size': 1}
Jul 30 20:38:36 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-0ea99304-2a6c-40e4-be6d-d0cb2ee0482e tempest-CreateVolumesFromSnapshotTest-652166221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:38:36 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-0ea99304-2a6c-40e4-be6d-d0cb2ee0482e tempest-CreateVolumesFromSnapshotTest-652166221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:38:36 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-0ea99304-2a6c-40e4-be6d-d0cb2ee0482e tempest-CreateVolumesFromSnapshotTest-652166221 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:38:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-845997144',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2349a94-eafd-49c5-9b63-dc2775dfdc90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='843b20e3780d4308857eef4183fc8403',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:38:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:38:37Z,use_quota=True,user_id='97a0fbca162549c1ac7d9cb299108864',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:38:36 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-0ea99304-2a6c-40e4-be6d-d0cb2ee0482e tempest-CreateVolumesFromSnapshotTest-652166221 None] Creating volume e2349a94-eafd-49c5-9b63-dc2775dfdc90 {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:38:36 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-0ea99304-2a6c-40e4-be6d-d0cb2ee0482e tempest-CreateVolumesFromSnapshotTest-652166221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:38:36 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-0ea99304-2a6c-40e4-be6d-d0cb2ee0482e tempest-CreateVolumesFromSnapshotTest-652166221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:38:36 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-0ea99304-2a6c-40e4-be6d-d0cb2ee0482e tempest-CreateVolumesFromSnapshotTest-652166221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:38:36 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-0ea99304-2a6c-40e4-be6d-d0cb2ee0482e tempest-CreateVolumesFromSnapshotTest-652166221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:38:36 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-0ea99304-2a6c-40e4-be6d-d0cb2ee0482e tempest-CreateVolumesFromSnapshotTest-652166221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:38:36 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-0ea99304-2a6c-40e4-be6d-d0cb2ee0482e tempest-CreateVolumesFromSnapshotTest-652166221 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:38:36 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-0ea99304-2a6c-40e4-be6d-d0cb2ee0482e tempest-CreateVolumesFromSnapshotTest-652166221 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:38:36 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-0ea99304-2a6c-40e4-be6d-d0cb2ee0482e tempest-CreateVolumesFromSnapshotTest-652166221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-e2349a94-eafd-49c5-9b63-dc2775dfdc90 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:38:36 devstack sudo[106105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-e2349a94-eafd-49c5-9b63-dc2775dfdc90 1073741824
Jul 30 20:38:36 devstack sudo[106105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:38:36 devstack sudo[106102]: pam_unix(sudo:session): session closed for user root
Jul 30 20:38:36 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-060a6608-b71a-4def-bebc-5254848a01cf tempest-SnapshotDependencyTests-62616082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.525s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:38:36 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-060a6608-b71a-4def-bebc-5254848a01cf tempest-SnapshotDependencyTests-62616082 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:38:36 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-060a6608-b71a-4def-bebc-5254848a01cf tempest-SnapshotDependencyTests-62616082 None] Deleted volume successfully.
Jul 30 20:38:36 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-060a6608-b71a-4def-bebc-5254848a01cf tempest-SnapshotDependencyTests-62616082 None] Lock "cinder-61e4fe85-591d-4319-a9d4-cc9f875801c1-delete_volume" released by "delete_volume" :: held 1.618s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:38:37 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-e481c217-4516-4725-8ab3-2a2a8aea5787 tempest-CreateVolumesFromSnapshotTest-652166221 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:38:37 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e481c217-4516-4725-8ab3-2a2a8aea5787 tempest-CreateVolumesFromSnapshotTest-652166221 None] Flow 'volume_create_manager' (39c93ff6-e012-4a13-a6f3-b4e084f73259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:38:37 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e481c217-4516-4725-8ab3-2a2a8aea5787 tempest-CreateVolumesFromSnapshotTest-652166221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72927e64-85bf-4d51-9976-e8886758dec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:38:37 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e481c217-4516-4725-8ab3-2a2a8aea5787 tempest-CreateVolumesFromSnapshotTest-652166221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72927e64-85bf-4d51-9976-e8886758dec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:38:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-558040367',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91e3d704-e0e3-407e-9c22-0744ed04a1e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='843b20e3780d4308857eef4183fc8403',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:38:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:38:37Z,use_quota=True,user_id='97a0fbca162549c1ac7d9cb299108864',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:38:37 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e481c217-4516-4725-8ab3-2a2a8aea5787 tempest-CreateVolumesFromSnapshotTest-652166221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dae1698-6848-449b-abf3-77fa694379c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:38:37 devstack sudo[106105]: pam_unix(sudo:session): session closed for user root
Jul 30 20:38:37 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e481c217-4516-4725-8ab3-2a2a8aea5787 tempest-CreateVolumesFromSnapshotTest-652166221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dae1698-6848-449b-abf3-77fa694379c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:38:37 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e481c217-4516-4725-8ab3-2a2a8aea5787 tempest-CreateVolumesFromSnapshotTest-652166221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7d2ef19-b1ce-46f2-8850-9ed08466e38d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:38:37 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e481c217-4516-4725-8ab3-2a2a8aea5787 tempest-CreateVolumesFromSnapshotTest-652166221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7d2ef19-b1ce-46f2-8850-9ed08466e38d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91e3d704-e0e3-407e-9c22-0744ed04a1e9', 'volume_name': 'volume-91e3d704-e0e3-407e-9c22-0744ed04a1e9', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:38:37 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e481c217-4516-4725-8ab3-2a2a8aea5787 tempest-CreateVolumesFromSnapshotTest-652166221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6320db8-d45d-4aa0-89d4-cad75c32d4cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:38:37 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e481c217-4516-4725-8ab3-2a2a8aea5787 tempest-CreateVolumesFromSnapshotTest-652166221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6320db8-d45d-4aa0-89d4-cad75c32d4cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:38:37 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e481c217-4516-4725-8ab3-2a2a8aea5787 tempest-CreateVolumesFromSnapshotTest-652166221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30505970-d207-4da7-9100-26b161b08041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:38:37 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-e481c217-4516-4725-8ab3-2a2a8aea5787 tempest-CreateVolumesFromSnapshotTest-652166221 None] Volume 91e3d704-e0e3-407e-9c22-0744ed04a1e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91e3d704-e0e3-407e-9c22-0744ed04a1e9', 'volume_size': 1}
Jul 30 20:38:37 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-e481c217-4516-4725-8ab3-2a2a8aea5787 tempest-CreateVolumesFromSnapshotTest-652166221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:38:37 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-0ea99304-2a6c-40e4-be6d-d0cb2ee0482e tempest-CreateVolumesFromSnapshotTest-652166221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-e2349a94-eafd-49c5-9b63-dc2775dfdc90 1073741824" returned: 0 in 0.655s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:38:37 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-0ea99304-2a6c-40e4-be6d-d0cb2ee0482e tempest-CreateVolumesFromSnapshotTest-652166221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-e2349a94-eafd-49c5-9b63-dc2775dfdc90 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:38:37 devstack sudo[106111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-e2349a94-eafd-49c5-9b63-dc2775dfdc90
Jul 30 20:38:37 devstack sudo[106111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:38:37 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-f39e7a58-e865-496c-8e82-2eefac032a8e tempest-CreateVolumesFromSnapshotTest-652166221 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:38:37 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-f39e7a58-e865-496c-8e82-2eefac032a8e tempest-CreateVolumesFromSnapshotTest-652166221 None] Flow 'volume_create_manager' (5572f5cf-bc8f-4199-97a3-b7a0c732ba57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:38:37 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-f39e7a58-e865-496c-8e82-2eefac032a8e tempest-CreateVolumesFromSnapshotTest-652166221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (539c9eef-7208-46eb-a5a1-676eb6beea8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:38:37 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-f39e7a58-e865-496c-8e82-2eefac032a8e tempest-CreateVolumesFromSnapshotTest-652166221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (539c9eef-7208-46eb-a5a1-676eb6beea8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:38:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-38415766',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80f57c4c-1396-49f2-8594-d1af83899ab8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='843b20e3780d4308857eef4183fc8403',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:38:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:38:38Z,use_quota=True,user_id='97a0fbca162549c1ac7d9cb299108864',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:38:37 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-f39e7a58-e865-496c-8e82-2eefac032a8e tempest-CreateVolumesFromSnapshotTest-652166221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc5d13b6-0a77-4c39-b263-adde1d3b7d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:38:37 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-f39e7a58-e865-496c-8e82-2eefac032a8e tempest-CreateVolumesFromSnapshotTest-652166221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc5d13b6-0a77-4c39-b263-adde1d3b7d73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:38:37 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-f39e7a58-e865-496c-8e82-2eefac032a8e tempest-CreateVolumesFromSnapshotTest-652166221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (627a050b-4866-4a89-b8c2-e0a470f01a6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:38:37 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-f39e7a58-e865-496c-8e82-2eefac032a8e tempest-CreateVolumesFromSnapshotTest-652166221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (627a050b-4866-4a89-b8c2-e0a470f01a6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80f57c4c-1396-49f2-8594-d1af83899ab8', 'volume_name': 'volume-80f57c4c-1396-49f2-8594-d1af83899ab8', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:38:37 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-f39e7a58-e865-496c-8e82-2eefac032a8e tempest-CreateVolumesFromSnapshotTest-652166221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c79ddebf-6ca6-4107-a14a-83b94afc3724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:38:37 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-f39e7a58-e865-496c-8e82-2eefac032a8e tempest-CreateVolumesFromSnapshotTest-652166221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c79ddebf-6ca6-4107-a14a-83b94afc3724) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:38:37 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-f39e7a58-e865-496c-8e82-2eefac032a8e tempest-CreateVolumesFromSnapshotTest-652166221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3ded672-c9a5-4305-85ba-59a497f153fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:38:37 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-f39e7a58-e865-496c-8e82-2eefac032a8e tempest-CreateVolumesFromSnapshotTest-652166221 None] Volume 80f57c4c-1396-49f2-8594-d1af83899ab8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80f57c4c-1396-49f2-8594-d1af83899ab8', 'volume_size': 1}
Jul 30 20:38:37 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-f39e7a58-e865-496c-8e82-2eefac032a8e tempest-CreateVolumesFromSnapshotTest-652166221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:38:37 devstack sudo[106111]: pam_unix(sudo:session): session closed for user root
Jul 30 20:38:37 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-0ea99304-2a6c-40e4-be6d-d0cb2ee0482e tempest-CreateVolumesFromSnapshotTest-652166221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-e2349a94-eafd-49c5-9b63-dc2775dfdc90" returned: 0 in 0.414s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:38:37 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-0ea99304-2a6c-40e4-be6d-d0cb2ee0482e tempest-CreateVolumesFromSnapshotTest-652166221 None] <== create_volume: return (1137ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:38:37 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-0ea99304-2a6c-40e4-be6d-d0cb2ee0482e tempest-CreateVolumesFromSnapshotTest-652166221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.138s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:38:37 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-e481c217-4516-4725-8ab3-2a2a8aea5787 tempest-CreateVolumesFromSnapshotTest-652166221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.474s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:38:37 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-e481c217-4516-4725-8ab3-2a2a8aea5787 tempest-CreateVolumesFromSnapshotTest-652166221 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:38:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-558040367',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91e3d704-e0e3-407e-9c22-0744ed04a1e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='843b20e3780d4308857eef4183fc8403',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:38:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:38:37Z,use_quota=True,user_id='97a0fbca162549c1ac7d9cb299108864',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:38:37 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-e481c217-4516-4725-8ab3-2a2a8aea5787 tempest-CreateVolumesFromSnapshotTest-652166221 None] Creating volume 91e3d704-e0e3-407e-9c22-0744ed04a1e9 {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:38:37 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-e481c217-4516-4725-8ab3-2a2a8aea5787 tempest-CreateVolumesFromSnapshotTest-652166221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:38:37 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-e481c217-4516-4725-8ab3-2a2a8aea5787 tempest-CreateVolumesFromSnapshotTest-652166221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:38:37 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-e481c217-4516-4725-8ab3-2a2a8aea5787 tempest-CreateVolumesFromSnapshotTest-652166221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:38:37 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-e481c217-4516-4725-8ab3-2a2a8aea5787 tempest-CreateVolumesFromSnapshotTest-652166221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:38:37 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-e481c217-4516-4725-8ab3-2a2a8aea5787 tempest-CreateVolumesFromSnapshotTest-652166221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:38:37 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-e481c217-4516-4725-8ab3-2a2a8aea5787 tempest-CreateVolumesFromSnapshotTest-652166221 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:38:37 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-e481c217-4516-4725-8ab3-2a2a8aea5787 tempest-CreateVolumesFromSnapshotTest-652166221 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:38:37 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-e481c217-4516-4725-8ab3-2a2a8aea5787 tempest-CreateVolumesFromSnapshotTest-652166221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-91e3d704-e0e3-407e-9c22-0744ed04a1e9 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:38:37 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-0ea99304-2a6c-40e4-be6d-d0cb2ee0482e tempest-CreateVolumesFromSnapshotTest-652166221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6e33691-5d3f-4e3f-a8b4-3fbdd2379dd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2349a94-eafd-49c5-9b63-dc2775dfdc90', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:38:37 devstack sudo[106116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-91e3d704-e0e3-407e-9c22-0744ed04a1e9 1073741824
Jul 30 20:38:37 devstack sudo[106116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:38:37 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-0ea99304-2a6c-40e4-be6d-d0cb2ee0482e tempest-CreateVolumesFromSnapshotTest-652166221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1d03c11-9c1f-462f-b82f-b9119beb1b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:38:38 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-0ea99304-2a6c-40e4-be6d-d0cb2ee0482e tempest-CreateVolumesFromSnapshotTest-652166221 None] Volume volume-e2349a94-eafd-49c5-9b63-dc2775dfdc90 (e2349a94-eafd-49c5-9b63-dc2775dfdc90): created successfully
Jul 30 20:38:38 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-0ea99304-2a6c-40e4-be6d-d0cb2ee0482e tempest-CreateVolumesFromSnapshotTest-652166221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1d03c11-9c1f-462f-b82f-b9119beb1b1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:38:38 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-0ea99304-2a6c-40e4-be6d-d0cb2ee0482e tempest-CreateVolumesFromSnapshotTest-652166221 None] Flow 'volume_create_manager' (b6d958b6-c35b-4a7d-b7ea-4960d766386b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:38:38 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-0ea99304-2a6c-40e4-be6d-d0cb2ee0482e tempest-CreateVolumesFromSnapshotTest-652166221 None] Created volume successfully.
Jul 30 20:38:38 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c38748b-613b-4942-a32c-a5991fdeb84f tempest-CreateVolumesFromSnapshotTest-652166221 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:38:38 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-9c38748b-613b-4942-a32c-a5991fdeb84f tempest-CreateVolumesFromSnapshotTest-652166221 None] Flow 'volume_create_manager' (01005053-ebbc-415a-b09a-f59dd1132ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:38:38 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-9c38748b-613b-4942-a32c-a5991fdeb84f tempest-CreateVolumesFromSnapshotTest-652166221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83647a22-dd8d-4504-b884-a8f940c2995e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:38:38 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-9c38748b-613b-4942-a32c-a5991fdeb84f tempest-CreateVolumesFromSnapshotTest-652166221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83647a22-dd8d-4504-b884-a8f940c2995e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:38:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-818596961',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80f9cee5-90a9-415f-8564-543faf77d433,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='843b20e3780d4308857eef4183fc8403',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:38:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:38:38Z,use_quota=True,user_id='97a0fbca162549c1ac7d9cb299108864',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:38:38 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-9c38748b-613b-4942-a32c-a5991fdeb84f tempest-CreateVolumesFromSnapshotTest-652166221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e104a9cd-bd36-4440-a592-48eb91437e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:38:38 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-9c38748b-613b-4942-a32c-a5991fdeb84f tempest-CreateVolumesFromSnapshotTest-652166221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e104a9cd-bd36-4440-a592-48eb91437e6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:38:38 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-9c38748b-613b-4942-a32c-a5991fdeb84f tempest-CreateVolumesFromSnapshotTest-652166221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddc9c85a-d86e-4ba1-80a4-0c5d3d4726f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:38:38 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-9c38748b-613b-4942-a32c-a5991fdeb84f tempest-CreateVolumesFromSnapshotTest-652166221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddc9c85a-d86e-4ba1-80a4-0c5d3d4726f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80f9cee5-90a9-415f-8564-543faf77d433', 'volume_name': 'volume-80f9cee5-90a9-415f-8564-543faf77d433', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:38:38 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-9c38748b-613b-4942-a32c-a5991fdeb84f tempest-CreateVolumesFromSnapshotTest-652166221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (925d1e5a-ec06-4fa3-8660-39e4a2fa60c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:38:38 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-9c38748b-613b-4942-a32c-a5991fdeb84f tempest-CreateVolumesFromSnapshotTest-652166221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (925d1e5a-ec06-4fa3-8660-39e4a2fa60c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:38:38 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-9c38748b-613b-4942-a32c-a5991fdeb84f tempest-CreateVolumesFromSnapshotTest-652166221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7849525f-3c10-4f46-81e0-f803c4ce81c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:38:38 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-9c38748b-613b-4942-a32c-a5991fdeb84f tempest-CreateVolumesFromSnapshotTest-652166221 None] Volume 80f9cee5-90a9-415f-8564-543faf77d433: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80f9cee5-90a9-415f-8564-543faf77d433', 'volume_size': 1}
Jul 30 20:38:38 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-9c38748b-613b-4942-a32c-a5991fdeb84f tempest-CreateVolumesFromSnapshotTest-652166221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:38:38 devstack sudo[106116]: pam_unix(sudo:session): session closed for user root
Jul 30 20:38:38 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-e481c217-4516-4725-8ab3-2a2a8aea5787 tempest-CreateVolumesFromSnapshotTest-652166221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-91e3d704-e0e3-407e-9c22-0744ed04a1e9 1073741824" returned: 0 in 0.674s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:38:38 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-e481c217-4516-4725-8ab3-2a2a8aea5787 tempest-CreateVolumesFromSnapshotTest-652166221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-91e3d704-e0e3-407e-9c22-0744ed04a1e9 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:38:38 devstack sudo[106121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-91e3d704-e0e3-407e-9c22-0744ed04a1e9
Jul 30 20:38:38 devstack sudo[106121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:38:38 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ee27f51-b3bc-444d-95d8-949c0bc24405 tempest-CreateVolumesFromSnapshotTest-652166221 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:38:38 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-3ee27f51-b3bc-444d-95d8-949c0bc24405 tempest-CreateVolumesFromSnapshotTest-652166221 None] Flow 'volume_create_manager' (8891cc16-0cee-4c60-a910-07a6e142484c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:38:38 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-3ee27f51-b3bc-444d-95d8-949c0bc24405 tempest-CreateVolumesFromSnapshotTest-652166221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ec5633f-5572-445e-a4ba-aab2f4abead5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:38:38 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-3ee27f51-b3bc-444d-95d8-949c0bc24405 tempest-CreateVolumesFromSnapshotTest-652166221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ec5633f-5572-445e-a4ba-aab2f4abead5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:38:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-205705135',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3e6d896-6fab-4705-9441-8372e1c4d5c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='843b20e3780d4308857eef4183fc8403',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:38:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:38:39Z,use_quota=True,user_id='97a0fbca162549c1ac7d9cb299108864',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:38:38 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-3ee27f51-b3bc-444d-95d8-949c0bc24405 tempest-CreateVolumesFromSnapshotTest-652166221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df924562-811c-4c28-9513-42c0d26c1c0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:38:39 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-3ee27f51-b3bc-444d-95d8-949c0bc24405 tempest-CreateVolumesFromSnapshotTest-652166221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df924562-811c-4c28-9513-42c0d26c1c0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:38:39 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-3ee27f51-b3bc-444d-95d8-949c0bc24405 tempest-CreateVolumesFromSnapshotTest-652166221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52470c6e-d7da-4cc5-b99c-499feffb8049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:38:39 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-3ee27f51-b3bc-444d-95d8-949c0bc24405 tempest-CreateVolumesFromSnapshotTest-652166221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52470c6e-d7da-4cc5-b99c-499feffb8049) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3e6d896-6fab-4705-9441-8372e1c4d5c7', 'volume_name': 'volume-d3e6d896-6fab-4705-9441-8372e1c4d5c7', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:38:39 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-3ee27f51-b3bc-444d-95d8-949c0bc24405 tempest-CreateVolumesFromSnapshotTest-652166221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ed48ceb-48cd-4521-adb0-a22db2ec25dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:38:39 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-3ee27f51-b3bc-444d-95d8-949c0bc24405 tempest-CreateVolumesFromSnapshotTest-652166221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ed48ceb-48cd-4521-adb0-a22db2ec25dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:38:39 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-3ee27f51-b3bc-444d-95d8-949c0bc24405 tempest-CreateVolumesFromSnapshotTest-652166221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (454e0462-41f2-4576-b436-4cf5d51a166e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:38:39 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-3ee27f51-b3bc-444d-95d8-949c0bc24405 tempest-CreateVolumesFromSnapshotTest-652166221 None] Volume d3e6d896-6fab-4705-9441-8372e1c4d5c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3e6d896-6fab-4705-9441-8372e1c4d5c7', 'volume_size': 1}
Jul 30 20:38:39 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-3ee27f51-b3bc-444d-95d8-949c0bc24405 tempest-CreateVolumesFromSnapshotTest-652166221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:38:39 devstack sudo[106121]: pam_unix(sudo:session): session closed for user root
Jul 30 20:38:39 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-e481c217-4516-4725-8ab3-2a2a8aea5787 tempest-CreateVolumesFromSnapshotTest-652166221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-91e3d704-e0e3-407e-9c22-0744ed04a1e9" returned: 0 in 0.417s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:38:39 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-e481c217-4516-4725-8ab3-2a2a8aea5787 tempest-CreateVolumesFromSnapshotTest-652166221 None] <== create_volume: return (1144ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:38:39 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-e481c217-4516-4725-8ab3-2a2a8aea5787 tempest-CreateVolumesFromSnapshotTest-652166221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.149s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:38:39 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-f39e7a58-e865-496c-8e82-2eefac032a8e tempest-CreateVolumesFromSnapshotTest-652166221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.172s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:38:39 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-f39e7a58-e865-496c-8e82-2eefac032a8e tempest-CreateVolumesFromSnapshotTest-652166221 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:38:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-38415766',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80f57c4c-1396-49f2-8594-d1af83899ab8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='843b20e3780d4308857eef4183fc8403',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:38:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:38:38Z,use_quota=True,user_id='97a0fbca162549c1ac7d9cb299108864',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:38:39 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-f39e7a58-e865-496c-8e82-2eefac032a8e tempest-CreateVolumesFromSnapshotTest-652166221 None] Creating volume 80f57c4c-1396-49f2-8594-d1af83899ab8 {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:38:39 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-f39e7a58-e865-496c-8e82-2eefac032a8e tempest-CreateVolumesFromSnapshotTest-652166221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:38:39 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-f39e7a58-e865-496c-8e82-2eefac032a8e tempest-CreateVolumesFromSnapshotTest-652166221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:38:39 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-f39e7a58-e865-496c-8e82-2eefac032a8e tempest-CreateVolumesFromSnapshotTest-652166221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:38:39 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-f39e7a58-e865-496c-8e82-2eefac032a8e tempest-CreateVolumesFromSnapshotTest-652166221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:38:39 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-f39e7a58-e865-496c-8e82-2eefac032a8e tempest-CreateVolumesFromSnapshotTest-652166221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:38:39 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-f39e7a58-e865-496c-8e82-2eefac032a8e tempest-CreateVolumesFromSnapshotTest-652166221 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:38:39 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-f39e7a58-e865-496c-8e82-2eefac032a8e tempest-CreateVolumesFromSnapshotTest-652166221 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:38:39 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f39e7a58-e865-496c-8e82-2eefac032a8e tempest-CreateVolumesFromSnapshotTest-652166221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-80f57c4c-1396-49f2-8594-d1af83899ab8 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:38:39 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e481c217-4516-4725-8ab3-2a2a8aea5787 tempest-CreateVolumesFromSnapshotTest-652166221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30505970-d207-4da7-9100-26b161b08041) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91e3d704-e0e3-407e-9c22-0744ed04a1e9', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:38:39 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e481c217-4516-4725-8ab3-2a2a8aea5787 tempest-CreateVolumesFromSnapshotTest-652166221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (153271ab-3458-4a17-97c1-439c5bc58442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:38:39 devstack sudo[106125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-80f57c4c-1396-49f2-8594-d1af83899ab8 1073741824
Jul 30 20:38:39 devstack sudo[106125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:38:39 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-e481c217-4516-4725-8ab3-2a2a8aea5787 tempest-CreateVolumesFromSnapshotTest-652166221 None] Volume volume-91e3d704-e0e3-407e-9c22-0744ed04a1e9 (91e3d704-e0e3-407e-9c22-0744ed04a1e9): created successfully
Jul 30 20:38:39 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e481c217-4516-4725-8ab3-2a2a8aea5787 tempest-CreateVolumesFromSnapshotTest-652166221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (153271ab-3458-4a17-97c1-439c5bc58442) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:38:39 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e481c217-4516-4725-8ab3-2a2a8aea5787 tempest-CreateVolumesFromSnapshotTest-652166221 None] Flow 'volume_create_manager' (39c93ff6-e012-4a13-a6f3-b4e084f73259) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:38:39 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-e481c217-4516-4725-8ab3-2a2a8aea5787 tempest-CreateVolumesFromSnapshotTest-652166221 None] Created volume successfully.
Jul 30 20:38:39 devstack sudo[106125]: pam_unix(sudo:session): session closed for user root
Jul 30 20:38:39 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f39e7a58-e865-496c-8e82-2eefac032a8e tempest-CreateVolumesFromSnapshotTest-652166221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-80f57c4c-1396-49f2-8594-d1af83899ab8 1073741824" returned: 0 in 0.572s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:38:39 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f39e7a58-e865-496c-8e82-2eefac032a8e tempest-CreateVolumesFromSnapshotTest-652166221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-80f57c4c-1396-49f2-8594-d1af83899ab8 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:38:39 devstack sudo[106131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-80f57c4c-1396-49f2-8594-d1af83899ab8
Jul 30 20:38:39 devstack sudo[106131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:38:40 devstack sudo[106131]: pam_unix(sudo:session): session closed for user root
Jul 30 20:38:40 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f39e7a58-e865-496c-8e82-2eefac032a8e tempest-CreateVolumesFromSnapshotTest-652166221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-80f57c4c-1396-49f2-8594-d1af83899ab8" returned: 0 in 0.327s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:38:40 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-f39e7a58-e865-496c-8e82-2eefac032a8e tempest-CreateVolumesFromSnapshotTest-652166221 None] <== create_volume: return (951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:38:40 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-f39e7a58-e865-496c-8e82-2eefac032a8e tempest-CreateVolumesFromSnapshotTest-652166221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:38:40 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-9c38748b-613b-4942-a32c-a5991fdeb84f tempest-CreateVolumesFromSnapshotTest-652166221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.511s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:38:40 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-9c38748b-613b-4942-a32c-a5991fdeb84f tempest-CreateVolumesFromSnapshotTest-652166221 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:38:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-818596961',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80f9cee5-90a9-415f-8564-543faf77d433,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='843b20e3780d4308857eef4183fc8403',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:38:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:38:38Z,use_quota=True,user_id='97a0fbca162549c1ac7d9cb299108864',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:38:40 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-9c38748b-613b-4942-a32c-a5991fdeb84f tempest-CreateVolumesFromSnapshotTest-652166221 None] Creating volume 80f9cee5-90a9-415f-8564-543faf77d433 {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:38:40 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-9c38748b-613b-4942-a32c-a5991fdeb84f tempest-CreateVolumesFromSnapshotTest-652166221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:38:40 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-9c38748b-613b-4942-a32c-a5991fdeb84f tempest-CreateVolumesFromSnapshotTest-652166221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:38:40 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-9c38748b-613b-4942-a32c-a5991fdeb84f tempest-CreateVolumesFromSnapshotTest-652166221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:38:40 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-9c38748b-613b-4942-a32c-a5991fdeb84f tempest-CreateVolumesFromSnapshotTest-652166221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:38:40 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-9c38748b-613b-4942-a32c-a5991fdeb84f tempest-CreateVolumesFromSnapshotTest-652166221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:38:40 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-9c38748b-613b-4942-a32c-a5991fdeb84f tempest-CreateVolumesFromSnapshotTest-652166221 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:38:40 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-9c38748b-613b-4942-a32c-a5991fdeb84f tempest-CreateVolumesFromSnapshotTest-652166221 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:38:40 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-9c38748b-613b-4942-a32c-a5991fdeb84f tempest-CreateVolumesFromSnapshotTest-652166221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-80f9cee5-90a9-415f-8564-543faf77d433 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:38:40 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-f39e7a58-e865-496c-8e82-2eefac032a8e tempest-CreateVolumesFromSnapshotTest-652166221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3ded672-c9a5-4305-85ba-59a497f153fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80f57c4c-1396-49f2-8594-d1af83899ab8', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:38:40 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-f39e7a58-e865-496c-8e82-2eefac032a8e tempest-CreateVolumesFromSnapshotTest-652166221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0324def5-47cd-4332-9e62-0ef89c9900ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:38:40 devstack sudo[106134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-80f9cee5-90a9-415f-8564-543faf77d433 1073741824
Jul 30 20:38:40 devstack sudo[106134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:38:40 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-f39e7a58-e865-496c-8e82-2eefac032a8e tempest-CreateVolumesFromSnapshotTest-652166221 None] Volume volume-80f57c4c-1396-49f2-8594-d1af83899ab8 (80f57c4c-1396-49f2-8594-d1af83899ab8): created successfully
Jul 30 20:38:40 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-f39e7a58-e865-496c-8e82-2eefac032a8e tempest-CreateVolumesFromSnapshotTest-652166221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0324def5-47cd-4332-9e62-0ef89c9900ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:38:40 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-f39e7a58-e865-496c-8e82-2eefac032a8e tempest-CreateVolumesFromSnapshotTest-652166221 None] Flow 'volume_create_manager' (5572f5cf-bc8f-4199-97a3-b7a0c732ba57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:38:40 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-f39e7a58-e865-496c-8e82-2eefac032a8e tempest-CreateVolumesFromSnapshotTest-652166221 None] Created volume successfully.
Jul 30 20:38:40 devstack sudo[106134]: pam_unix(sudo:session): session closed for user root
Jul 30 20:38:40 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-9c38748b-613b-4942-a32c-a5991fdeb84f tempest-CreateVolumesFromSnapshotTest-652166221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-80f9cee5-90a9-415f-8564-543faf77d433 1073741824" returned: 0 in 0.544s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:38:40 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-9c38748b-613b-4942-a32c-a5991fdeb84f tempest-CreateVolumesFromSnapshotTest-652166221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-80f9cee5-90a9-415f-8564-543faf77d433 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:38:40 devstack sudo[106140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-80f9cee5-90a9-415f-8564-543faf77d433
Jul 30 20:38:40 devstack sudo[106140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:38:40 devstack sudo[106140]: pam_unix(sudo:session): session closed for user root
Jul 30 20:38:40 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-9c38748b-613b-4942-a32c-a5991fdeb84f tempest-CreateVolumesFromSnapshotTest-652166221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-80f9cee5-90a9-415f-8564-543faf77d433" returned: 0 in 0.339s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:38:40 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-9c38748b-613b-4942-a32c-a5991fdeb84f tempest-CreateVolumesFromSnapshotTest-652166221 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:38:40 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-9c38748b-613b-4942-a32c-a5991fdeb84f tempest-CreateVolumesFromSnapshotTest-652166221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:38:40 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-3ee27f51-b3bc-444d-95d8-949c0bc24405 tempest-CreateVolumesFromSnapshotTest-652166221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.927s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:38:40 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-3ee27f51-b3bc-444d-95d8-949c0bc24405 tempest-CreateVolumesFromSnapshotTest-652166221 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:38:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-205705135',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3e6d896-6fab-4705-9441-8372e1c4d5c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='843b20e3780d4308857eef4183fc8403',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:38:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:38:39Z,use_quota=True,user_id='97a0fbca162549c1ac7d9cb299108864',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:38:40 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-3ee27f51-b3bc-444d-95d8-949c0bc24405 tempest-CreateVolumesFromSnapshotTest-652166221 None] Creating volume d3e6d896-6fab-4705-9441-8372e1c4d5c7 {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:38:40 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-3ee27f51-b3bc-444d-95d8-949c0bc24405 tempest-CreateVolumesFromSnapshotTest-652166221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:38:40 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-3ee27f51-b3bc-444d-95d8-949c0bc24405 tempest-CreateVolumesFromSnapshotTest-652166221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:38:40 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-3ee27f51-b3bc-444d-95d8-949c0bc24405 tempest-CreateVolumesFromSnapshotTest-652166221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:38:40 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-3ee27f51-b3bc-444d-95d8-949c0bc24405 tempest-CreateVolumesFromSnapshotTest-652166221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:38:40 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-3ee27f51-b3bc-444d-95d8-949c0bc24405 tempest-CreateVolumesFromSnapshotTest-652166221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:38:40 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-3ee27f51-b3bc-444d-95d8-949c0bc24405 tempest-CreateVolumesFromSnapshotTest-652166221 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:38:40 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-3ee27f51-b3bc-444d-95d8-949c0bc24405 tempest-CreateVolumesFromSnapshotTest-652166221 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:38:40 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3ee27f51-b3bc-444d-95d8-949c0bc24405 tempest-CreateVolumesFromSnapshotTest-652166221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d3e6d896-6fab-4705-9441-8372e1c4d5c7 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:38:41 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-9c38748b-613b-4942-a32c-a5991fdeb84f tempest-CreateVolumesFromSnapshotTest-652166221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7849525f-3c10-4f46-81e0-f803c4ce81c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80f9cee5-90a9-415f-8564-543faf77d433', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:38:41 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-9c38748b-613b-4942-a32c-a5991fdeb84f tempest-CreateVolumesFromSnapshotTest-652166221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a58a534-a1c1-46a0-ab3a-6242e339a312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:38:41 devstack sudo[106143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d3e6d896-6fab-4705-9441-8372e1c4d5c7 1073741824
Jul 30 20:38:41 devstack sudo[106143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:38:41 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-9c38748b-613b-4942-a32c-a5991fdeb84f tempest-CreateVolumesFromSnapshotTest-652166221 None] Volume volume-80f9cee5-90a9-415f-8564-543faf77d433 (80f9cee5-90a9-415f-8564-543faf77d433): created successfully
Jul 30 20:38:41 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-9c38748b-613b-4942-a32c-a5991fdeb84f tempest-CreateVolumesFromSnapshotTest-652166221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a58a534-a1c1-46a0-ab3a-6242e339a312) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:38:41 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-9c38748b-613b-4942-a32c-a5991fdeb84f tempest-CreateVolumesFromSnapshotTest-652166221 None] Flow 'volume_create_manager' (01005053-ebbc-415a-b09a-f59dd1132ee7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:38:41 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-9c38748b-613b-4942-a32c-a5991fdeb84f tempest-CreateVolumesFromSnapshotTest-652166221 None] Created volume successfully.
Jul 30 20:38:41 devstack sudo[106143]: pam_unix(sudo:session): session closed for user root
Jul 30 20:38:41 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3ee27f51-b3bc-444d-95d8-949c0bc24405 tempest-CreateVolumesFromSnapshotTest-652166221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d3e6d896-6fab-4705-9441-8372e1c4d5c7 1073741824" returned: 0 in 0.647s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:38:41 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3ee27f51-b3bc-444d-95d8-949c0bc24405 tempest-CreateVolumesFromSnapshotTest-652166221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d3e6d896-6fab-4705-9441-8372e1c4d5c7 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:38:41 devstack sudo[106149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d3e6d896-6fab-4705-9441-8372e1c4d5c7
Jul 30 20:38:41 devstack sudo[106149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:38:41 devstack sudo[106149]: pam_unix(sudo:session): session closed for user root
Jul 30 20:38:41 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3ee27f51-b3bc-444d-95d8-949c0bc24405 tempest-CreateVolumesFromSnapshotTest-652166221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d3e6d896-6fab-4705-9441-8372e1c4d5c7" returned: 0 in 0.308s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:38:41 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-3ee27f51-b3bc-444d-95d8-949c0bc24405 tempest-CreateVolumesFromSnapshotTest-652166221 None] <== create_volume: return (1006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:38:41 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-3ee27f51-b3bc-444d-95d8-949c0bc24405 tempest-CreateVolumesFromSnapshotTest-652166221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.011s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:38:41 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-3ee27f51-b3bc-444d-95d8-949c0bc24405 tempest-CreateVolumesFromSnapshotTest-652166221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (454e0462-41f2-4576-b436-4cf5d51a166e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3e6d896-6fab-4705-9441-8372e1c4d5c7', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:38:42 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-3ee27f51-b3bc-444d-95d8-949c0bc24405 tempest-CreateVolumesFromSnapshotTest-652166221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe747562-af77-4838-a123-3fb335601acc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:38:42 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-3ee27f51-b3bc-444d-95d8-949c0bc24405 tempest-CreateVolumesFromSnapshotTest-652166221 None] Volume volume-d3e6d896-6fab-4705-9441-8372e1c4d5c7 (d3e6d896-6fab-4705-9441-8372e1c4d5c7): created successfully
Jul 30 20:38:42 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-3ee27f51-b3bc-444d-95d8-949c0bc24405 tempest-CreateVolumesFromSnapshotTest-652166221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe747562-af77-4838-a123-3fb335601acc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:38:42 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-3ee27f51-b3bc-444d-95d8-949c0bc24405 tempest-CreateVolumesFromSnapshotTest-652166221 None] Flow 'volume_create_manager' (8891cc16-0cee-4c60-a910-07a6e142484c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:38:42 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-3ee27f51-b3bc-444d-95d8-949c0bc24405 tempest-CreateVolumesFromSnapshotTest-652166221 None] Created volume successfully.
Jul 30 20:38:42 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-b0c6a031-c8ee-4a6e-b7ca-6ead656e3f17 tempest-CreateVolumesFromSnapshotTest-652166221 None] Acquiring lock "cinder-d3e6d896-6fab-4705-9441-8372e1c4d5c7-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:38:42 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-b0c6a031-c8ee-4a6e-b7ca-6ead656e3f17 tempest-CreateVolumesFromSnapshotTest-652166221 None] Lock "cinder-d3e6d896-6fab-4705-9441-8372e1c4d5c7-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:38:42 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-b0c6a031-c8ee-4a6e-b7ca-6ead656e3f17 tempest-CreateVolumesFromSnapshotTest-652166221 None] Acquiring lock "cinder-quobyte-d3e6d896-6fab-4705-9441-8372e1c4d5c7" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:38:42 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-b0c6a031-c8ee-4a6e-b7ca-6ead656e3f17 tempest-CreateVolumesFromSnapshotTest-652166221 None] Lock "cinder-quobyte-d3e6d896-6fab-4705-9441-8372e1c4d5c7" acquired by "delete_volume" :: waited 0.017s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:38:42 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb35b0a3-dd78-4bda-b8ce-8fd1d6b1635f]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:38:42 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-b0c6a031-c8ee-4a6e-b7ca-6ead656e3f17 tempest-CreateVolumesFromSnapshotTest-652166221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d3e6d896-6fab-4705-9441-8372e1c4d5c7 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:38:42 devstack sudo[106153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d3e6d896-6fab-4705-9441-8372e1c4d5c7
Jul 30 20:38:42 devstack sudo[106153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:38:43 devstack sudo[106153]: pam_unix(sudo:session): session closed for user root
Jul 30 20:38:43 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-b0c6a031-c8ee-4a6e-b7ca-6ead656e3f17 tempest-CreateVolumesFromSnapshotTest-652166221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d3e6d896-6fab-4705-9441-8372e1c4d5c7" returned: 0 in 0.383s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:38:43 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-b0c6a031-c8ee-4a6e-b7ca-6ead656e3f17 tempest-CreateVolumesFromSnapshotTest-652166221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d3e6d896-6fab-4705-9441-8372e1c4d5c7 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:38:43 devstack sudo[106158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d3e6d896-6fab-4705-9441-8372e1c4d5c7
Jul 30 20:38:43 devstack sudo[106158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:38:43 devstack sudo[106158]: pam_unix(sudo:session): session closed for user root
Jul 30 20:38:43 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-b0c6a031-c8ee-4a6e-b7ca-6ead656e3f17 tempest-CreateVolumesFromSnapshotTest-652166221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d3e6d896-6fab-4705-9441-8372e1c4d5c7" returned: 0 in 0.253s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:38:43 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-b0c6a031-c8ee-4a6e-b7ca-6ead656e3f17 tempest-CreateVolumesFromSnapshotTest-652166221 None] Lock "cinder-quobyte-d3e6d896-6fab-4705-9441-8372e1c4d5c7" released by "delete_volume" :: held 0.699s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:38:43 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-b0c6a031-c8ee-4a6e-b7ca-6ead656e3f17 tempest-CreateVolumesFromSnapshotTest-652166221 None] Created reservations ['37da5f6c-568c-455d-aae5-4f7db22ac69f', '690b8112-a941-41e3-993c-49866172d02c', 'e4ced063-73b2-4e14-b997-1b3dc1e48de5', '4cdb5ca3-5cc2-49f2-8492-467c28650e71'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:38:43 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-b0c6a031-c8ee-4a6e-b7ca-6ead656e3f17 tempest-CreateVolumesFromSnapshotTest-652166221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:38:43 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-b0c6a031-c8ee-4a6e-b7ca-6ead656e3f17 tempest-CreateVolumesFromSnapshotTest-652166221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:38:43 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-b0c6a031-c8ee-4a6e-b7ca-6ead656e3f17 tempest-CreateVolumesFromSnapshotTest-652166221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:38:43 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-b0c6a031-c8ee-4a6e-b7ca-6ead656e3f17 tempest-CreateVolumesFromSnapshotTest-652166221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:38:43 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-b0c6a031-c8ee-4a6e-b7ca-6ead656e3f17 tempest-CreateVolumesFromSnapshotTest-652166221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:38:43 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-b0c6a031-c8ee-4a6e-b7ca-6ead656e3f17 tempest-CreateVolumesFromSnapshotTest-652166221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:38:43 devstack sudo[106161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:38:43 devstack sudo[106161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:38:43 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-931320fb-6557-4d0b-a83f-525865891d8a tempest-CreateVolumesFromSnapshotTest-652166221 None] Acquiring lock "cinder-80f9cee5-90a9-415f-8564-543faf77d433-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:38:43 devstack sudo[106161]: pam_unix(sudo:session): session closed for user root
Jul 30 20:38:43 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-b0c6a031-c8ee-4a6e-b7ca-6ead656e3f17 tempest-CreateVolumesFromSnapshotTest-652166221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.365s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:38:43 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-b0c6a031-c8ee-4a6e-b7ca-6ead656e3f17 tempest-CreateVolumesFromSnapshotTest-652166221 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:38:43 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-b0c6a031-c8ee-4a6e-b7ca-6ead656e3f17 tempest-CreateVolumesFromSnapshotTest-652166221 None] Deleted volume successfully.
Jul 30 20:38:43 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-931320fb-6557-4d0b-a83f-525865891d8a tempest-CreateVolumesFromSnapshotTest-652166221 None] Lock "cinder-80f9cee5-90a9-415f-8564-543faf77d433-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:38:43 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-b0c6a031-c8ee-4a6e-b7ca-6ead656e3f17 tempest-CreateVolumesFromSnapshotTest-652166221 None] Lock "cinder-d3e6d896-6fab-4705-9441-8372e1c4d5c7-delete_volume" released by "delete_volume" :: held 1.378s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:38:43 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-931320fb-6557-4d0b-a83f-525865891d8a tempest-CreateVolumesFromSnapshotTest-652166221 None] Acquiring lock "cinder-quobyte-80f9cee5-90a9-415f-8564-543faf77d433" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:38:43 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-931320fb-6557-4d0b-a83f-525865891d8a tempest-CreateVolumesFromSnapshotTest-652166221 None] Lock "cinder-quobyte-80f9cee5-90a9-415f-8564-543faf77d433" acquired by "delete_volume" :: waited 0.017s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:38:43 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa1e301f-a58e-4a99-b7d2-387c55d85fa8]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:38:43 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-931320fb-6557-4d0b-a83f-525865891d8a tempest-CreateVolumesFromSnapshotTest-652166221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-80f9cee5-90a9-415f-8564-543faf77d433 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:38:44 devstack sudo[106164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-80f9cee5-90a9-415f-8564-543faf77d433
Jul 30 20:38:44 devstack sudo[106164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:38:44 devstack sudo[106164]: pam_unix(sudo:session): session closed for user root
Jul 30 20:38:44 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-931320fb-6557-4d0b-a83f-525865891d8a tempest-CreateVolumesFromSnapshotTest-652166221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-80f9cee5-90a9-415f-8564-543faf77d433" returned: 0 in 0.440s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:38:44 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-931320fb-6557-4d0b-a83f-525865891d8a tempest-CreateVolumesFromSnapshotTest-652166221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-80f9cee5-90a9-415f-8564-543faf77d433 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:38:44 devstack sudo[106169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-80f9cee5-90a9-415f-8564-543faf77d433
Jul 30 20:38:44 devstack sudo[106169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:38:44 devstack sudo[106169]: pam_unix(sudo:session): session closed for user root
Jul 30 20:38:44 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-931320fb-6557-4d0b-a83f-525865891d8a tempest-CreateVolumesFromSnapshotTest-652166221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-80f9cee5-90a9-415f-8564-543faf77d433" returned: 0 in 0.277s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:38:44 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-931320fb-6557-4d0b-a83f-525865891d8a tempest-CreateVolumesFromSnapshotTest-652166221 None] Lock "cinder-quobyte-80f9cee5-90a9-415f-8564-543faf77d433" released by "delete_volume" :: held 0.776s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:38:44 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-931320fb-6557-4d0b-a83f-525865891d8a tempest-CreateVolumesFromSnapshotTest-652166221 None] Created reservations ['6ac5f7ea-31c7-4b58-a6b5-bc2dc7e2d1bb', '9aa83d6a-2403-4932-a608-5c68d75ef1d3', 'b4309deb-31af-4524-9a2f-e8115b845e49', '2d0b87f0-4135-425a-93e7-07796873dd56'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:38:44 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-931320fb-6557-4d0b-a83f-525865891d8a tempest-CreateVolumesFromSnapshotTest-652166221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:38:44 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-931320fb-6557-4d0b-a83f-525865891d8a tempest-CreateVolumesFromSnapshotTest-652166221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:38:44 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-931320fb-6557-4d0b-a83f-525865891d8a tempest-CreateVolumesFromSnapshotTest-652166221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:38:44 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-931320fb-6557-4d0b-a83f-525865891d8a tempest-CreateVolumesFromSnapshotTest-652166221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:38:44 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-931320fb-6557-4d0b-a83f-525865891d8a tempest-CreateVolumesFromSnapshotTest-652166221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:38:44 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-931320fb-6557-4d0b-a83f-525865891d8a tempest-CreateVolumesFromSnapshotTest-652166221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:38:44 devstack sudo[106172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:38:44 devstack sudo[106172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:38:45 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-063f3d31-b31a-41f6-b18f-7b3edd750005 tempest-CreateVolumesFromSnapshotTest-652166221 None] Acquiring lock "cinder-80f57c4c-1396-49f2-8594-d1af83899ab8-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:38:45 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-063f3d31-b31a-41f6-b18f-7b3edd750005 tempest-CreateVolumesFromSnapshotTest-652166221 None] Lock "cinder-80f57c4c-1396-49f2-8594-d1af83899ab8-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:38:45 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-063f3d31-b31a-41f6-b18f-7b3edd750005 tempest-CreateVolumesFromSnapshotTest-652166221 None] Acquiring lock "cinder-quobyte-80f57c4c-1396-49f2-8594-d1af83899ab8" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:38:45 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-063f3d31-b31a-41f6-b18f-7b3edd750005 tempest-CreateVolumesFromSnapshotTest-652166221 None] Lock "cinder-quobyte-80f57c4c-1396-49f2-8594-d1af83899ab8" acquired by "delete_volume" :: waited 0.021s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:38:45 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[af6f7def-6d3e-43ec-9422-7ec3a95b16d8]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:38:45 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-063f3d31-b31a-41f6-b18f-7b3edd750005 tempest-CreateVolumesFromSnapshotTest-652166221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-80f57c4c-1396-49f2-8594-d1af83899ab8 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:38:45 devstack sudo[106172]: pam_unix(sudo:session): session closed for user root
Jul 30 20:38:45 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-931320fb-6557-4d0b-a83f-525865891d8a tempest-CreateVolumesFromSnapshotTest-652166221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.417s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:38:45 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-931320fb-6557-4d0b-a83f-525865891d8a tempest-CreateVolumesFromSnapshotTest-652166221 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:38:45 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-931320fb-6557-4d0b-a83f-525865891d8a tempest-CreateVolumesFromSnapshotTest-652166221 None] Deleted volume successfully.
Jul 30 20:38:45 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-931320fb-6557-4d0b-a83f-525865891d8a tempest-CreateVolumesFromSnapshotTest-652166221 None] Lock "cinder-80f9cee5-90a9-415f-8564-543faf77d433-delete_volume" released by "delete_volume" :: held 1.490s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:38:45 devstack sudo[106176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-80f57c4c-1396-49f2-8594-d1af83899ab8
Jul 30 20:38:45 devstack sudo[106176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:38:45 devstack sudo[106176]: pam_unix(sudo:session): session closed for user root
Jul 30 20:38:45 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-063f3d31-b31a-41f6-b18f-7b3edd750005 tempest-CreateVolumesFromSnapshotTest-652166221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-80f57c4c-1396-49f2-8594-d1af83899ab8" returned: 0 in 0.445s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:38:45 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-063f3d31-b31a-41f6-b18f-7b3edd750005 tempest-CreateVolumesFromSnapshotTest-652166221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-80f57c4c-1396-49f2-8594-d1af83899ab8 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:38:45 devstack sudo[106182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-80f57c4c-1396-49f2-8594-d1af83899ab8
Jul 30 20:38:45 devstack sudo[106182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:38:45 devstack sudo[106182]: pam_unix(sudo:session): session closed for user root
Jul 30 20:38:45 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-063f3d31-b31a-41f6-b18f-7b3edd750005 tempest-CreateVolumesFromSnapshotTest-652166221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-80f57c4c-1396-49f2-8594-d1af83899ab8" returned: 0 in 0.295s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:38:46 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-063f3d31-b31a-41f6-b18f-7b3edd750005 tempest-CreateVolumesFromSnapshotTest-652166221 None] Lock "cinder-quobyte-80f57c4c-1396-49f2-8594-d1af83899ab8" released by "delete_volume" :: held 0.806s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:38:46 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-063f3d31-b31a-41f6-b18f-7b3edd750005 tempest-CreateVolumesFromSnapshotTest-652166221 None] Created reservations ['1914ec83-5d32-4b29-abe4-03e3779e8907', 'c70e2cad-4989-43f1-b802-c362114f9b99', 'f0c6e68d-b4e5-4fed-a584-185c528b9362', '9f8eadaa-1be7-4968-9198-b56300414e21'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:38:46 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-063f3d31-b31a-41f6-b18f-7b3edd750005 tempest-CreateVolumesFromSnapshotTest-652166221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:38:46 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-063f3d31-b31a-41f6-b18f-7b3edd750005 tempest-CreateVolumesFromSnapshotTest-652166221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:38:46 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-063f3d31-b31a-41f6-b18f-7b3edd750005 tempest-CreateVolumesFromSnapshotTest-652166221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:38:46 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-063f3d31-b31a-41f6-b18f-7b3edd750005 tempest-CreateVolumesFromSnapshotTest-652166221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:38:46 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-063f3d31-b31a-41f6-b18f-7b3edd750005 tempest-CreateVolumesFromSnapshotTest-652166221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:38:46 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-063f3d31-b31a-41f6-b18f-7b3edd750005 tempest-CreateVolumesFromSnapshotTest-652166221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:38:46 devstack sudo[106185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:38:46 devstack sudo[106185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:38:46 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-bcda0038-8283-48f7-bdb1-2a1616ae7f4d tempest-CreateVolumesFromSnapshotTest-652166221 None] Acquiring lock "cinder-91e3d704-e0e3-407e-9c22-0744ed04a1e9-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:38:46 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-bcda0038-8283-48f7-bdb1-2a1616ae7f4d tempest-CreateVolumesFromSnapshotTest-652166221 None] Lock "cinder-91e3d704-e0e3-407e-9c22-0744ed04a1e9-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:38:46 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-bcda0038-8283-48f7-bdb1-2a1616ae7f4d tempest-CreateVolumesFromSnapshotTest-652166221 None] Acquiring lock "cinder-quobyte-91e3d704-e0e3-407e-9c22-0744ed04a1e9" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:38:46 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-bcda0038-8283-48f7-bdb1-2a1616ae7f4d tempest-CreateVolumesFromSnapshotTest-652166221 None] Lock "cinder-quobyte-91e3d704-e0e3-407e-9c22-0744ed04a1e9" acquired by "delete_volume" :: waited 0.022s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:38:46 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ccd69ca-0ec2-44a2-b03c-26431e733a44]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:38:46 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-bcda0038-8283-48f7-bdb1-2a1616ae7f4d tempest-CreateVolumesFromSnapshotTest-652166221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-91e3d704-e0e3-407e-9c22-0744ed04a1e9 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:38:46 devstack sudo[106185]: pam_unix(sudo:session): session closed for user root
Jul 30 20:38:46 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-063f3d31-b31a-41f6-b18f-7b3edd750005 tempest-CreateVolumesFromSnapshotTest-652166221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.363s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:38:46 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-063f3d31-b31a-41f6-b18f-7b3edd750005 tempest-CreateVolumesFromSnapshotTest-652166221 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:38:46 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-063f3d31-b31a-41f6-b18f-7b3edd750005 tempest-CreateVolumesFromSnapshotTest-652166221 None] Deleted volume successfully.
Jul 30 20:38:46 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-063f3d31-b31a-41f6-b18f-7b3edd750005 tempest-CreateVolumesFromSnapshotTest-652166221 None] Lock "cinder-80f57c4c-1396-49f2-8594-d1af83899ab8-delete_volume" released by "delete_volume" :: held 1.506s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:38:46 devstack sudo[106188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-91e3d704-e0e3-407e-9c22-0744ed04a1e9
Jul 30 20:38:46 devstack sudo[106188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:38:46 devstack sudo[106188]: pam_unix(sudo:session): session closed for user root
Jul 30 20:38:46 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-bcda0038-8283-48f7-bdb1-2a1616ae7f4d tempest-CreateVolumesFromSnapshotTest-652166221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-91e3d704-e0e3-407e-9c22-0744ed04a1e9" returned: 0 in 0.468s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:38:46 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-bcda0038-8283-48f7-bdb1-2a1616ae7f4d tempest-CreateVolumesFromSnapshotTest-652166221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-91e3d704-e0e3-407e-9c22-0744ed04a1e9 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:38:47 devstack sudo[106193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-91e3d704-e0e3-407e-9c22-0744ed04a1e9
Jul 30 20:38:47 devstack sudo[106193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:38:47 devstack sudo[106193]: pam_unix(sudo:session): session closed for user root
Jul 30 20:38:47 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-bcda0038-8283-48f7-bdb1-2a1616ae7f4d tempest-CreateVolumesFromSnapshotTest-652166221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-91e3d704-e0e3-407e-9c22-0744ed04a1e9" returned: 0 in 0.401s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:38:47 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-bcda0038-8283-48f7-bdb1-2a1616ae7f4d tempest-CreateVolumesFromSnapshotTest-652166221 None] Lock "cinder-quobyte-91e3d704-e0e3-407e-9c22-0744ed04a1e9" released by "delete_volume" :: held 0.935s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:38:47 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-bcda0038-8283-48f7-bdb1-2a1616ae7f4d tempest-CreateVolumesFromSnapshotTest-652166221 None] Created reservations ['3d3939c0-27b8-447d-8bbb-9fecf8d05855', 'd706b375-fe4e-481c-96db-a903fabb6eb2', 'fb747682-cf9f-4158-ba92-7b845a5e5ab2', '6d81e2c8-c63c-4778-8a41-28a1b953ef00'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:38:47 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-bcda0038-8283-48f7-bdb1-2a1616ae7f4d tempest-CreateVolumesFromSnapshotTest-652166221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:38:47 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-bcda0038-8283-48f7-bdb1-2a1616ae7f4d tempest-CreateVolumesFromSnapshotTest-652166221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:38:47 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-bcda0038-8283-48f7-bdb1-2a1616ae7f4d tempest-CreateVolumesFromSnapshotTest-652166221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:38:47 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-bcda0038-8283-48f7-bdb1-2a1616ae7f4d tempest-CreateVolumesFromSnapshotTest-652166221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:38:47 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-bcda0038-8283-48f7-bdb1-2a1616ae7f4d tempest-CreateVolumesFromSnapshotTest-652166221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:38:47 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-bcda0038-8283-48f7-bdb1-2a1616ae7f4d tempest-CreateVolumesFromSnapshotTest-652166221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:38:47 devstack sudo[106196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:38:47 devstack sudo[106196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:38:47 devstack sudo[106196]: pam_unix(sudo:session): session closed for user root
Jul 30 20:38:47 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-bcda0038-8283-48f7-bdb1-2a1616ae7f4d tempest-CreateVolumesFromSnapshotTest-652166221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.280s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:38:47 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-bcda0038-8283-48f7-bdb1-2a1616ae7f4d tempest-CreateVolumesFromSnapshotTest-652166221 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:38:47 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-bcda0038-8283-48f7-bdb1-2a1616ae7f4d tempest-CreateVolumesFromSnapshotTest-652166221 None] Deleted volume successfully.
Jul 30 20:38:47 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-bcda0038-8283-48f7-bdb1-2a1616ae7f4d tempest-CreateVolumesFromSnapshotTest-652166221 None] Lock "cinder-91e3d704-e0e3-407e-9c22-0744ed04a1e9-delete_volume" released by "delete_volume" :: held 1.527s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:38:48 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-be5050ec-30fc-44a1-b82d-2324b6b387b7 tempest-TestServerVolumeAttachmentScenario-204017630 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:38:48 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-be5050ec-30fc-44a1-b82d-2324b6b387b7 tempest-TestServerVolumeAttachmentScenario-204017630 None] Flow 'volume_create_manager' (5cb679c6-1fcf-4dab-a69b-8f1905b35579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:38:48 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-be5050ec-30fc-44a1-b82d-2324b6b387b7 tempest-TestServerVolumeAttachmentScenario-204017630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dc4af9a-8c89-490a-bcdd-21404d0ba9a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:38:48 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-be5050ec-30fc-44a1-b82d-2324b6b387b7 tempest-TestServerVolumeAttachmentScenario-204017630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dc4af9a-8c89-490a-bcdd-21404d0ba9a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:38:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-824000107',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a10dc318-5742-45f6-bae0-2d729e932792,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acde0cefe3ac4ecc9c555be682b67f04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:38:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:38:48Z,use_quota=True,user_id='04d72befd6d44b39ae6b5f7023b493d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:38:48 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-be5050ec-30fc-44a1-b82d-2324b6b387b7 tempest-TestServerVolumeAttachmentScenario-204017630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9232dec-d967-4b0e-936a-fbc0e7fafce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:38:48 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-be5050ec-30fc-44a1-b82d-2324b6b387b7 tempest-TestServerVolumeAttachmentScenario-204017630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9232dec-d967-4b0e-936a-fbc0e7fafce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:38:48 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-be5050ec-30fc-44a1-b82d-2324b6b387b7 tempest-TestServerVolumeAttachmentScenario-204017630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3db63ae9-2c8b-480d-b6dd-361d3b85fb2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:38:48 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-be5050ec-30fc-44a1-b82d-2324b6b387b7 tempest-TestServerVolumeAttachmentScenario-204017630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3db63ae9-2c8b-480d-b6dd-361d3b85fb2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a10dc318-5742-45f6-bae0-2d729e932792', 'volume_name': 'volume-a10dc318-5742-45f6-bae0-2d729e932792', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:38:48 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-be5050ec-30fc-44a1-b82d-2324b6b387b7 tempest-TestServerVolumeAttachmentScenario-204017630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cfb4eff-cc0c-402c-8ef9-9f6b290233aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:38:48 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-be5050ec-30fc-44a1-b82d-2324b6b387b7 tempest-TestServerVolumeAttachmentScenario-204017630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cfb4eff-cc0c-402c-8ef9-9f6b290233aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:38:48 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-be5050ec-30fc-44a1-b82d-2324b6b387b7 tempest-TestServerVolumeAttachmentScenario-204017630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e55e41b-495e-49fc-8982-d5bfd9265dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:38:48 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-be5050ec-30fc-44a1-b82d-2324b6b387b7 tempest-TestServerVolumeAttachmentScenario-204017630 None] Volume a10dc318-5742-45f6-bae0-2d729e932792: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a10dc318-5742-45f6-bae0-2d729e932792', 'volume_size': 1}
Jul 30 20:38:48 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-be5050ec-30fc-44a1-b82d-2324b6b387b7 tempest-TestServerVolumeAttachmentScenario-204017630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:38:48 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-be5050ec-30fc-44a1-b82d-2324b6b387b7 tempest-TestServerVolumeAttachmentScenario-204017630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:38:48 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-be5050ec-30fc-44a1-b82d-2324b6b387b7 tempest-TestServerVolumeAttachmentScenario-204017630 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:38:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-824000107',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a10dc318-5742-45f6-bae0-2d729e932792,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acde0cefe3ac4ecc9c555be682b67f04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:38:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:38:48Z,use_quota=True,user_id='04d72befd6d44b39ae6b5f7023b493d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:38:48 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-be5050ec-30fc-44a1-b82d-2324b6b387b7 tempest-TestServerVolumeAttachmentScenario-204017630 None] Creating volume a10dc318-5742-45f6-bae0-2d729e932792 {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:38:48 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-be5050ec-30fc-44a1-b82d-2324b6b387b7 tempest-TestServerVolumeAttachmentScenario-204017630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:38:48 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-be5050ec-30fc-44a1-b82d-2324b6b387b7 tempest-TestServerVolumeAttachmentScenario-204017630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:38:48 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-be5050ec-30fc-44a1-b82d-2324b6b387b7 tempest-TestServerVolumeAttachmentScenario-204017630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:38:48 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-be5050ec-30fc-44a1-b82d-2324b6b387b7 tempest-TestServerVolumeAttachmentScenario-204017630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:38:48 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-be5050ec-30fc-44a1-b82d-2324b6b387b7 tempest-TestServerVolumeAttachmentScenario-204017630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:38:48 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-be5050ec-30fc-44a1-b82d-2324b6b387b7 tempest-TestServerVolumeAttachmentScenario-204017630 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:38:48 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-be5050ec-30fc-44a1-b82d-2324b6b387b7 tempest-TestServerVolumeAttachmentScenario-204017630 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:38:48 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-be5050ec-30fc-44a1-b82d-2324b6b387b7 tempest-TestServerVolumeAttachmentScenario-204017630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-a10dc318-5742-45f6-bae0-2d729e932792 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:38:48 devstack sudo[106199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-a10dc318-5742-45f6-bae0-2d729e932792 1073741824
Jul 30 20:38:48 devstack sudo[106199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:38:48 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-9c9868fc-79fc-4e69-b15e-d503b4536b05 tempest-CreateVolumesFromSnapshotTest-652166221 None] Acquiring lock "cinder-e2349a94-eafd-49c5-9b63-dc2775dfdc90-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:38:48 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-9c9868fc-79fc-4e69-b15e-d503b4536b05 tempest-CreateVolumesFromSnapshotTest-652166221 None] Lock "cinder-e2349a94-eafd-49c5-9b63-dc2775dfdc90-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:38:48 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-9c9868fc-79fc-4e69-b15e-d503b4536b05 tempest-CreateVolumesFromSnapshotTest-652166221 None] Acquiring lock "cinder-quobyte-e2349a94-eafd-49c5-9b63-dc2775dfdc90" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:38:48 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-9c9868fc-79fc-4e69-b15e-d503b4536b05 tempest-CreateVolumesFromSnapshotTest-652166221 None] Lock "cinder-quobyte-e2349a94-eafd-49c5-9b63-dc2775dfdc90" acquired by "delete_volume" :: waited 0.017s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:38:48 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a02d102-6dd1-4612-8b19-b8720778493e]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:38:48 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-9c9868fc-79fc-4e69-b15e-d503b4536b05 tempest-CreateVolumesFromSnapshotTest-652166221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-e2349a94-eafd-49c5-9b63-dc2775dfdc90 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:38:48 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3d2f1d6-005c-41ec-91a2-0c1146afe4ee tempest-TestServerVolumeAttachmentScenario-204017630 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:38:49 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e3d2f1d6-005c-41ec-91a2-0c1146afe4ee tempest-TestServerVolumeAttachmentScenario-204017630 None] Flow 'volume_create_manager' (f4f3ee20-cbe5-4163-8e44-897e9219bae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:38:49 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e3d2f1d6-005c-41ec-91a2-0c1146afe4ee tempest-TestServerVolumeAttachmentScenario-204017630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (207a4e5f-f31c-41e8-9809-026827512a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:38:49 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e3d2f1d6-005c-41ec-91a2-0c1146afe4ee tempest-TestServerVolumeAttachmentScenario-204017630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (207a4e5f-f31c-41e8-9809-026827512a87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:38:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-394252696',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0385bb1f-1c4e-4ab2-912e-fb24b198cf3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acde0cefe3ac4ecc9c555be682b67f04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:38:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:38:49Z,use_quota=True,user_id='04d72befd6d44b39ae6b5f7023b493d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:38:49 devstack sudo[106201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-e2349a94-eafd-49c5-9b63-dc2775dfdc90
Jul 30 20:38:49 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e3d2f1d6-005c-41ec-91a2-0c1146afe4ee tempest-TestServerVolumeAttachmentScenario-204017630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (338f3e02-cbdd-4a8d-b487-4e1827f6571f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:38:49 devstack sudo[106201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:38:49 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e3d2f1d6-005c-41ec-91a2-0c1146afe4ee tempest-TestServerVolumeAttachmentScenario-204017630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (338f3e02-cbdd-4a8d-b487-4e1827f6571f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:38:49 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e3d2f1d6-005c-41ec-91a2-0c1146afe4ee tempest-TestServerVolumeAttachmentScenario-204017630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6176aa46-7c76-4776-953a-f9189f22eeed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:38:49 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e3d2f1d6-005c-41ec-91a2-0c1146afe4ee tempest-TestServerVolumeAttachmentScenario-204017630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6176aa46-7c76-4776-953a-f9189f22eeed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0385bb1f-1c4e-4ab2-912e-fb24b198cf3d', 'volume_name': 'volume-0385bb1f-1c4e-4ab2-912e-fb24b198cf3d', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:38:49 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e3d2f1d6-005c-41ec-91a2-0c1146afe4ee tempest-TestServerVolumeAttachmentScenario-204017630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48fbc8ce-7ba4-4b6a-81b3-cc5818d136d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:38:49 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e3d2f1d6-005c-41ec-91a2-0c1146afe4ee tempest-TestServerVolumeAttachmentScenario-204017630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48fbc8ce-7ba4-4b6a-81b3-cc5818d136d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:38:49 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e3d2f1d6-005c-41ec-91a2-0c1146afe4ee tempest-TestServerVolumeAttachmentScenario-204017630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dff94fa-91f9-4952-ac13-41ea8a124cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:38:49 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-e3d2f1d6-005c-41ec-91a2-0c1146afe4ee tempest-TestServerVolumeAttachmentScenario-204017630 None] Volume 0385bb1f-1c4e-4ab2-912e-fb24b198cf3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0385bb1f-1c4e-4ab2-912e-fb24b198cf3d', 'volume_size': 1}
Jul 30 20:38:49 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-e3d2f1d6-005c-41ec-91a2-0c1146afe4ee tempest-TestServerVolumeAttachmentScenario-204017630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:38:49 devstack sudo[106199]: pam_unix(sudo:session): session closed for user root
Jul 30 20:38:49 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-be5050ec-30fc-44a1-b82d-2324b6b387b7 tempest-TestServerVolumeAttachmentScenario-204017630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-a10dc318-5742-45f6-bae0-2d729e932792 1073741824" returned: 0 in 0.813s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:38:49 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-be5050ec-30fc-44a1-b82d-2324b6b387b7 tempest-TestServerVolumeAttachmentScenario-204017630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-a10dc318-5742-45f6-bae0-2d729e932792 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:38:49 devstack sudo[106201]: pam_unix(sudo:session): session closed for user root
Jul 30 20:38:49 devstack sudo[106209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-a10dc318-5742-45f6-bae0-2d729e932792
Jul 30 20:38:49 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-9c9868fc-79fc-4e69-b15e-d503b4536b05 tempest-CreateVolumesFromSnapshotTest-652166221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-e2349a94-eafd-49c5-9b63-dc2775dfdc90" returned: 0 in 0.665s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:38:49 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-9c9868fc-79fc-4e69-b15e-d503b4536b05 tempest-CreateVolumesFromSnapshotTest-652166221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-e2349a94-eafd-49c5-9b63-dc2775dfdc90 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:38:49 devstack sudo[106209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:38:49 devstack sudo[106211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-e2349a94-eafd-49c5-9b63-dc2775dfdc90
Jul 30 20:38:49 devstack sudo[106211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:38:49 devstack sudo[106209]: pam_unix(sudo:session): session closed for user root
Jul 30 20:38:49 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-be5050ec-30fc-44a1-b82d-2324b6b387b7 tempest-TestServerVolumeAttachmentScenario-204017630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-a10dc318-5742-45f6-bae0-2d729e932792" returned: 0 in 0.306s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:38:49 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-be5050ec-30fc-44a1-b82d-2324b6b387b7 tempest-TestServerVolumeAttachmentScenario-204017630 None] <== create_volume: return (1173ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:38:49 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-be5050ec-30fc-44a1-b82d-2324b6b387b7 tempest-TestServerVolumeAttachmentScenario-204017630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.177s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:38:49 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-e3d2f1d6-005c-41ec-91a2-0c1146afe4ee tempest-TestServerVolumeAttachmentScenario-204017630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.610s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:38:49 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-e3d2f1d6-005c-41ec-91a2-0c1146afe4ee tempest-TestServerVolumeAttachmentScenario-204017630 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:38:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-394252696',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0385bb1f-1c4e-4ab2-912e-fb24b198cf3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acde0cefe3ac4ecc9c555be682b67f04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:38:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:38:49Z,use_quota=True,user_id='04d72befd6d44b39ae6b5f7023b493d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:38:49 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-e3d2f1d6-005c-41ec-91a2-0c1146afe4ee tempest-TestServerVolumeAttachmentScenario-204017630 None] Creating volume 0385bb1f-1c4e-4ab2-912e-fb24b198cf3d {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:38:49 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-e3d2f1d6-005c-41ec-91a2-0c1146afe4ee tempest-TestServerVolumeAttachmentScenario-204017630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:38:49 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-e3d2f1d6-005c-41ec-91a2-0c1146afe4ee tempest-TestServerVolumeAttachmentScenario-204017630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:38:49 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-e3d2f1d6-005c-41ec-91a2-0c1146afe4ee tempest-TestServerVolumeAttachmentScenario-204017630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:38:49 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-e3d2f1d6-005c-41ec-91a2-0c1146afe4ee tempest-TestServerVolumeAttachmentScenario-204017630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:38:49 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-e3d2f1d6-005c-41ec-91a2-0c1146afe4ee tempest-TestServerVolumeAttachmentScenario-204017630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:38:49 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-e3d2f1d6-005c-41ec-91a2-0c1146afe4ee tempest-TestServerVolumeAttachmentScenario-204017630 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:38:49 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-e3d2f1d6-005c-41ec-91a2-0c1146afe4ee tempest-TestServerVolumeAttachmentScenario-204017630 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:38:49 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-e3d2f1d6-005c-41ec-91a2-0c1146afe4ee tempest-TestServerVolumeAttachmentScenario-204017630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0385bb1f-1c4e-4ab2-912e-fb24b198cf3d 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:38:49 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-be5050ec-30fc-44a1-b82d-2324b6b387b7 tempest-TestServerVolumeAttachmentScenario-204017630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e55e41b-495e-49fc-8982-d5bfd9265dea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a10dc318-5742-45f6-bae0-2d729e932792', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:38:49 devstack sudo[106215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0385bb1f-1c4e-4ab2-912e-fb24b198cf3d 1073741824
Jul 30 20:38:49 devstack sudo[106215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:38:49 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-be5050ec-30fc-44a1-b82d-2324b6b387b7 tempest-TestServerVolumeAttachmentScenario-204017630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb91a32e-3f62-40cb-be4b-26831e80b703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:38:49 devstack sudo[106211]: pam_unix(sudo:session): session closed for user root
Jul 30 20:38:49 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-be5050ec-30fc-44a1-b82d-2324b6b387b7 tempest-TestServerVolumeAttachmentScenario-204017630 None] Volume volume-a10dc318-5742-45f6-bae0-2d729e932792 (a10dc318-5742-45f6-bae0-2d729e932792): created successfully
Jul 30 20:38:49 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-be5050ec-30fc-44a1-b82d-2324b6b387b7 tempest-TestServerVolumeAttachmentScenario-204017630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb91a32e-3f62-40cb-be4b-26831e80b703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:38:49 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-be5050ec-30fc-44a1-b82d-2324b6b387b7 tempest-TestServerVolumeAttachmentScenario-204017630 None] Flow 'volume_create_manager' (5cb679c6-1fcf-4dab-a69b-8f1905b35579) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:38:49 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-9c9868fc-79fc-4e69-b15e-d503b4536b05 tempest-CreateVolumesFromSnapshotTest-652166221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-e2349a94-eafd-49c5-9b63-dc2775dfdc90" returned: 0 in 0.403s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:38:49 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-be5050ec-30fc-44a1-b82d-2324b6b387b7 tempest-TestServerVolumeAttachmentScenario-204017630 None] Created volume successfully.
Jul 30 20:38:49 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-9c9868fc-79fc-4e69-b15e-d503b4536b05 tempest-CreateVolumesFromSnapshotTest-652166221 None] Lock "cinder-quobyte-e2349a94-eafd-49c5-9b63-dc2775dfdc90" released by "delete_volume" :: held 1.154s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:38:49 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-9c9868fc-79fc-4e69-b15e-d503b4536b05 tempest-CreateVolumesFromSnapshotTest-652166221 None] Created reservations ['c9304ccf-4b1b-493f-8a0e-78543570f08b', '737c6d29-1f1d-4546-a39a-84167401589a', '33725881-444c-4a15-96aa-90ecf344fc5a', 'dbab0ace-75b3-4c1b-9091-05952f5e9dcf'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:38:50 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-9c9868fc-79fc-4e69-b15e-d503b4536b05 tempest-CreateVolumesFromSnapshotTest-652166221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:38:50 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-9c9868fc-79fc-4e69-b15e-d503b4536b05 tempest-CreateVolumesFromSnapshotTest-652166221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:38:50 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-9c9868fc-79fc-4e69-b15e-d503b4536b05 tempest-CreateVolumesFromSnapshotTest-652166221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:38:50 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-9c9868fc-79fc-4e69-b15e-d503b4536b05 tempest-CreateVolumesFromSnapshotTest-652166221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:38:50 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-9c9868fc-79fc-4e69-b15e-d503b4536b05 tempest-CreateVolumesFromSnapshotTest-652166221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:38:50 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-9c9868fc-79fc-4e69-b15e-d503b4536b05 tempest-CreateVolumesFromSnapshotTest-652166221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:38:50 devstack sudo[106220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:38:50 devstack sudo[106220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:38:50 devstack sudo[106215]: pam_unix(sudo:session): session closed for user root
Jul 30 20:38:50 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-e3d2f1d6-005c-41ec-91a2-0c1146afe4ee tempest-TestServerVolumeAttachmentScenario-204017630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0385bb1f-1c4e-4ab2-912e-fb24b198cf3d 1073741824" returned: 0 in 0.631s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:38:50 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-e3d2f1d6-005c-41ec-91a2-0c1146afe4ee tempest-TestServerVolumeAttachmentScenario-204017630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0385bb1f-1c4e-4ab2-912e-fb24b198cf3d {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:38:50 devstack sudo[106220]: pam_unix(sudo:session): session closed for user root
Jul 30 20:38:50 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-9c9868fc-79fc-4e69-b15e-d503b4536b05 tempest-CreateVolumesFromSnapshotTest-652166221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.399s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:38:50 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-9c9868fc-79fc-4e69-b15e-d503b4536b05 tempest-CreateVolumesFromSnapshotTest-652166221 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:38:50 devstack sudo[106224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0385bb1f-1c4e-4ab2-912e-fb24b198cf3d
Jul 30 20:38:50 devstack sudo[106224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:38:50 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-9c9868fc-79fc-4e69-b15e-d503b4536b05 tempest-CreateVolumesFromSnapshotTest-652166221 None] Deleted volume successfully.
Jul 30 20:38:50 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-9c9868fc-79fc-4e69-b15e-d503b4536b05 tempest-CreateVolumesFromSnapshotTest-652166221 None] Lock "cinder-e2349a94-eafd-49c5-9b63-dc2775dfdc90-delete_volume" released by "delete_volume" :: held 1.863s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:38:50 devstack sudo[106224]: pam_unix(sudo:session): session closed for user root
Jul 30 20:38:50 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-e3d2f1d6-005c-41ec-91a2-0c1146afe4ee tempest-TestServerVolumeAttachmentScenario-204017630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0385bb1f-1c4e-4ab2-912e-fb24b198cf3d" returned: 0 in 0.394s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:38:50 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-e3d2f1d6-005c-41ec-91a2-0c1146afe4ee tempest-TestServerVolumeAttachmentScenario-204017630 None] <== create_volume: return (1096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:38:50 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-e3d2f1d6-005c-41ec-91a2-0c1146afe4ee tempest-TestServerVolumeAttachmentScenario-204017630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.099s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:38:50 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e3d2f1d6-005c-41ec-91a2-0c1146afe4ee tempest-TestServerVolumeAttachmentScenario-204017630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dff94fa-91f9-4952-ac13-41ea8a124cde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0385bb1f-1c4e-4ab2-912e-fb24b198cf3d', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:38:50 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e3d2f1d6-005c-41ec-91a2-0c1146afe4ee tempest-TestServerVolumeAttachmentScenario-204017630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2af79267-4544-4bf2-b53c-2970e2610d78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:38:50 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-e3d2f1d6-005c-41ec-91a2-0c1146afe4ee tempest-TestServerVolumeAttachmentScenario-204017630 None] Volume volume-0385bb1f-1c4e-4ab2-912e-fb24b198cf3d (0385bb1f-1c4e-4ab2-912e-fb24b198cf3d): created successfully
Jul 30 20:38:50 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e3d2f1d6-005c-41ec-91a2-0c1146afe4ee tempest-TestServerVolumeAttachmentScenario-204017630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2af79267-4544-4bf2-b53c-2970e2610d78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:38:50 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e3d2f1d6-005c-41ec-91a2-0c1146afe4ee tempest-TestServerVolumeAttachmentScenario-204017630 None] Flow 'volume_create_manager' (f4f3ee20-cbe5-4163-8e44-897e9219bae4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:38:50 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-e3d2f1d6-005c-41ec-91a2-0c1146afe4ee tempest-TestServerVolumeAttachmentScenario-204017630 None] Created volume successfully.
Jul 30 20:38:50 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-33b875b1-1833-4121-8fa9-7a6601732348 tempest-CreateVolumesFromSnapshotTest-652166221 None] Acquiring lock "cinder-961d1894-df50-46cc-99a2-b547f1c24a36-delete_snapshot" by "delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:38:50 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-33b875b1-1833-4121-8fa9-7a6601732348 tempest-CreateVolumesFromSnapshotTest-652166221 None] Lock "cinder-961d1894-df50-46cc-99a2-b547f1c24a36-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:38:50 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-33b875b1-1833-4121-8fa9-7a6601732348 tempest-CreateVolumesFromSnapshotTest-652166221 None] Acquiring lock "cinder-quobyte-6e21e34b-c8af-4395-adc2-5baeb0a0daed" by "delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:38:50 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-33b875b1-1833-4121-8fa9-7a6601732348 tempest-CreateVolumesFromSnapshotTest-652166221 None] Lock "cinder-quobyte-6e21e34b-c8af-4395-adc2-5baeb0a0daed" acquired by "delete_snapshot" :: waited 0.031s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:38:50 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-33b875b1-1833-4121-8fa9-7a6601732348 tempest-CreateVolumesFromSnapshotTest-652166221 None] Acquiring lock "cinder-quobyte-961d1894-df50-46cc-99a2-b547f1c24a36" by "_delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:38:51 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-33b875b1-1833-4121-8fa9-7a6601732348 tempest-CreateVolumesFromSnapshotTest-652166221 None] Lock "cinder-quobyte-961d1894-df50-46cc-99a2-b547f1c24a36" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:38:51 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-33b875b1-1833-4121-8fa9-7a6601732348 tempest-CreateVolumesFromSnapshotTest-652166221 None] Deleting offline snapshot 961d1894-df50-46cc-99a2-b547f1c24a36 of volume 6e21e34b-c8af-4395-adc2-5baeb0a0daed {{(pid=88719) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 30 20:38:51 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-33b875b1-1833-4121-8fa9-7a6601732348 tempest-CreateVolumesFromSnapshotTest-652166221 None] snapshot_file for this snap is: volume-6e21e34b-c8af-4395-adc2-5baeb0a0daed.961d1894-df50-46cc-99a2-b547f1c24a36 {{(pid=88719) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 30 20:38:51 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[31cceaf5-6e1c-41d3-94b5-c660bbaa79c6]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:38:51 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-33b875b1-1833-4121-8fa9-7a6601732348 tempest-CreateVolumesFromSnapshotTest-652166221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6e21e34b-c8af-4395-adc2-5baeb0a0daed.961d1894-df50-46cc-99a2-b547f1c24a36 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:38:51 devstack sudo[106227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6e21e34b-c8af-4395-adc2-5baeb0a0daed.961d1894-df50-46cc-99a2-b547f1c24a36
Jul 30 20:38:51 devstack sudo[106227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:38:51 devstack sudo[106227]: pam_unix(sudo:session): session closed for user root
Jul 30 20:38:51 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-33b875b1-1833-4121-8fa9-7a6601732348 tempest-CreateVolumesFromSnapshotTest-652166221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6e21e34b-c8af-4395-adc2-5baeb0a0daed.961d1894-df50-46cc-99a2-b547f1c24a36" returned: 0 in 0.454s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:38:51 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-33b875b1-1833-4121-8fa9-7a6601732348 tempest-CreateVolumesFromSnapshotTest-652166221 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e21e34b-c8af-4395-adc2-5baeb0a0daed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88719) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 30 20:38:51 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dfcb6ed-a56e-4e63-b52f-696bc2b1b6c3]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:38:51 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-33b875b1-1833-4121-8fa9-7a6601732348 tempest-CreateVolumesFromSnapshotTest-652166221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6e21e34b-c8af-4395-adc2-5baeb0a0daed {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:38:51 devstack sudo[106234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6e21e34b-c8af-4395-adc2-5baeb0a0daed
Jul 30 20:38:51 devstack sudo[106234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:38:51 devstack sudo[106234]: pam_unix(sudo:session): session closed for user root
Jul 30 20:38:51 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-33b875b1-1833-4121-8fa9-7a6601732348 tempest-CreateVolumesFromSnapshotTest-652166221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6e21e34b-c8af-4395-adc2-5baeb0a0daed" returned: 0 in 0.437s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:38:51 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-33b875b1-1833-4121-8fa9-7a6601732348 tempest-CreateVolumesFromSnapshotTest-652166221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6e21e34b-c8af-4395-adc2-5baeb0a0daed.961d1894-df50-46cc-99a2-b547f1c24a36 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:38:52 devstack sudo[106239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6e21e34b-c8af-4395-adc2-5baeb0a0daed.961d1894-df50-46cc-99a2-b547f1c24a36
Jul 30 20:38:52 devstack sudo[106239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:38:52 devstack sudo[106239]: pam_unix(sudo:session): session closed for user root
Jul 30 20:38:52 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-33b875b1-1833-4121-8fa9-7a6601732348 tempest-CreateVolumesFromSnapshotTest-652166221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6e21e34b-c8af-4395-adc2-5baeb0a0daed.961d1894-df50-46cc-99a2-b547f1c24a36" returned: 0 in 0.506s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:38:52 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-33b875b1-1833-4121-8fa9-7a6601732348 tempest-CreateVolumesFromSnapshotTest-652166221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6e21e34b-c8af-4395-adc2-5baeb0a0daed.961d1894-df50-46cc-99a2-b547f1c24a36 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:38:52 devstack sudo[106245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6e21e34b-c8af-4395-adc2-5baeb0a0daed.961d1894-df50-46cc-99a2-b547f1c24a36
Jul 30 20:38:52 devstack sudo[106245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:38:52 devstack sudo[106245]: pam_unix(sudo:session): session closed for user root
Jul 30 20:38:52 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-33b875b1-1833-4121-8fa9-7a6601732348 tempest-CreateVolumesFromSnapshotTest-652166221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6e21e34b-c8af-4395-adc2-5baeb0a0daed.961d1894-df50-46cc-99a2-b547f1c24a36" returned: 0 in 0.295s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:38:52 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-33b875b1-1833-4121-8fa9-7a6601732348 tempest-CreateVolumesFromSnapshotTest-652166221 None] Lock "cinder-quobyte-961d1894-df50-46cc-99a2-b547f1c24a36" released by "_delete_snapshot" :: held 1.844s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:38:52 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-33b875b1-1833-4121-8fa9-7a6601732348 tempest-CreateVolumesFromSnapshotTest-652166221 None] Lock "cinder-quobyte-6e21e34b-c8af-4395-adc2-5baeb0a0daed" released by "delete_snapshot" :: held 1.869s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:38:52 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-33b875b1-1833-4121-8fa9-7a6601732348 tempest-CreateVolumesFromSnapshotTest-652166221 None] Created reservations ['1096cbbc-05a6-4f3a-baac-3f2d5dcc371e', '668103f5-c471-4c9c-8cc1-0146e99bbfae', '1d773821-ead2-4cf3-a68e-8daeec2cc8b6', 'bc609f80-a097-4994-acc6-1aca8ff7c951'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:38:53 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-33b875b1-1833-4121-8fa9-7a6601732348 tempest-CreateVolumesFromSnapshotTest-652166221 None] Delete snapshot completed successfully.
Jul 30 20:38:53 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-33b875b1-1833-4121-8fa9-7a6601732348 tempest-CreateVolumesFromSnapshotTest-652166221 None] Lock "cinder-961d1894-df50-46cc-99a2-b547f1c24a36-delete_snapshot" released by "delete_snapshot" :: held 2.068s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:38:53 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-07bce03f-6dfb-4285-ad2d-0215d3fa51c6 tempest-CreateVolumesFromSnapshotTest-652166221 None] Acquiring lock "cinder-6e21e34b-c8af-4395-adc2-5baeb0a0daed-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:38:53 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-07bce03f-6dfb-4285-ad2d-0215d3fa51c6 tempest-CreateVolumesFromSnapshotTest-652166221 None] Lock "cinder-6e21e34b-c8af-4395-adc2-5baeb0a0daed-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:38:53 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-07bce03f-6dfb-4285-ad2d-0215d3fa51c6 tempest-CreateVolumesFromSnapshotTest-652166221 None] Acquiring lock "cinder-quobyte-6e21e34b-c8af-4395-adc2-5baeb0a0daed" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:38:53 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-07bce03f-6dfb-4285-ad2d-0215d3fa51c6 tempest-CreateVolumesFromSnapshotTest-652166221 None] Lock "cinder-quobyte-6e21e34b-c8af-4395-adc2-5baeb0a0daed" acquired by "delete_volume" :: waited 0.039s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:38:53 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[be4a914e-0841-4aef-9520-9b8cfd1ecc79]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:38:53 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-07bce03f-6dfb-4285-ad2d-0215d3fa51c6 tempest-CreateVolumesFromSnapshotTest-652166221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6e21e34b-c8af-4395-adc2-5baeb0a0daed {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:38:53 devstack sudo[106251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6e21e34b-c8af-4395-adc2-5baeb0a0daed
Jul 30 20:38:53 devstack sudo[106251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:38:53 devstack sudo[106251]: pam_unix(sudo:session): session closed for user root
Jul 30 20:38:53 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-07bce03f-6dfb-4285-ad2d-0215d3fa51c6 tempest-CreateVolumesFromSnapshotTest-652166221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6e21e34b-c8af-4395-adc2-5baeb0a0daed" returned: 0 in 0.420s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:38:53 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-07bce03f-6dfb-4285-ad2d-0215d3fa51c6 tempest-CreateVolumesFromSnapshotTest-652166221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6e21e34b-c8af-4395-adc2-5baeb0a0daed {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:38:53 devstack sudo[106256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6e21e34b-c8af-4395-adc2-5baeb0a0daed
Jul 30 20:38:53 devstack sudo[106256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:38:54 devstack sudo[106256]: pam_unix(sudo:session): session closed for user root
Jul 30 20:38:54 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-07bce03f-6dfb-4285-ad2d-0215d3fa51c6 tempest-CreateVolumesFromSnapshotTest-652166221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6e21e34b-c8af-4395-adc2-5baeb0a0daed" returned: 0 in 0.308s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:38:54 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-07bce03f-6dfb-4285-ad2d-0215d3fa51c6 tempest-CreateVolumesFromSnapshotTest-652166221 None] Lock "cinder-quobyte-6e21e34b-c8af-4395-adc2-5baeb0a0daed" released by "delete_volume" :: held 0.847s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:38:54 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-07bce03f-6dfb-4285-ad2d-0215d3fa51c6 tempest-CreateVolumesFromSnapshotTest-652166221 None] Created reservations ['f9d3b511-3de6-4f81-bce1-2b0ce1772e80', '436ca2c4-134c-40e1-8d49-f2f4907f4336', '4f6a6204-9d4c-4953-b1e6-f4af6dbf2cbe', '2084fd2a-9fde-4afa-9622-530508f2c0a7'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:38:54 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-07bce03f-6dfb-4285-ad2d-0215d3fa51c6 tempest-CreateVolumesFromSnapshotTest-652166221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:38:54 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-07bce03f-6dfb-4285-ad2d-0215d3fa51c6 tempest-CreateVolumesFromSnapshotTest-652166221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:38:54 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-07bce03f-6dfb-4285-ad2d-0215d3fa51c6 tempest-CreateVolumesFromSnapshotTest-652166221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:38:54 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-07bce03f-6dfb-4285-ad2d-0215d3fa51c6 tempest-CreateVolumesFromSnapshotTest-652166221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:38:54 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-07bce03f-6dfb-4285-ad2d-0215d3fa51c6 tempest-CreateVolumesFromSnapshotTest-652166221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:38:54 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-07bce03f-6dfb-4285-ad2d-0215d3fa51c6 tempest-CreateVolumesFromSnapshotTest-652166221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:38:54 devstack sudo[106259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:38:54 devstack sudo[106259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:38:54 devstack sudo[106259]: pam_unix(sudo:session): session closed for user root
Jul 30 20:38:54 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-07bce03f-6dfb-4285-ad2d-0215d3fa51c6 tempest-CreateVolumesFromSnapshotTest-652166221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.396s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:38:54 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-07bce03f-6dfb-4285-ad2d-0215d3fa51c6 tempest-CreateVolumesFromSnapshotTest-652166221 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:38:54 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-07bce03f-6dfb-4285-ad2d-0215d3fa51c6 tempest-CreateVolumesFromSnapshotTest-652166221 None] Deleted volume successfully.
Jul 30 20:38:54 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-07bce03f-6dfb-4285-ad2d-0215d3fa51c6 tempest-CreateVolumesFromSnapshotTest-652166221 None] Lock "cinder-6e21e34b-c8af-4395-adc2-5baeb0a0daed-delete_volume" released by "delete_volume" :: held 1.623s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:39:04 devstack cinder-volume[88719]: DEBUG dbcounter [-] [88719] Writing DB stats cinder:UPDATE=150,cinder:SELECT=116,cinder:DELETE=16,cinder:INSERT=37 {{(pid=88719) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 30 20:39:04 devstack cinder-volume[88719]: DEBUG dbcounter [-] [88719] Writing DB stats cinder:SELECT=104,cinder:UPDATE=168,cinder:INSERT=39,cinder:DELETE=13 {{(pid=88719) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 30 20:39:16 devstack cinder-volume[88719]: DEBUG oslo_service.periodic_task [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88719) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 30 20:39:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:39:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:39:16 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:39:16 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:39:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:39:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:39:16 devstack sudo[106437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:39:16 devstack sudo[106437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:39:16 devstack sudo[106437]: pam_unix(sudo:session): session closed for user root
Jul 30 20:39:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.240s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:39:16 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:39:16 devstack cinder-volume[88719]: DEBUG oslo_service.periodic_task [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Running periodic task VolumeManager._thread_info {{(pid=88719) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 30 20:39:16 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] thread count: 28 {{(pid=88719) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 30 20:39:16 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] thread info: [<_MainThread(MainThread, started 132390416908416)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132390306497536)>, <Thread(Thread-3 (stat_writer), started daemon 132390304471680)>, <Thread(Rabbit-heartbeat, started daemon 132390303393408)>, <Thread(Thread-5 (_runner), started daemon 132390303543168)>, <Thread(Thread-7 (_runner), started daemon 132390303563392)>, <Thread(fd_logger, started daemon 132390301344640)>, <Thread(privsep_reader, started daemon 132390301560640)>, <Thread(tpool_thread_0, started daemon 132390291470016)>, <Thread(tpool_thread_1, started daemon 132390283077312)>, <Thread(tpool_thread_2, started daemon 132390274684608)>, <Thread(tpool_thread_3, started daemon 132390266291904)>, <Thread(tpool_thread_4, started daemon 132390257899200)>, <Thread(tpool_thread_5, started daemon 132390249506496)>, <Thread(tpool_thread_6, started daemon 132390241113792)>, <Thread(tpool_thread_7, started daemon 132390232721088)>, <Thread(tpool_thread_8, started daemon 132390224328384)>, <Thread(tpool_thread_9, started daemon 132390215919296)>, <Thread(tpool_thread_10, started daemon 132390207510208)>, <Thread(tpool_thread_11, started daemon 132390199101120)>, <Thread(tpool_thread_12, started daemon 132390190692032)>, <Thread(tpool_thread_13, started daemon 132390182282944)>, <Thread(tpool_thread_14, started daemon 132390173873856)>, <Thread(tpool_thread_15, started daemon 132390165464768)>, <Thread(tpool_thread_16, started daemon 132390157055680)>, <Thread(tpool_thread_17, started daemon 132390148646592)>, <Thread(tpool_thread_18, started daemon 132390140237504)>, <Thread(tpool_thread_19, started daemon 132390131828416)>] {{(pid=88719) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 30 20:39:22 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [req-1d636170-ec63-439e-8e82-3d28430ca852 req-de3f707a-a833-40f5-952e-e46dacd0c081 tempest-TestServerVolumeAttachmentScenario-204017630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:39:22 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [req-1d636170-ec63-439e-8e82-3d28430ca852 req-de3f707a-a833-40f5-952e-e46dacd0c081 tempest-TestServerVolumeAttachmentScenario-204017630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:39:22 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [req-1d636170-ec63-439e-8e82-3d28430ca852 req-de3f707a-a833-40f5-952e-e46dacd0c081 tempest-TestServerVolumeAttachmentScenario-204017630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:39:22 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [req-1d636170-ec63-439e-8e82-3d28430ca852 req-de3f707a-a833-40f5-952e-e46dacd0c081 tempest-TestServerVolumeAttachmentScenario-204017630 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5', 'name': 'volume-a10dc318-5742-45f6-bae0-2d729e932792', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '47a3f5be-3f6c-40e0-a94a-b65d79af1553', 'enforce_multipath': True} {{(pid=88719) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 30 20:39:22 devstack cinder-volume[88719]: INFO cinder.volume.manager [req-1d636170-ec63-439e-8e82-3d28430ca852 req-de3f707a-a833-40f5-952e-e46dacd0c081 tempest-TestServerVolumeAttachmentScenario-204017630 None] attachment_update completed successfully.
Jul 30 20:39:26 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [req-8f900f69-c6a1-4815-a0d0-4e01e7567fb3 req-437618e9-48fe-4cd2-a027-0a4e94d2bc3e tempest-TestServerVolumeAttachmentScenario-204017630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:39:26 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [req-8f900f69-c6a1-4815-a0d0-4e01e7567fb3 req-437618e9-48fe-4cd2-a027-0a4e94d2bc3e tempest-TestServerVolumeAttachmentScenario-204017630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:39:26 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [req-8f900f69-c6a1-4815-a0d0-4e01e7567fb3 req-437618e9-48fe-4cd2-a027-0a4e94d2bc3e tempest-TestServerVolumeAttachmentScenario-204017630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.010s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:39:27 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [req-8f900f69-c6a1-4815-a0d0-4e01e7567fb3 req-437618e9-48fe-4cd2-a027-0a4e94d2bc3e tempest-TestServerVolumeAttachmentScenario-204017630 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5', 'name': 'volume-0385bb1f-1c4e-4ab2-912e-fb24b198cf3d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e37b4578-b337-475b-8c8c-ebbfe316e689', 'enforce_multipath': True} {{(pid=88719) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 30 20:39:27 devstack cinder-volume[88719]: INFO cinder.volume.manager [req-8f900f69-c6a1-4815-a0d0-4e01e7567fb3 req-437618e9-48fe-4cd2-a027-0a4e94d2bc3e tempest-TestServerVolumeAttachmentScenario-204017630 None] attachment_update completed successfully.
Jul 30 20:39:28 devstack cinder-volume[88719]: INFO cinder.volume.manager [req-08c3ae5e-1a78-4fc0-8161-7e7f4aa9d373 req-18e0e6f2-b2b2-41a6-9482-a5fd592674d3 tempest-TestServerVolumeAttachmentScenario-204017630 None] Terminate volume connection completed successfully.
Jul 30 20:39:28 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [req-08c3ae5e-1a78-4fc0-8161-7e7f4aa9d373 req-18e0e6f2-b2b2-41a6-9482-a5fd592674d3 tempest-TestServerVolumeAttachmentScenario-204017630 None] Deleting attachment e37b4578-b337-475b-8c8c-ebbfe316e689. {{(pid=88719) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 30 20:39:30 devstack cinder-volume[88719]: INFO cinder.volume.manager [req-388fd566-0a95-40a7-bc3e-ecba8aceb007 req-aacd1bef-7dde-4a6e-8d09-ed7f98bd3777 tempest-TestServerVolumeAttachmentScenario-204017630 None] Terminate volume connection completed successfully.
Jul 30 20:39:30 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [req-388fd566-0a95-40a7-bc3e-ecba8aceb007 req-aacd1bef-7dde-4a6e-8d09-ed7f98bd3777 tempest-TestServerVolumeAttachmentScenario-204017630 None] Deleting attachment 47a3f5be-3f6c-40e0-a94a-b65d79af1553. {{(pid=88719) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 30 20:39:34 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-9412edd3-bb32-4fb7-bded-7883aeeee6a4 tempest-TestServerVolumeAttachmentScenario-204017630 None] Acquiring lock "cinder-0385bb1f-1c4e-4ab2-912e-fb24b198cf3d-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:39:34 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-9412edd3-bb32-4fb7-bded-7883aeeee6a4 tempest-TestServerVolumeAttachmentScenario-204017630 None] Lock "cinder-0385bb1f-1c4e-4ab2-912e-fb24b198cf3d-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:39:34 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-9412edd3-bb32-4fb7-bded-7883aeeee6a4 tempest-TestServerVolumeAttachmentScenario-204017630 None] Acquiring lock "cinder-quobyte-0385bb1f-1c4e-4ab2-912e-fb24b198cf3d" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:39:34 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-9412edd3-bb32-4fb7-bded-7883aeeee6a4 tempest-TestServerVolumeAttachmentScenario-204017630 None] Lock "cinder-quobyte-0385bb1f-1c4e-4ab2-912e-fb24b198cf3d" acquired by "delete_volume" :: waited 0.015s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:39:34 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[1642fa87-d721-4f3c-a93b-b1e60540ad15]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:39:34 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-9412edd3-bb32-4fb7-bded-7883aeeee6a4 tempest-TestServerVolumeAttachmentScenario-204017630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0385bb1f-1c4e-4ab2-912e-fb24b198cf3d {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:39:34 devstack sudo[106919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0385bb1f-1c4e-4ab2-912e-fb24b198cf3d
Jul 30 20:39:34 devstack sudo[106919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:39:34 devstack sudo[106919]: pam_unix(sudo:session): session closed for user root
Jul 30 20:39:34 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-9412edd3-bb32-4fb7-bded-7883aeeee6a4 tempest-TestServerVolumeAttachmentScenario-204017630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0385bb1f-1c4e-4ab2-912e-fb24b198cf3d" returned: 0 in 0.345s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:39:34 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-9412edd3-bb32-4fb7-bded-7883aeeee6a4 tempest-TestServerVolumeAttachmentScenario-204017630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0385bb1f-1c4e-4ab2-912e-fb24b198cf3d {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:39:34 devstack sudo[106924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0385bb1f-1c4e-4ab2-912e-fb24b198cf3d
Jul 30 20:39:34 devstack sudo[106924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:39:35 devstack sudo[106924]: pam_unix(sudo:session): session closed for user root
Jul 30 20:39:35 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-9412edd3-bb32-4fb7-bded-7883aeeee6a4 tempest-TestServerVolumeAttachmentScenario-204017630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-0385bb1f-1c4e-4ab2-912e-fb24b198cf3d" returned: 0 in 0.241s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:39:35 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-9412edd3-bb32-4fb7-bded-7883aeeee6a4 tempest-TestServerVolumeAttachmentScenario-204017630 None] Lock "cinder-quobyte-0385bb1f-1c4e-4ab2-912e-fb24b198cf3d" released by "delete_volume" :: held 0.626s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:39:35 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-9412edd3-bb32-4fb7-bded-7883aeeee6a4 tempest-TestServerVolumeAttachmentScenario-204017630 None] Created reservations ['3e3c5225-5cc2-464d-85ce-2f34887c966f', '4aa01b48-393a-403b-a27c-2fabad31696b', 'a2066da9-2bab-4ac2-9d4f-c6aa60600e66', '3fede3e8-4bba-4a93-bec0-aa0857675874'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:39:35 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-9412edd3-bb32-4fb7-bded-7883aeeee6a4 tempest-TestServerVolumeAttachmentScenario-204017630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:39:35 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-9412edd3-bb32-4fb7-bded-7883aeeee6a4 tempest-TestServerVolumeAttachmentScenario-204017630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:39:35 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-9412edd3-bb32-4fb7-bded-7883aeeee6a4 tempest-TestServerVolumeAttachmentScenario-204017630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:39:35 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-9412edd3-bb32-4fb7-bded-7883aeeee6a4 tempest-TestServerVolumeAttachmentScenario-204017630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:39:35 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-9412edd3-bb32-4fb7-bded-7883aeeee6a4 tempest-TestServerVolumeAttachmentScenario-204017630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:39:35 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-9412edd3-bb32-4fb7-bded-7883aeeee6a4 tempest-TestServerVolumeAttachmentScenario-204017630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:39:35 devstack sudo[106929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:39:35 devstack sudo[106929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:39:35 devstack sudo[106929]: pam_unix(sudo:session): session closed for user root
Jul 30 20:39:35 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-9412edd3-bb32-4fb7-bded-7883aeeee6a4 tempest-TestServerVolumeAttachmentScenario-204017630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.237s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:39:35 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-9412edd3-bb32-4fb7-bded-7883aeeee6a4 tempest-TestServerVolumeAttachmentScenario-204017630 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:39:35 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-9412edd3-bb32-4fb7-bded-7883aeeee6a4 tempest-TestServerVolumeAttachmentScenario-204017630 None] Deleted volume successfully.
Jul 30 20:39:35 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-9412edd3-bb32-4fb7-bded-7883aeeee6a4 tempest-TestServerVolumeAttachmentScenario-204017630 None] Lock "cinder-0385bb1f-1c4e-4ab2-912e-fb24b198cf3d-delete_volume" released by "delete_volume" :: held 1.073s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:39:35 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-942d313a-4b95-49a1-8301-31acd36d4d4c tempest-TestServerVolumeAttachmentScenario-204017630 None] Acquiring lock "cinder-a10dc318-5742-45f6-bae0-2d729e932792-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:39:35 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-942d313a-4b95-49a1-8301-31acd36d4d4c tempest-TestServerVolumeAttachmentScenario-204017630 None] Lock "cinder-a10dc318-5742-45f6-bae0-2d729e932792-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:39:35 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-942d313a-4b95-49a1-8301-31acd36d4d4c tempest-TestServerVolumeAttachmentScenario-204017630 None] Acquiring lock "cinder-quobyte-a10dc318-5742-45f6-bae0-2d729e932792" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:39:35 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-942d313a-4b95-49a1-8301-31acd36d4d4c tempest-TestServerVolumeAttachmentScenario-204017630 None] Lock "cinder-quobyte-a10dc318-5742-45f6-bae0-2d729e932792" acquired by "delete_volume" :: waited 0.013s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:39:35 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[69364a05-6077-410f-a313-50a65144369a]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:39:35 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-942d313a-4b95-49a1-8301-31acd36d4d4c tempest-TestServerVolumeAttachmentScenario-204017630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-a10dc318-5742-45f6-bae0-2d729e932792 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:39:35 devstack sudo[106932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-a10dc318-5742-45f6-bae0-2d729e932792
Jul 30 20:39:35 devstack sudo[106932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:39:35 devstack sudo[106932]: pam_unix(sudo:session): session closed for user root
Jul 30 20:39:35 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-942d313a-4b95-49a1-8301-31acd36d4d4c tempest-TestServerVolumeAttachmentScenario-204017630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-a10dc318-5742-45f6-bae0-2d729e932792" returned: 0 in 0.345s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:39:35 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-942d313a-4b95-49a1-8301-31acd36d4d4c tempest-TestServerVolumeAttachmentScenario-204017630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-a10dc318-5742-45f6-bae0-2d729e932792 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:39:35 devstack sudo[106937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-a10dc318-5742-45f6-bae0-2d729e932792
Jul 30 20:39:35 devstack sudo[106937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:39:36 devstack sudo[106937]: pam_unix(sudo:session): session closed for user root
Jul 30 20:39:36 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-942d313a-4b95-49a1-8301-31acd36d4d4c tempest-TestServerVolumeAttachmentScenario-204017630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-a10dc318-5742-45f6-bae0-2d729e932792" returned: 0 in 0.238s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:39:36 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-942d313a-4b95-49a1-8301-31acd36d4d4c tempest-TestServerVolumeAttachmentScenario-204017630 None] Lock "cinder-quobyte-a10dc318-5742-45f6-bae0-2d729e932792" released by "delete_volume" :: held 0.619s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:39:36 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-942d313a-4b95-49a1-8301-31acd36d4d4c tempest-TestServerVolumeAttachmentScenario-204017630 None] Created reservations ['66dc02ea-5845-42bd-976a-eec4fbda94c5', 'f78292ea-621d-49db-acc0-75eeb2a80f96', '55352b21-19c8-4fc6-b9c7-5f38ee63e1ce', 'afc15760-32eb-4f3a-80ac-21c01301ddc9'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:39:36 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-942d313a-4b95-49a1-8301-31acd36d4d4c tempest-TestServerVolumeAttachmentScenario-204017630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:39:36 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-942d313a-4b95-49a1-8301-31acd36d4d4c tempest-TestServerVolumeAttachmentScenario-204017630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:39:36 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-942d313a-4b95-49a1-8301-31acd36d4d4c tempest-TestServerVolumeAttachmentScenario-204017630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:39:36 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-942d313a-4b95-49a1-8301-31acd36d4d4c tempest-TestServerVolumeAttachmentScenario-204017630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:39:36 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-942d313a-4b95-49a1-8301-31acd36d4d4c tempest-TestServerVolumeAttachmentScenario-204017630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:39:36 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-942d313a-4b95-49a1-8301-31acd36d4d4c tempest-TestServerVolumeAttachmentScenario-204017630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:39:36 devstack sudo[106940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:39:36 devstack sudo[106940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:39:36 devstack sudo[106940]: pam_unix(sudo:session): session closed for user root
Jul 30 20:39:36 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-942d313a-4b95-49a1-8301-31acd36d4d4c tempest-TestServerVolumeAttachmentScenario-204017630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.239s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:39:36 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-942d313a-4b95-49a1-8301-31acd36d4d4c tempest-TestServerVolumeAttachmentScenario-204017630 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:39:36 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-942d313a-4b95-49a1-8301-31acd36d4d4c tempest-TestServerVolumeAttachmentScenario-204017630 None] Deleted volume successfully.
Jul 30 20:39:36 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-942d313a-4b95-49a1-8301-31acd36d4d4c tempest-TestServerVolumeAttachmentScenario-204017630 None] Lock "cinder-a10dc318-5742-45f6-bae0-2d729e932792-delete_volume" released by "delete_volume" :: held 1.046s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:39:46 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-4867ded7-07d5-441c-b6ee-f8a8d5f73a14 tempest-VolumeDependencyTests-173226427 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:39:46 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-4867ded7-07d5-441c-b6ee-f8a8d5f73a14 tempest-VolumeDependencyTests-173226427 None] Flow 'volume_create_manager' (33c04324-8ab0-48c8-a2c2-92c3665178c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:39:46 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-4867ded7-07d5-441c-b6ee-f8a8d5f73a14 tempest-VolumeDependencyTests-173226427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89d0ee3b-e2c0-4cc6-8be5-382218c32cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:39:46 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-4867ded7-07d5-441c-b6ee-f8a8d5f73a14 tempest-VolumeDependencyTests-173226427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89d0ee3b-e2c0-4cc6-8be5-382218c32cff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:39:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-733726846',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16c96a24-f248-451f-b4d6-1f7f7b97a37c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b54a7f25553436d8a0e66452f1db433',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:39:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:39:46Z,use_quota=True,user_id='3481c0a6ded24997a70a80f5f71754c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:39:46 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-4867ded7-07d5-441c-b6ee-f8a8d5f73a14 tempest-VolumeDependencyTests-173226427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (061d4764-1104-4964-8798-1fcd73569dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:39:46 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-4867ded7-07d5-441c-b6ee-f8a8d5f73a14 tempest-VolumeDependencyTests-173226427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (061d4764-1104-4964-8798-1fcd73569dfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:39:46 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-4867ded7-07d5-441c-b6ee-f8a8d5f73a14 tempest-VolumeDependencyTests-173226427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d507a204-9365-4af2-a6ef-8fc641f68f8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:39:46 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-4867ded7-07d5-441c-b6ee-f8a8d5f73a14 tempest-VolumeDependencyTests-173226427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d507a204-9365-4af2-a6ef-8fc641f68f8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16c96a24-f248-451f-b4d6-1f7f7b97a37c', 'volume_name': 'volume-16c96a24-f248-451f-b4d6-1f7f7b97a37c', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:39:46 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-4867ded7-07d5-441c-b6ee-f8a8d5f73a14 tempest-VolumeDependencyTests-173226427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a69e0c1-dd84-4f6a-908c-4f1b815a7c24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:39:46 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-4867ded7-07d5-441c-b6ee-f8a8d5f73a14 tempest-VolumeDependencyTests-173226427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a69e0c1-dd84-4f6a-908c-4f1b815a7c24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:39:46 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-4867ded7-07d5-441c-b6ee-f8a8d5f73a14 tempest-VolumeDependencyTests-173226427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0d1c4d6-cfea-48ef-b549-252da1fa4097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:39:46 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-4867ded7-07d5-441c-b6ee-f8a8d5f73a14 tempest-VolumeDependencyTests-173226427 None] Volume 16c96a24-f248-451f-b4d6-1f7f7b97a37c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16c96a24-f248-451f-b4d6-1f7f7b97a37c', 'volume_size': 1}
Jul 30 20:39:46 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-4867ded7-07d5-441c-b6ee-f8a8d5f73a14 tempest-VolumeDependencyTests-173226427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:39:46 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-4867ded7-07d5-441c-b6ee-f8a8d5f73a14 tempest-VolumeDependencyTests-173226427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:39:46 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-4867ded7-07d5-441c-b6ee-f8a8d5f73a14 tempest-VolumeDependencyTests-173226427 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:39:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-733726846',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16c96a24-f248-451f-b4d6-1f7f7b97a37c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b54a7f25553436d8a0e66452f1db433',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:39:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:39:46Z,use_quota=True,user_id='3481c0a6ded24997a70a80f5f71754c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:39:46 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-4867ded7-07d5-441c-b6ee-f8a8d5f73a14 tempest-VolumeDependencyTests-173226427 None] Creating volume 16c96a24-f248-451f-b4d6-1f7f7b97a37c {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:39:46 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-4867ded7-07d5-441c-b6ee-f8a8d5f73a14 tempest-VolumeDependencyTests-173226427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:39:46 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-4867ded7-07d5-441c-b6ee-f8a8d5f73a14 tempest-VolumeDependencyTests-173226427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:39:46 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-4867ded7-07d5-441c-b6ee-f8a8d5f73a14 tempest-VolumeDependencyTests-173226427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:39:46 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-4867ded7-07d5-441c-b6ee-f8a8d5f73a14 tempest-VolumeDependencyTests-173226427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:39:46 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-4867ded7-07d5-441c-b6ee-f8a8d5f73a14 tempest-VolumeDependencyTests-173226427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:39:46 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-4867ded7-07d5-441c-b6ee-f8a8d5f73a14 tempest-VolumeDependencyTests-173226427 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:39:46 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-4867ded7-07d5-441c-b6ee-f8a8d5f73a14 tempest-VolumeDependencyTests-173226427 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:39:46 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-4867ded7-07d5-441c-b6ee-f8a8d5f73a14 tempest-VolumeDependencyTests-173226427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-16c96a24-f248-451f-b4d6-1f7f7b97a37c 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:39:46 devstack sudo[106950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-16c96a24-f248-451f-b4d6-1f7f7b97a37c 1073741824
Jul 30 20:39:46 devstack sudo[106950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:39:46 devstack sudo[106950]: pam_unix(sudo:session): session closed for user root
Jul 30 20:39:46 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-4867ded7-07d5-441c-b6ee-f8a8d5f73a14 tempest-VolumeDependencyTests-173226427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-16c96a24-f248-451f-b4d6-1f7f7b97a37c 1073741824" returned: 0 in 0.403s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:39:46 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-4867ded7-07d5-441c-b6ee-f8a8d5f73a14 tempest-VolumeDependencyTests-173226427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-16c96a24-f248-451f-b4d6-1f7f7b97a37c {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:39:46 devstack sudo[106955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-16c96a24-f248-451f-b4d6-1f7f7b97a37c
Jul 30 20:39:46 devstack sudo[106955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:39:46 devstack sudo[106955]: pam_unix(sudo:session): session closed for user root
Jul 30 20:39:46 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-4867ded7-07d5-441c-b6ee-f8a8d5f73a14 tempest-VolumeDependencyTests-173226427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-16c96a24-f248-451f-b4d6-1f7f7b97a37c" returned: 0 in 0.237s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:39:46 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-4867ded7-07d5-441c-b6ee-f8a8d5f73a14 tempest-VolumeDependencyTests-173226427 None] <== create_volume: return (680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:39:46 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-4867ded7-07d5-441c-b6ee-f8a8d5f73a14 tempest-VolumeDependencyTests-173226427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.683s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:39:46 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-4867ded7-07d5-441c-b6ee-f8a8d5f73a14 tempest-VolumeDependencyTests-173226427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0d1c4d6-cfea-48ef-b549-252da1fa4097) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16c96a24-f248-451f-b4d6-1f7f7b97a37c', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:39:46 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-4867ded7-07d5-441c-b6ee-f8a8d5f73a14 tempest-VolumeDependencyTests-173226427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (531229a0-db6a-46e0-a5d9-2ecdff00761b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:39:46 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-4867ded7-07d5-441c-b6ee-f8a8d5f73a14 tempest-VolumeDependencyTests-173226427 None] Volume volume-16c96a24-f248-451f-b4d6-1f7f7b97a37c (16c96a24-f248-451f-b4d6-1f7f7b97a37c): created successfully
Jul 30 20:39:46 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-4867ded7-07d5-441c-b6ee-f8a8d5f73a14 tempest-VolumeDependencyTests-173226427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (531229a0-db6a-46e0-a5d9-2ecdff00761b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:39:46 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-4867ded7-07d5-441c-b6ee-f8a8d5f73a14 tempest-VolumeDependencyTests-173226427 None] Flow 'volume_create_manager' (33c04324-8ab0-48c8-a2c2-92c3665178c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:39:46 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-4867ded7-07d5-441c-b6ee-f8a8d5f73a14 tempest-VolumeDependencyTests-173226427 None] Created volume successfully.
Jul 30 20:39:47 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-dd51b51e-20b5-40aa-8bc6-216397aa9f70 tempest-VolumeDependencyTests-173226427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:39:47 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-dd51b51e-20b5-40aa-8bc6-216397aa9f70 tempest-VolumeDependencyTests-173226427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:39:47 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-dd51b51e-20b5-40aa-8bc6-216397aa9f70 tempest-VolumeDependencyTests-173226427 None] Creating offline snapshot 7149b917-3c71-4758-9bfd-b7897a634ae2 of volume 16c96a24-f248-451f-b4d6-1f7f7b97a37c {{(pid=88719) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 30 20:39:47 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bfe20d0-7e03-47b7-893e-3be12b88dcb2]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:39:47 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-dd51b51e-20b5-40aa-8bc6-216397aa9f70 tempest-VolumeDependencyTests-173226427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-16c96a24-f248-451f-b4d6-1f7f7b97a37c {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:39:47 devstack sudo[106958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-16c96a24-f248-451f-b4d6-1f7f7b97a37c
Jul 30 20:39:47 devstack sudo[106958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:39:47 devstack sudo[106958]: pam_unix(sudo:session): session closed for user root
Jul 30 20:39:47 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-dd51b51e-20b5-40aa-8bc6-216397aa9f70 tempest-VolumeDependencyTests-173226427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-16c96a24-f248-451f-b4d6-1f7f7b97a37c" returned: 0 in 0.339s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:39:47 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-dd51b51e-20b5-40aa-8bc6-216397aa9f70 tempest-VolumeDependencyTests-173226427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-16c96a24-f248-451f-b4d6-1f7f7b97a37c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-16c96a24-f248-451f-b4d6-1f7f7b97a37c.7149b917-3c71-4758-9bfd-b7897a634ae2 1G {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:39:47 devstack sudo[106963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-16c96a24-f248-451f-b4d6-1f7f7b97a37c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-16c96a24-f248-451f-b4d6-1f7f7b97a37c.7149b917-3c71-4758-9bfd-b7897a634ae2 1G
Jul 30 20:39:47 devstack sudo[106963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:39:48 devstack sudo[106963]: pam_unix(sudo:session): session closed for user root
Jul 30 20:39:48 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-dd51b51e-20b5-40aa-8bc6-216397aa9f70 tempest-VolumeDependencyTests-173226427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-16c96a24-f248-451f-b4d6-1f7f7b97a37c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-16c96a24-f248-451f-b4d6-1f7f7b97a37c.7149b917-3c71-4758-9bfd-b7897a634ae2 1G" returned: 0 in 0.379s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:39:48 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-dd51b51e-20b5-40aa-8bc6-216397aa9f70 tempest-VolumeDependencyTests-173226427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16c96a24-f248-451f-b4d6-1f7f7b97a37c -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-16c96a24-f248-451f-b4d6-1f7f7b97a37c.7149b917-3c71-4758-9bfd-b7897a634ae2 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:39:48 devstack sudo[106969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16c96a24-f248-451f-b4d6-1f7f7b97a37c -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-16c96a24-f248-451f-b4d6-1f7f7b97a37c.7149b917-3c71-4758-9bfd-b7897a634ae2
Jul 30 20:39:48 devstack sudo[106969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:39:48 devstack sudo[106969]: pam_unix(sudo:session): session closed for user root
Jul 30 20:39:48 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-dd51b51e-20b5-40aa-8bc6-216397aa9f70 tempest-VolumeDependencyTests-173226427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16c96a24-f248-451f-b4d6-1f7f7b97a37c -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-16c96a24-f248-451f-b4d6-1f7f7b97a37c.7149b917-3c71-4758-9bfd-b7897a634ae2" returned: 0 in 0.295s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:39:48 devstack cinder-volume[88719]: WARNING cinder.volume.drivers.remotefs [None req-dd51b51e-20b5-40aa-8bc6-216397aa9f70 tempest-VolumeDependencyTests-173226427 None] /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-16c96a24-f248-451f-b4d6-1f7f7b97a37c.7149b917-3c71-4758-9bfd-b7897a634ae2 is being set with open permissions: ugo+rw
Jul 30 20:39:48 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-dd51b51e-20b5-40aa-8bc6-216397aa9f70 tempest-VolumeDependencyTests-173226427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-16c96a24-f248-451f-b4d6-1f7f7b97a37c.7149b917-3c71-4758-9bfd-b7897a634ae2 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:39:48 devstack sudo[106974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-16c96a24-f248-451f-b4d6-1f7f7b97a37c.7149b917-3c71-4758-9bfd-b7897a634ae2
Jul 30 20:39:48 devstack sudo[106974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:39:48 devstack sudo[106974]: pam_unix(sudo:session): session closed for user root
Jul 30 20:39:48 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-dd51b51e-20b5-40aa-8bc6-216397aa9f70 tempest-VolumeDependencyTests-173226427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-16c96a24-f248-451f-b4d6-1f7f7b97a37c.7149b917-3c71-4758-9bfd-b7897a634ae2" returned: 0 in 0.232s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:39:48 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-dd51b51e-20b5-40aa-8bc6-216397aa9f70 tempest-VolumeDependencyTests-173226427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-16c96a24-f248-451f-b4d6-1f7f7b97a37c.info {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:39:48 devstack sudo[106977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-16c96a24-f248-451f-b4d6-1f7f7b97a37c.info
Jul 30 20:39:48 devstack sudo[106977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:39:48 devstack sudo[106977]: pam_unix(sudo:session): session closed for user root
Jul 30 20:39:48 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-dd51b51e-20b5-40aa-8bc6-216397aa9f70 tempest-VolumeDependencyTests-173226427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-16c96a24-f248-451f-b4d6-1f7f7b97a37c.info" returned: 0 in 0.246s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:39:48 devstack cinder-volume[88719]: WARNING cinder.volume.drivers.remotefs [None req-dd51b51e-20b5-40aa-8bc6-216397aa9f70 tempest-VolumeDependencyTests-173226427 None] /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-16c96a24-f248-451f-b4d6-1f7f7b97a37c.info is being set with open permissions: ugo+rw
Jul 30 20:39:48 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-dd51b51e-20b5-40aa-8bc6-216397aa9f70 tempest-VolumeDependencyTests-173226427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-16c96a24-f248-451f-b4d6-1f7f7b97a37c.info {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:39:48 devstack sudo[106980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-16c96a24-f248-451f-b4d6-1f7f7b97a37c.info
Jul 30 20:39:48 devstack sudo[106980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:39:49 devstack sudo[106980]: pam_unix(sudo:session): session closed for user root
Jul 30 20:39:49 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-dd51b51e-20b5-40aa-8bc6-216397aa9f70 tempest-VolumeDependencyTests-173226427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-16c96a24-f248-451f-b4d6-1f7f7b97a37c.info" returned: 0 in 0.234s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:39:49 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-dd51b51e-20b5-40aa-8bc6-216397aa9f70 tempest-VolumeDependencyTests-173226427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.807s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:39:49 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-dd51b51e-20b5-40aa-8bc6-216397aa9f70 tempest-VolumeDependencyTests-173226427 None] Create snapshot completed successfully
Jul 30 20:39:49 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-471e0d25-1a6c-430b-b3de-293a28bb11cb tempest-VolumeDependencyTests-173226427 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:39:49 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-471e0d25-1a6c-430b-b3de-293a28bb11cb tempest-VolumeDependencyTests-173226427 None] Flow 'volume_create_manager' (a285431e-39c0-478d-97a6-5a7be2b940dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:39:49 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-471e0d25-1a6c-430b-b3de-293a28bb11cb tempest-VolumeDependencyTests-173226427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a8d9936-cb75-498e-92f1-753a734a23a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:39:49 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-471e0d25-1a6c-430b-b3de-293a28bb11cb tempest-VolumeDependencyTests-173226427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a8d9936-cb75-498e-92f1-753a734a23a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:39:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1553037843',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13a2c7da-cfa2-4819-9979-82650e0a194f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b54a7f25553436d8a0e66452f1db433',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:39:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7149b917-3c71-4758-9bfd-b7897a634ae2,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:39:50Z,use_quota=True,user_id='3481c0a6ded24997a70a80f5f71754c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:39:49 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-471e0d25-1a6c-430b-b3de-293a28bb11cb tempest-VolumeDependencyTests-173226427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddb38465-ff47-441b-8fb0-255a980d2f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:39:49 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-471e0d25-1a6c-430b-b3de-293a28bb11cb tempest-VolumeDependencyTests-173226427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddb38465-ff47-441b-8fb0-255a980d2f5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:39:49 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-471e0d25-1a6c-430b-b3de-293a28bb11cb tempest-VolumeDependencyTests-173226427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68eefd36-8892-4b77-b46c-02a4573b537d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:39:49 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-471e0d25-1a6c-430b-b3de-293a28bb11cb tempest-VolumeDependencyTests-173226427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68eefd36-8892-4b77-b46c-02a4573b537d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '13a2c7da-cfa2-4819-9979-82650e0a194f', 'volume_name': 'volume-13a2c7da-cfa2-4819-9979-82650e0a194f', 'volume_size': 1, 'snapshot_id': '7149b917-3c71-4758-9bfd-b7897a634ae2'}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:39:49 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-471e0d25-1a6c-430b-b3de-293a28bb11cb tempest-VolumeDependencyTests-173226427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb18b982-bdba-4f86-9c4b-b1ab31a7fda7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:39:49 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-471e0d25-1a6c-430b-b3de-293a28bb11cb tempest-VolumeDependencyTests-173226427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb18b982-bdba-4f86-9c4b-b1ab31a7fda7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:39:49 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-471e0d25-1a6c-430b-b3de-293a28bb11cb tempest-VolumeDependencyTests-173226427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c9f0396-258e-414f-a4a5-6ea6c000e5e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:39:49 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-471e0d25-1a6c-430b-b3de-293a28bb11cb tempest-VolumeDependencyTests-173226427 None] Volume 13a2c7da-cfa2-4819-9979-82650e0a194f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-13a2c7da-cfa2-4819-9979-82650e0a194f', 'volume_size': 1, 'snapshot_id': '7149b917-3c71-4758-9bfd-b7897a634ae2'}
Jul 30 20:39:49 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-471e0d25-1a6c-430b-b3de-293a28bb11cb tempest-VolumeDependencyTests-173226427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:39:49 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-471e0d25-1a6c-430b-b3de-293a28bb11cb tempest-VolumeDependencyTests-173226427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:39:49 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-471e0d25-1a6c-430b-b3de-293a28bb11cb tempest-VolumeDependencyTests-173226427 None] Acquiring lock "cinder-quobyte-7149b917-3c71-4758-9bfd-b7897a634ae2-13a2c7da-cfa2-4819-9979-82650e0a194f" by "_create_volume_from_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:39:50 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-471e0d25-1a6c-430b-b3de-293a28bb11cb tempest-VolumeDependencyTests-173226427 None] Lock "cinder-quobyte-7149b917-3c71-4758-9bfd-b7897a634ae2-13a2c7da-cfa2-4819-9979-82650e0a194f" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:39:50 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-471e0d25-1a6c-430b-b3de-293a28bb11cb tempest-VolumeDependencyTests-173226427 None] Creating volume 13a2c7da-cfa2-4819-9979-82650e0a194f from snapshot 7149b917-3c71-4758-9bfd-b7897a634ae2 {{(pid=88719) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Jul 30 20:39:50 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-471e0d25-1a6c-430b-b3de-293a28bb11cb tempest-VolumeDependencyTests-173226427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:39:50 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-471e0d25-1a6c-430b-b3de-293a28bb11cb tempest-VolumeDependencyTests-173226427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:39:50 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-471e0d25-1a6c-430b-b3de-293a28bb11cb tempest-VolumeDependencyTests-173226427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:39:50 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-471e0d25-1a6c-430b-b3de-293a28bb11cb tempest-VolumeDependencyTests-173226427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:39:50 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-471e0d25-1a6c-430b-b3de-293a28bb11cb tempest-VolumeDependencyTests-173226427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:39:50 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-471e0d25-1a6c-430b-b3de-293a28bb11cb tempest-VolumeDependencyTests-173226427 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:39:50 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-471e0d25-1a6c-430b-b3de-293a28bb11cb tempest-VolumeDependencyTests-173226427 None] Acquiring lock "cinder-quobyte-13a2c7da-cfa2-4819-9979-82650e0a194f" by "_copy_volume_from_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:39:50 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-471e0d25-1a6c-430b-b3de-293a28bb11cb tempest-VolumeDependencyTests-173226427 None] Lock "cinder-quobyte-13a2c7da-cfa2-4819-9979-82650e0a194f" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:39:50 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-471e0d25-1a6c-430b-b3de-293a28bb11cb tempest-VolumeDependencyTests-173226427 None] snapshot: 7149b917-3c71-4758-9bfd-b7897a634ae2, volume: 13a2c7da-cfa2-4819-9979-82650e0a194f,  {{(pid=88719) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}}
Jul 30 20:39:50 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-471e0d25-1a6c-430b-b3de-293a28bb11cb tempest-VolumeDependencyTests-173226427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:39:50 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-471e0d25-1a6c-430b-b3de-293a28bb11cb tempest-VolumeDependencyTests-173226427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:39:50 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-471e0d25-1a6c-430b-b3de-293a28bb11cb tempest-VolumeDependencyTests-173226427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:39:50 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-471e0d25-1a6c-430b-b3de-293a28bb11cb tempest-VolumeDependencyTests-173226427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:39:50 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-471e0d25-1a6c-430b-b3de-293a28bb11cb tempest-VolumeDependencyTests-173226427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:39:50 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c08b758-3fa7-40d3-837f-a14fb0efcc7d]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:39:50 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-471e0d25-1a6c-430b-b3de-293a28bb11cb tempest-VolumeDependencyTests-173226427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-16c96a24-f248-451f-b4d6-1f7f7b97a37c.7149b917-3c71-4758-9bfd-b7897a634ae2 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:39:50 devstack sudo[106983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-16c96a24-f248-451f-b4d6-1f7f7b97a37c.7149b917-3c71-4758-9bfd-b7897a634ae2
Jul 30 20:39:50 devstack sudo[106983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:39:50 devstack sudo[106983]: pam_unix(sudo:session): session closed for user root
Jul 30 20:39:50 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-471e0d25-1a6c-430b-b3de-293a28bb11cb tempest-VolumeDependencyTests-173226427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-16c96a24-f248-451f-b4d6-1f7f7b97a37c.7149b917-3c71-4758-9bfd-b7897a634ae2" returned: 0 in 0.352s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:39:50 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-471e0d25-1a6c-430b-b3de-293a28bb11cb tempest-VolumeDependencyTests-173226427 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-16c96a24-f248-451f-b4d6-1f7f7b97a37c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88719) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 30 20:39:50 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae8bf688-550c-479b-86d8-14da48c5a223]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:39:50 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-471e0d25-1a6c-430b-b3de-293a28bb11cb tempest-VolumeDependencyTests-173226427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-16c96a24-f248-451f-b4d6-1f7f7b97a37c {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:39:50 devstack sudo[106988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-16c96a24-f248-451f-b4d6-1f7f7b97a37c
Jul 30 20:39:50 devstack sudo[106988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:39:50 devstack sudo[106988]: pam_unix(sudo:session): session closed for user root
Jul 30 20:39:50 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-471e0d25-1a6c-430b-b3de-293a28bb11cb tempest-VolumeDependencyTests-173226427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-16c96a24-f248-451f-b4d6-1f7f7b97a37c" returned: 0 in 0.337s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:39:50 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-471e0d25-1a6c-430b-b3de-293a28bb11cb tempest-VolumeDependencyTests-173226427 None] will copy from snapshot at /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-16c96a24-f248-451f-b4d6-1f7f7b97a37c {{(pid=88719) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}}
Jul 30 20:39:50 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-471e0d25-1a6c-430b-b3de-293a28bb11cb tempest-VolumeDependencyTests-173226427 None] Creating direct copy from snapshot {{(pid=88719) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}}
Jul 30 20:39:50 devstack cinder-volume[88719]: DEBUG cinder.utils [None req-471e0d25-1a6c-430b-b3de-293a28bb11cb tempest-VolumeDependencyTests-173226427 None] Path /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-13a2c7da-cfa2-4819-9979-82650e0a194f not found in is_blk_device check {{(pid=88719) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 30 20:39:50 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-471e0d25-1a6c-430b-b3de-293a28bb11cb tempest-VolumeDependencyTests-173226427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-16c96a24-f248-451f-b4d6-1f7f7b97a37c /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-13a2c7da-cfa2-4819-9979-82650e0a194f {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:39:50 devstack sudo[106993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-16c96a24-f248-451f-b4d6-1f7f7b97a37c /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-13a2c7da-cfa2-4819-9979-82650e0a194f
Jul 30 20:39:50 devstack sudo[106993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:39:54 devstack sudo[106993]: pam_unix(sudo:session): session closed for user root
Jul 30 20:39:54 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-471e0d25-1a6c-430b-b3de-293a28bb11cb tempest-VolumeDependencyTests-173226427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-16c96a24-f248-451f-b4d6-1f7f7b97a37c /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-13a2c7da-cfa2-4819-9979-82650e0a194f" returned: 0 in 4.041s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:39:54 devstack cinder-volume[88719]: DEBUG cinder.image.image_utils [None req-471e0d25-1a6c-430b-b3de-293a28bb11cb tempest-VolumeDependencyTests-173226427 None] Image conversion details: src /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-16c96a24-f248-451f-b4d6-1f7f7b97a37c, size 1024.00 MB, duration 4.04 sec, destination /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-13a2c7da-cfa2-4819-9979-82650e0a194f {{(pid=88719) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 30 20:39:54 devstack cinder-volume[88719]: INFO cinder.image.image_utils [None req-471e0d25-1a6c-430b-b3de-293a28bb11cb tempest-VolumeDependencyTests-173226427 None] Converted 1024.00 MB image at 253.30 MB/s
Jul 30 20:39:54 devstack cinder-volume[88719]: WARNING cinder.volume.drivers.remotefs [None req-471e0d25-1a6c-430b-b3de-293a28bb11cb tempest-VolumeDependencyTests-173226427 None] /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-13a2c7da-cfa2-4819-9979-82650e0a194f is being set with open permissions: ugo+rw
Jul 30 20:39:54 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-471e0d25-1a6c-430b-b3de-293a28bb11cb tempest-VolumeDependencyTests-173226427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-13a2c7da-cfa2-4819-9979-82650e0a194f {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:39:54 devstack sudo[107006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-13a2c7da-cfa2-4819-9979-82650e0a194f
Jul 30 20:39:54 devstack sudo[107006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:39:55 devstack sudo[107006]: pam_unix(sudo:session): session closed for user root
Jul 30 20:39:55 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-471e0d25-1a6c-430b-b3de-293a28bb11cb tempest-VolumeDependencyTests-173226427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-13a2c7da-cfa2-4819-9979-82650e0a194f" returned: 0 in 0.234s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:39:55 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-471e0d25-1a6c-430b-b3de-293a28bb11cb tempest-VolumeDependencyTests-173226427 None] Lock "cinder-quobyte-13a2c7da-cfa2-4819-9979-82650e0a194f" released by "_copy_volume_from_snapshot" :: held 5.035s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:39:55 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-471e0d25-1a6c-430b-b3de-293a28bb11cb tempest-VolumeDependencyTests-173226427 None] Lock "cinder-quobyte-7149b917-3c71-4758-9bfd-b7897a634ae2-13a2c7da-cfa2-4819-9979-82650e0a194f" released by "_create_volume_from_snapshot" :: held 5.092s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:39:55 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-471e0d25-1a6c-430b-b3de-293a28bb11cb tempest-VolumeDependencyTests-173226427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.107s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:39:55 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-471e0d25-1a6c-430b-b3de-293a28bb11cb tempest-VolumeDependencyTests-173226427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c9f0396-258e-414f-a4a5-6ea6c000e5e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13a2c7da-cfa2-4819-9979-82650e0a194f', 'volume_size': 1, 'snapshot_id': '7149b917-3c71-4758-9bfd-b7897a634ae2'}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:39:55 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-471e0d25-1a6c-430b-b3de-293a28bb11cb tempest-VolumeDependencyTests-173226427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (776470f2-2a48-4993-b72c-15a42566f16c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:39:55 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-471e0d25-1a6c-430b-b3de-293a28bb11cb tempest-VolumeDependencyTests-173226427 None] Volume volume-13a2c7da-cfa2-4819-9979-82650e0a194f (13a2c7da-cfa2-4819-9979-82650e0a194f): created successfully
Jul 30 20:39:55 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-471e0d25-1a6c-430b-b3de-293a28bb11cb tempest-VolumeDependencyTests-173226427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (776470f2-2a48-4993-b72c-15a42566f16c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:39:55 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-471e0d25-1a6c-430b-b3de-293a28bb11cb tempest-VolumeDependencyTests-173226427 None] Flow 'volume_create_manager' (a285431e-39c0-478d-97a6-5a7be2b940dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:39:55 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-471e0d25-1a6c-430b-b3de-293a28bb11cb tempest-VolumeDependencyTests-173226427 None] Created volume successfully.
Jul 30 20:39:55 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-11cbac92-7f25-4674-8b86-79e666489be1 tempest-VolumeDependencyTests-173226427 None] Acquiring lock "cinder-7149b917-3c71-4758-9bfd-b7897a634ae2-delete_snapshot" by "delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:39:55 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-11cbac92-7f25-4674-8b86-79e666489be1 tempest-VolumeDependencyTests-173226427 None] Lock "cinder-7149b917-3c71-4758-9bfd-b7897a634ae2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:39:55 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-11cbac92-7f25-4674-8b86-79e666489be1 tempest-VolumeDependencyTests-173226427 None] Acquiring lock "cinder-quobyte-16c96a24-f248-451f-b4d6-1f7f7b97a37c" by "delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:39:55 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-11cbac92-7f25-4674-8b86-79e666489be1 tempest-VolumeDependencyTests-173226427 None] Lock "cinder-quobyte-16c96a24-f248-451f-b4d6-1f7f7b97a37c" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:39:55 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-11cbac92-7f25-4674-8b86-79e666489be1 tempest-VolumeDependencyTests-173226427 None] Acquiring lock "cinder-quobyte-7149b917-3c71-4758-9bfd-b7897a634ae2" by "_delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:39:55 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-11cbac92-7f25-4674-8b86-79e666489be1 tempest-VolumeDependencyTests-173226427 None] Lock "cinder-quobyte-7149b917-3c71-4758-9bfd-b7897a634ae2" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:39:55 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-11cbac92-7f25-4674-8b86-79e666489be1 tempest-VolumeDependencyTests-173226427 None] Deleting offline snapshot 7149b917-3c71-4758-9bfd-b7897a634ae2 of volume 16c96a24-f248-451f-b4d6-1f7f7b97a37c {{(pid=88719) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 30 20:39:55 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-11cbac92-7f25-4674-8b86-79e666489be1 tempest-VolumeDependencyTests-173226427 None] snapshot_file for this snap is: volume-16c96a24-f248-451f-b4d6-1f7f7b97a37c.7149b917-3c71-4758-9bfd-b7897a634ae2 {{(pid=88719) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 30 20:39:55 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[322f1c4c-ff6f-4cf9-8559-62f79d657bc3]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:39:55 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-11cbac92-7f25-4674-8b86-79e666489be1 tempest-VolumeDependencyTests-173226427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-16c96a24-f248-451f-b4d6-1f7f7b97a37c.7149b917-3c71-4758-9bfd-b7897a634ae2 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:39:55 devstack sudo[107010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-16c96a24-f248-451f-b4d6-1f7f7b97a37c.7149b917-3c71-4758-9bfd-b7897a634ae2
Jul 30 20:39:55 devstack sudo[107010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:39:55 devstack sudo[107010]: pam_unix(sudo:session): session closed for user root
Jul 30 20:39:55 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-11cbac92-7f25-4674-8b86-79e666489be1 tempest-VolumeDependencyTests-173226427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-16c96a24-f248-451f-b4d6-1f7f7b97a37c.7149b917-3c71-4758-9bfd-b7897a634ae2" returned: 0 in 0.354s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:39:55 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-11cbac92-7f25-4674-8b86-79e666489be1 tempest-VolumeDependencyTests-173226427 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-16c96a24-f248-451f-b4d6-1f7f7b97a37c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88719) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 30 20:39:55 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[87de6222-1a01-4e1f-916a-da9d7f80006e]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:39:55 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-11cbac92-7f25-4674-8b86-79e666489be1 tempest-VolumeDependencyTests-173226427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-16c96a24-f248-451f-b4d6-1f7f7b97a37c {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:39:55 devstack sudo[107015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-16c96a24-f248-451f-b4d6-1f7f7b97a37c
Jul 30 20:39:55 devstack sudo[107015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:39:56 devstack sudo[107015]: pam_unix(sudo:session): session closed for user root
Jul 30 20:39:56 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-11cbac92-7f25-4674-8b86-79e666489be1 tempest-VolumeDependencyTests-173226427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-16c96a24-f248-451f-b4d6-1f7f7b97a37c" returned: 0 in 0.509s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:39:56 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-11cbac92-7f25-4674-8b86-79e666489be1 tempest-VolumeDependencyTests-173226427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-16c96a24-f248-451f-b4d6-1f7f7b97a37c.7149b917-3c71-4758-9bfd-b7897a634ae2 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:39:56 devstack sudo[107020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-16c96a24-f248-451f-b4d6-1f7f7b97a37c.7149b917-3c71-4758-9bfd-b7897a634ae2
Jul 30 20:39:56 devstack sudo[107020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:39:56 devstack sudo[107020]: pam_unix(sudo:session): session closed for user root
Jul 30 20:39:56 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-11cbac92-7f25-4674-8b86-79e666489be1 tempest-VolumeDependencyTests-173226427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-16c96a24-f248-451f-b4d6-1f7f7b97a37c.7149b917-3c71-4758-9bfd-b7897a634ae2" returned: 0 in 0.327s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:39:56 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-11cbac92-7f25-4674-8b86-79e666489be1 tempest-VolumeDependencyTests-173226427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-16c96a24-f248-451f-b4d6-1f7f7b97a37c.7149b917-3c71-4758-9bfd-b7897a634ae2 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:39:56 devstack sudo[107025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-16c96a24-f248-451f-b4d6-1f7f7b97a37c.7149b917-3c71-4758-9bfd-b7897a634ae2
Jul 30 20:39:56 devstack sudo[107025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:39:56 devstack sudo[107025]: pam_unix(sudo:session): session closed for user root
Jul 30 20:39:56 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-11cbac92-7f25-4674-8b86-79e666489be1 tempest-VolumeDependencyTests-173226427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-16c96a24-f248-451f-b4d6-1f7f7b97a37c.7149b917-3c71-4758-9bfd-b7897a634ae2" returned: 0 in 0.241s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:39:56 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-11cbac92-7f25-4674-8b86-79e666489be1 tempest-VolumeDependencyTests-173226427 None] Lock "cinder-quobyte-7149b917-3c71-4758-9bfd-b7897a634ae2" released by "_delete_snapshot" :: held 1.525s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:39:56 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-11cbac92-7f25-4674-8b86-79e666489be1 tempest-VolumeDependencyTests-173226427 None] Lock "cinder-quobyte-16c96a24-f248-451f-b4d6-1f7f7b97a37c" released by "delete_snapshot" :: held 1.546s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:39:57 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-11cbac92-7f25-4674-8b86-79e666489be1 tempest-VolumeDependencyTests-173226427 None] Created reservations ['9f4098f5-726e-41a2-b0bd-cba5efee5e77', '4df89a0e-fa68-46cf-a64f-b98f0af2c15b', '59363298-1212-45e5-afcb-05af0d4cefe9', '8ee64279-e810-4a99-82c4-78e1546a3095'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:39:57 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-11cbac92-7f25-4674-8b86-79e666489be1 tempest-VolumeDependencyTests-173226427 None] Delete snapshot completed successfully.
Jul 30 20:39:57 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-11cbac92-7f25-4674-8b86-79e666489be1 tempest-VolumeDependencyTests-173226427 None] Lock "cinder-7149b917-3c71-4758-9bfd-b7897a634ae2-delete_snapshot" released by "delete_snapshot" :: held 1.681s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:39:57 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-21dba2c6-0e11-4b26-af14-acf22dc12ede tempest-VolumeDependencyTests-173226427 None] Acquiring lock "cinder-16c96a24-f248-451f-b4d6-1f7f7b97a37c-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:39:57 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-21dba2c6-0e11-4b26-af14-acf22dc12ede tempest-VolumeDependencyTests-173226427 None] Lock "cinder-16c96a24-f248-451f-b4d6-1f7f7b97a37c-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:39:57 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-21dba2c6-0e11-4b26-af14-acf22dc12ede tempest-VolumeDependencyTests-173226427 None] Acquiring lock "cinder-quobyte-16c96a24-f248-451f-b4d6-1f7f7b97a37c" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:39:57 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-21dba2c6-0e11-4b26-af14-acf22dc12ede tempest-VolumeDependencyTests-173226427 None] Lock "cinder-quobyte-16c96a24-f248-451f-b4d6-1f7f7b97a37c" acquired by "delete_volume" :: waited 0.014s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:39:57 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[74e8cab2-cc23-4cda-9134-d74fe508ccc3]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:39:57 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-21dba2c6-0e11-4b26-af14-acf22dc12ede tempest-VolumeDependencyTests-173226427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-16c96a24-f248-451f-b4d6-1f7f7b97a37c {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:39:57 devstack sudo[107028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-16c96a24-f248-451f-b4d6-1f7f7b97a37c
Jul 30 20:39:57 devstack sudo[107028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:39:57 devstack sudo[107028]: pam_unix(sudo:session): session closed for user root
Jul 30 20:39:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-21dba2c6-0e11-4b26-af14-acf22dc12ede tempest-VolumeDependencyTests-173226427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-16c96a24-f248-451f-b4d6-1f7f7b97a37c" returned: 0 in 0.353s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:39:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-21dba2c6-0e11-4b26-af14-acf22dc12ede tempest-VolumeDependencyTests-173226427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-16c96a24-f248-451f-b4d6-1f7f7b97a37c {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:39:58 devstack sudo[107033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-16c96a24-f248-451f-b4d6-1f7f7b97a37c
Jul 30 20:39:58 devstack sudo[107033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:39:58 devstack sudo[107033]: pam_unix(sudo:session): session closed for user root
Jul 30 20:39:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-21dba2c6-0e11-4b26-af14-acf22dc12ede tempest-VolumeDependencyTests-173226427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-16c96a24-f248-451f-b4d6-1f7f7b97a37c" returned: 0 in 0.240s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:39:58 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-21dba2c6-0e11-4b26-af14-acf22dc12ede tempest-VolumeDependencyTests-173226427 None] Lock "cinder-quobyte-16c96a24-f248-451f-b4d6-1f7f7b97a37c" released by "delete_volume" :: held 0.651s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:39:58 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-21dba2c6-0e11-4b26-af14-acf22dc12ede tempest-VolumeDependencyTests-173226427 None] Created reservations ['6068ab4c-68a0-4434-a2b1-c77dce88bb53', '883fd5b2-c6b6-4cc6-861e-9130f18d3159', 'f4867017-b885-4f2d-8f43-414be0541b2f', 'ad9ab42d-4994-4dd0-a5b5-0ae7a39c725f'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:39:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-21dba2c6-0e11-4b26-af14-acf22dc12ede tempest-VolumeDependencyTests-173226427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:39:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-21dba2c6-0e11-4b26-af14-acf22dc12ede tempest-VolumeDependencyTests-173226427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:39:58 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-21dba2c6-0e11-4b26-af14-acf22dc12ede tempest-VolumeDependencyTests-173226427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:39:58 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-21dba2c6-0e11-4b26-af14-acf22dc12ede tempest-VolumeDependencyTests-173226427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:39:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-21dba2c6-0e11-4b26-af14-acf22dc12ede tempest-VolumeDependencyTests-173226427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:39:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-21dba2c6-0e11-4b26-af14-acf22dc12ede tempest-VolumeDependencyTests-173226427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:39:58 devstack sudo[107036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:39:58 devstack sudo[107036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:39:58 devstack sudo[107036]: pam_unix(sudo:session): session closed for user root
Jul 30 20:39:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-21dba2c6-0e11-4b26-af14-acf22dc12ede tempest-VolumeDependencyTests-173226427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.237s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:39:58 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-21dba2c6-0e11-4b26-af14-acf22dc12ede tempest-VolumeDependencyTests-173226427 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:39:58 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-21dba2c6-0e11-4b26-af14-acf22dc12ede tempest-VolumeDependencyTests-173226427 None] Deleted volume successfully.
Jul 30 20:39:58 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-21dba2c6-0e11-4b26-af14-acf22dc12ede tempest-VolumeDependencyTests-173226427 None] Lock "cinder-16c96a24-f248-451f-b4d6-1f7f7b97a37c-delete_volume" released by "delete_volume" :: held 1.074s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:39:58 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-3f88005e-b8bb-421a-9163-b8d755e28b99 tempest-VolumeDependencyTests-173226427 None] Acquiring lock "cinder-13a2c7da-cfa2-4819-9979-82650e0a194f-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:39:58 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-3f88005e-b8bb-421a-9163-b8d755e28b99 tempest-VolumeDependencyTests-173226427 None] Lock "cinder-13a2c7da-cfa2-4819-9979-82650e0a194f-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:39:58 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-3f88005e-b8bb-421a-9163-b8d755e28b99 tempest-VolumeDependencyTests-173226427 None] Acquiring lock "cinder-quobyte-13a2c7da-cfa2-4819-9979-82650e0a194f" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:39:58 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-3f88005e-b8bb-421a-9163-b8d755e28b99 tempest-VolumeDependencyTests-173226427 None] Lock "cinder-quobyte-13a2c7da-cfa2-4819-9979-82650e0a194f" acquired by "delete_volume" :: waited 0.015s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:39:58 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[539b6405-a274-4a0d-8869-964da1d295c6]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:39:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3f88005e-b8bb-421a-9163-b8d755e28b99 tempest-VolumeDependencyTests-173226427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-13a2c7da-cfa2-4819-9979-82650e0a194f {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:39:58 devstack sudo[107039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-13a2c7da-cfa2-4819-9979-82650e0a194f
Jul 30 20:39:58 devstack sudo[107039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:39:59 devstack sudo[107039]: pam_unix(sudo:session): session closed for user root
Jul 30 20:39:59 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3f88005e-b8bb-421a-9163-b8d755e28b99 tempest-VolumeDependencyTests-173226427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-13a2c7da-cfa2-4819-9979-82650e0a194f" returned: 0 in 0.350s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:39:59 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3f88005e-b8bb-421a-9163-b8d755e28b99 tempest-VolumeDependencyTests-173226427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-13a2c7da-cfa2-4819-9979-82650e0a194f {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:39:59 devstack sudo[107044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-13a2c7da-cfa2-4819-9979-82650e0a194f
Jul 30 20:39:59 devstack sudo[107044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:39:59 devstack sudo[107044]: pam_unix(sudo:session): session closed for user root
Jul 30 20:39:59 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3f88005e-b8bb-421a-9163-b8d755e28b99 tempest-VolumeDependencyTests-173226427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-13a2c7da-cfa2-4819-9979-82650e0a194f" returned: 0 in 0.238s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:39:59 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-3f88005e-b8bb-421a-9163-b8d755e28b99 tempest-VolumeDependencyTests-173226427 None] Lock "cinder-quobyte-13a2c7da-cfa2-4819-9979-82650e0a194f" released by "delete_volume" :: held 0.625s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:39:59 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-3f88005e-b8bb-421a-9163-b8d755e28b99 tempest-VolumeDependencyTests-173226427 None] Created reservations ['2368f0da-a1fa-4e1d-b94b-d02b2fd5ffb5', 'aeff63b7-a976-4643-84d2-6739525e41ed', 'ff122ab6-fecb-46e1-a114-e073ffd5f130', '5b512b28-9ceb-48c6-9452-24223262224d'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:39:59 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-3f88005e-b8bb-421a-9163-b8d755e28b99 tempest-VolumeDependencyTests-173226427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:39:59 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-3f88005e-b8bb-421a-9163-b8d755e28b99 tempest-VolumeDependencyTests-173226427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:39:59 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-3f88005e-b8bb-421a-9163-b8d755e28b99 tempest-VolumeDependencyTests-173226427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:39:59 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-3f88005e-b8bb-421a-9163-b8d755e28b99 tempest-VolumeDependencyTests-173226427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:39:59 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-3f88005e-b8bb-421a-9163-b8d755e28b99 tempest-VolumeDependencyTests-173226427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:39:59 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3f88005e-b8bb-421a-9163-b8d755e28b99 tempest-VolumeDependencyTests-173226427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:39:59 devstack sudo[107047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:39:59 devstack sudo[107047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:39:59 devstack sudo[107047]: pam_unix(sudo:session): session closed for user root
Jul 30 20:39:59 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3f88005e-b8bb-421a-9163-b8d755e28b99 tempest-VolumeDependencyTests-173226427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.239s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:39:59 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-3f88005e-b8bb-421a-9163-b8d755e28b99 tempest-VolumeDependencyTests-173226427 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:39:59 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-3f88005e-b8bb-421a-9163-b8d755e28b99 tempest-VolumeDependencyTests-173226427 None] Deleted volume successfully.
Jul 30 20:39:59 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-3f88005e-b8bb-421a-9163-b8d755e28b99 tempest-VolumeDependencyTests-173226427 None] Lock "cinder-13a2c7da-cfa2-4819-9979-82650e0a194f-delete_volume" released by "delete_volume" :: held 1.048s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:40:09 devstack cinder-volume[88719]: DEBUG dbcounter [-] [88719] Writing DB stats cinder:SELECT=48,cinder:UPDATE=50,cinder:INSERT=11,cinder:DELETE=3 {{(pid=88719) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 30 20:40:09 devstack cinder-volume[88719]: DEBUG dbcounter [-] [88719] Writing DB stats cinder:SELECT=52,cinder:UPDATE=47,cinder:INSERT=12,cinder:DELETE=4 {{(pid=88719) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 30 20:40:16 devstack cinder-volume[88719]: DEBUG oslo_service.periodic_task [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88719) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 30 20:40:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:40:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:40:16 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:40:16 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:40:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:40:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:16 devstack sudo[107121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:40:16 devstack sudo[107121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:16 devstack sudo[107121]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.245s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:16 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:40:16 devstack cinder-volume[88719]: DEBUG oslo_service.periodic_task [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Running periodic task VolumeManager._thread_info {{(pid=88719) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 30 20:40:16 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] thread count: 28 {{(pid=88719) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 30 20:40:16 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] thread info: [<_MainThread(MainThread, started 132390416908416)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132390306497536)>, <Thread(Thread-3 (stat_writer), started daemon 132390304471680)>, <Thread(Rabbit-heartbeat, started daemon 132390303393408)>, <Thread(Thread-5 (_runner), started daemon 132390303543168)>, <Thread(Thread-7 (_runner), started daemon 132390303563392)>, <Thread(fd_logger, started daemon 132390301344640)>, <Thread(privsep_reader, started daemon 132390301560640)>, <Thread(tpool_thread_0, started daemon 132390291470016)>, <Thread(tpool_thread_1, started daemon 132390283077312)>, <Thread(tpool_thread_2, started daemon 132390274684608)>, <Thread(tpool_thread_3, started daemon 132390266291904)>, <Thread(tpool_thread_4, started daemon 132390257899200)>, <Thread(tpool_thread_5, started daemon 132390249506496)>, <Thread(tpool_thread_6, started daemon 132390241113792)>, <Thread(tpool_thread_7, started daemon 132390232721088)>, <Thread(tpool_thread_8, started daemon 132390224328384)>, <Thread(tpool_thread_9, started daemon 132390215919296)>, <Thread(tpool_thread_10, started daemon 132390207510208)>, <Thread(tpool_thread_11, started daemon 132390199101120)>, <Thread(tpool_thread_12, started daemon 132390190692032)>, <Thread(tpool_thread_13, started daemon 132390182282944)>, <Thread(tpool_thread_14, started daemon 132390173873856)>, <Thread(tpool_thread_15, started daemon 132390165464768)>, <Thread(tpool_thread_16, started daemon 132390157055680)>, <Thread(tpool_thread_17, started daemon 132390148646592)>, <Thread(tpool_thread_18, started daemon 132390140237504)>, <Thread(tpool_thread_19, started daemon 132390131828416)>] {{(pid=88719) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 30 20:40:24 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-776b248e-e11b-4eb0-97af-78c4125505ef tempest-CreateVolumesFromSnapshotTest-1096389075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:40:24 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-776b248e-e11b-4eb0-97af-78c4125505ef tempest-CreateVolumesFromSnapshotTest-1096389075 None] Flow 'volume_create_manager' (b7d176e5-e3ca-4950-aa8f-4557ff728150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:40:24 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-776b248e-e11b-4eb0-97af-78c4125505ef tempest-CreateVolumesFromSnapshotTest-1096389075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f89801a-5df9-4a75-8077-99da63947b2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:24 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-776b248e-e11b-4eb0-97af-78c4125505ef tempest-CreateVolumesFromSnapshotTest-1096389075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f89801a-5df9-4a75-8077-99da63947b2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:40:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-312447775',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efae64d4-0356-42c0-8d82-bf512cf6c201,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd1f96963de14944bf651afe61967374',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:40:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:40:24Z,use_quota=True,user_id='e8bf019004ba44838613267030b09257',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:24 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-776b248e-e11b-4eb0-97af-78c4125505ef tempest-CreateVolumesFromSnapshotTest-1096389075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b677f1d9-105f-4f60-8d98-bafbc6eaf193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:24 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-776b248e-e11b-4eb0-97af-78c4125505ef tempest-CreateVolumesFromSnapshotTest-1096389075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b677f1d9-105f-4f60-8d98-bafbc6eaf193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:24 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-776b248e-e11b-4eb0-97af-78c4125505ef tempest-CreateVolumesFromSnapshotTest-1096389075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dca40bec-01cf-488f-a795-7df85761b231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:24 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-776b248e-e11b-4eb0-97af-78c4125505ef tempest-CreateVolumesFromSnapshotTest-1096389075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dca40bec-01cf-488f-a795-7df85761b231) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'efae64d4-0356-42c0-8d82-bf512cf6c201', 'volume_name': 'volume-efae64d4-0356-42c0-8d82-bf512cf6c201', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:24 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-776b248e-e11b-4eb0-97af-78c4125505ef tempest-CreateVolumesFromSnapshotTest-1096389075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ed4a8ec-a81a-4721-9c7b-4d3f5ecb77d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:24 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-776b248e-e11b-4eb0-97af-78c4125505ef tempest-CreateVolumesFromSnapshotTest-1096389075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ed4a8ec-a81a-4721-9c7b-4d3f5ecb77d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:24 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-776b248e-e11b-4eb0-97af-78c4125505ef tempest-CreateVolumesFromSnapshotTest-1096389075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a91b9989-4f20-4870-af1d-cbcb48be40ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:24 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-776b248e-e11b-4eb0-97af-78c4125505ef tempest-CreateVolumesFromSnapshotTest-1096389075 None] Volume efae64d4-0356-42c0-8d82-bf512cf6c201: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-efae64d4-0356-42c0-8d82-bf512cf6c201', 'volume_size': 1}
Jul 30 20:40:24 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-776b248e-e11b-4eb0-97af-78c4125505ef tempest-CreateVolumesFromSnapshotTest-1096389075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:40:24 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-776b248e-e11b-4eb0-97af-78c4125505ef tempest-CreateVolumesFromSnapshotTest-1096389075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:40:24 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-776b248e-e11b-4eb0-97af-78c4125505ef tempest-CreateVolumesFromSnapshotTest-1096389075 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:40:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-312447775',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efae64d4-0356-42c0-8d82-bf512cf6c201,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd1f96963de14944bf651afe61967374',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:40:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:40:24Z,use_quota=True,user_id='e8bf019004ba44838613267030b09257',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:40:24 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-776b248e-e11b-4eb0-97af-78c4125505ef tempest-CreateVolumesFromSnapshotTest-1096389075 None] Creating volume efae64d4-0356-42c0-8d82-bf512cf6c201 {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:40:24 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-776b248e-e11b-4eb0-97af-78c4125505ef tempest-CreateVolumesFromSnapshotTest-1096389075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:40:24 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-776b248e-e11b-4eb0-97af-78c4125505ef tempest-CreateVolumesFromSnapshotTest-1096389075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:40:24 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-776b248e-e11b-4eb0-97af-78c4125505ef tempest-CreateVolumesFromSnapshotTest-1096389075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:40:24 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-776b248e-e11b-4eb0-97af-78c4125505ef tempest-CreateVolumesFromSnapshotTest-1096389075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:40:24 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-776b248e-e11b-4eb0-97af-78c4125505ef tempest-CreateVolumesFromSnapshotTest-1096389075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:40:24 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-776b248e-e11b-4eb0-97af-78c4125505ef tempest-CreateVolumesFromSnapshotTest-1096389075 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:40:24 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-776b248e-e11b-4eb0-97af-78c4125505ef tempest-CreateVolumesFromSnapshotTest-1096389075 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:40:24 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-776b248e-e11b-4eb0-97af-78c4125505ef tempest-CreateVolumesFromSnapshotTest-1096389075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-efae64d4-0356-42c0-8d82-bf512cf6c201 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:24 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcd001a0-e707-4015-ac19-340664635dd7 tempest-CreateVolumesFromImageTest-799253929 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:40:24 devstack sudo[107138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-efae64d4-0356-42c0-8d82-bf512cf6c201 1073741824
Jul 30 20:40:24 devstack sudo[107138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:24 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-fcd001a0-e707-4015-ac19-340664635dd7 tempest-CreateVolumesFromImageTest-799253929 None] Flow 'volume_create_manager' (953a9b87-6c5f-4a44-9bfd-55bafe0c39cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:40:24 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-fcd001a0-e707-4015-ac19-340664635dd7 tempest-CreateVolumesFromImageTest-799253929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81a43741-40ea-4c2b-943b-55eddbbb2d26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:24 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-fcd001a0-e707-4015-ac19-340664635dd7 tempest-CreateVolumesFromImageTest-799253929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81a43741-40ea-4c2b-943b-55eddbbb2d26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:40:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-871431489',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1766edab-1aa4-48c2-be6d-a33ed85fe7ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f881be5c37a42bcaefca9600e4c0f80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:40:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:40:24Z,use_quota=True,user_id='3c1b0976b78f4526a9abb7737ccace29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:24 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-fcd001a0-e707-4015-ac19-340664635dd7 tempest-CreateVolumesFromImageTest-799253929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91a95fcc-16bd-472b-bcba-53e6f7417622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:24 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-fcd001a0-e707-4015-ac19-340664635dd7 tempest-CreateVolumesFromImageTest-799253929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91a95fcc-16bd-472b-bcba-53e6f7417622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:24 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-fcd001a0-e707-4015-ac19-340664635dd7 tempest-CreateVolumesFromImageTest-799253929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00307a24-0f10-4398-9971-1f99c035aa31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:24 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-fcd001a0-e707-4015-ac19-340664635dd7 tempest-CreateVolumesFromImageTest-799253929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00307a24-0f10-4398-9971-1f99c035aa31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1766edab-1aa4-48c2-be6d-a33ed85fe7ba', 'volume_name': 'volume-1766edab-1aa4-48c2-be6d-a33ed85fe7ba', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:24 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-fcd001a0-e707-4015-ac19-340664635dd7 tempest-CreateVolumesFromImageTest-799253929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41fd3cbf-a752-4c13-a3d2-e09b4b6ace72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:24 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-fcd001a0-e707-4015-ac19-340664635dd7 tempest-CreateVolumesFromImageTest-799253929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41fd3cbf-a752-4c13-a3d2-e09b4b6ace72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:24 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-fcd001a0-e707-4015-ac19-340664635dd7 tempest-CreateVolumesFromImageTest-799253929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79896a37-e4ff-4d31-96fa-607b42e63637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:24 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-fcd001a0-e707-4015-ac19-340664635dd7 tempest-CreateVolumesFromImageTest-799253929 None] Volume 1766edab-1aa4-48c2-be6d-a33ed85fe7ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1766edab-1aa4-48c2-be6d-a33ed85fe7ba', 'volume_size': 1}
Jul 30 20:40:24 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-fcd001a0-e707-4015-ac19-340664635dd7 tempest-CreateVolumesFromImageTest-799253929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:40:24 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1ec799e-83f0-44e0-a738-9f515fa0502a tempest-CreateVolumesFromImageTest-799253929 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:40:24 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-d1ec799e-83f0-44e0-a738-9f515fa0502a tempest-CreateVolumesFromImageTest-799253929 None] Flow 'volume_create_manager' (64857f1e-f5b8-46f1-a912-252d0f771d27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:40:24 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-d1ec799e-83f0-44e0-a738-9f515fa0502a tempest-CreateVolumesFromImageTest-799253929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dc73035-e0b2-42d2-859d-acca99fade3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:24 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-d1ec799e-83f0-44e0-a738-9f515fa0502a tempest-CreateVolumesFromImageTest-799253929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dc73035-e0b2-42d2-859d-acca99fade3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:40:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-632146547',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a65807b-1dc6-4183-822c-c925dbc7e9c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f881be5c37a42bcaefca9600e4c0f80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:40:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:40:25Z,use_quota=True,user_id='3c1b0976b78f4526a9abb7737ccace29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:24 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-d1ec799e-83f0-44e0-a738-9f515fa0502a tempest-CreateVolumesFromImageTest-799253929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44d38b73-a305-40ed-a45e-193a5a9f0fd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:24 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-d1ec799e-83f0-44e0-a738-9f515fa0502a tempest-CreateVolumesFromImageTest-799253929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44d38b73-a305-40ed-a45e-193a5a9f0fd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:24 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-d1ec799e-83f0-44e0-a738-9f515fa0502a tempest-CreateVolumesFromImageTest-799253929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e670fdf1-e7be-42dd-ab4b-9ebdbd94ff92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:24 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-d1ec799e-83f0-44e0-a738-9f515fa0502a tempest-CreateVolumesFromImageTest-799253929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e670fdf1-e7be-42dd-ab4b-9ebdbd94ff92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a65807b-1dc6-4183-822c-c925dbc7e9c0', 'volume_name': 'volume-1a65807b-1dc6-4183-822c-c925dbc7e9c0', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:24 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-d1ec799e-83f0-44e0-a738-9f515fa0502a tempest-CreateVolumesFromImageTest-799253929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7134f042-588b-40bf-a85f-8521d4a56e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:24 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-d1ec799e-83f0-44e0-a738-9f515fa0502a tempest-CreateVolumesFromImageTest-799253929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7134f042-588b-40bf-a85f-8521d4a56e31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:24 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-d1ec799e-83f0-44e0-a738-9f515fa0502a tempest-CreateVolumesFromImageTest-799253929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed7299f4-aab3-4e46-a124-24aad749098f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:24 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-d1ec799e-83f0-44e0-a738-9f515fa0502a tempest-CreateVolumesFromImageTest-799253929 None] Volume 1a65807b-1dc6-4183-822c-c925dbc7e9c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a65807b-1dc6-4183-822c-c925dbc7e9c0', 'volume_size': 1}
Jul 30 20:40:24 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-d1ec799e-83f0-44e0-a738-9f515fa0502a tempest-CreateVolumesFromImageTest-799253929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:40:24 devstack sudo[107138]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:24 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-776b248e-e11b-4eb0-97af-78c4125505ef tempest-CreateVolumesFromSnapshotTest-1096389075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-efae64d4-0356-42c0-8d82-bf512cf6c201 1073741824" returned: 0 in 0.662s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:25 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-776b248e-e11b-4eb0-97af-78c4125505ef tempest-CreateVolumesFromSnapshotTest-1096389075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-efae64d4-0356-42c0-8d82-bf512cf6c201 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:25 devstack sudo[107143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-efae64d4-0356-42c0-8d82-bf512cf6c201
Jul 30 20:40:25 devstack sudo[107143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:25 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f6b13db-9455-4d31-9591-212b293b43ad tempest-VolumeDependencyTests-326923044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:40:25 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2f6b13db-9455-4d31-9591-212b293b43ad tempest-VolumeDependencyTests-326923044 None] Flow 'volume_create_manager' (597bd323-ed44-4895-afca-483ac001da45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:40:25 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2f6b13db-9455-4d31-9591-212b293b43ad tempest-VolumeDependencyTests-326923044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8390aa0-1c89-4074-89be-34c0798c14db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:25 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2f6b13db-9455-4d31-9591-212b293b43ad tempest-VolumeDependencyTests-326923044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8390aa0-1c89-4074-89be-34c0798c14db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:40:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1869590365',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc1416a2-99d8-447c-aa4f-7fe69fe04b59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d28a4825cf764961bd16d185f93fcf68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:40:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:40:25Z,use_quota=True,user_id='e34818f899eb4081bb3e236997e77dda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:25 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2f6b13db-9455-4d31-9591-212b293b43ad tempest-VolumeDependencyTests-326923044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98988f7f-edc0-4e6d-bb28-0018bbd297c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:25 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2f6b13db-9455-4d31-9591-212b293b43ad tempest-VolumeDependencyTests-326923044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98988f7f-edc0-4e6d-bb28-0018bbd297c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:25 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2f6b13db-9455-4d31-9591-212b293b43ad tempest-VolumeDependencyTests-326923044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bafd34b2-6469-4149-9d57-2e5976a32351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:25 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2f6b13db-9455-4d31-9591-212b293b43ad tempest-VolumeDependencyTests-326923044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bafd34b2-6469-4149-9d57-2e5976a32351) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc1416a2-99d8-447c-aa4f-7fe69fe04b59', 'volume_name': 'volume-dc1416a2-99d8-447c-aa4f-7fe69fe04b59', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:25 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2f6b13db-9455-4d31-9591-212b293b43ad tempest-VolumeDependencyTests-326923044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28c14843-47ca-4322-b3d8-9f26c4c1fbc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:25 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2f6b13db-9455-4d31-9591-212b293b43ad tempest-VolumeDependencyTests-326923044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28c14843-47ca-4322-b3d8-9f26c4c1fbc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:25 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2f6b13db-9455-4d31-9591-212b293b43ad tempest-VolumeDependencyTests-326923044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdff075e-9ca7-4605-abb4-c2aae1f3a92a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:25 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-2f6b13db-9455-4d31-9591-212b293b43ad tempest-VolumeDependencyTests-326923044 None] Volume dc1416a2-99d8-447c-aa4f-7fe69fe04b59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc1416a2-99d8-447c-aa4f-7fe69fe04b59', 'volume_size': 1}
Jul 30 20:40:25 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-2f6b13db-9455-4d31-9591-212b293b43ad tempest-VolumeDependencyTests-326923044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:40:25 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa3b4a7f-b338-425a-b01e-bcb0d8bdfe43 tempest-CreateVolumesFromImageTest-799253929 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:40:25 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-aa3b4a7f-b338-425a-b01e-bcb0d8bdfe43 tempest-CreateVolumesFromImageTest-799253929 None] Flow 'volume_create_manager' (509edab2-36c6-460f-88d5-0e112a6e0d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:40:25 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-aa3b4a7f-b338-425a-b01e-bcb0d8bdfe43 tempest-CreateVolumesFromImageTest-799253929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03b00835-7c3b-43f6-9beb-4f0a45bb0ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:25 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-aa3b4a7f-b338-425a-b01e-bcb0d8bdfe43 tempest-CreateVolumesFromImageTest-799253929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03b00835-7c3b-43f6-9beb-4f0a45bb0ceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:40:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-687350592',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c95fc2a5-c186-4b1d-b35b-57723fca8159,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f881be5c37a42bcaefca9600e4c0f80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:40:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:40:25Z,use_quota=True,user_id='3c1b0976b78f4526a9abb7737ccace29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:25 devstack sudo[107143]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:25 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-aa3b4a7f-b338-425a-b01e-bcb0d8bdfe43 tempest-CreateVolumesFromImageTest-799253929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ccd9b2a-eace-4992-a46e-272d91c7574b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:25 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-aa3b4a7f-b338-425a-b01e-bcb0d8bdfe43 tempest-CreateVolumesFromImageTest-799253929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ccd9b2a-eace-4992-a46e-272d91c7574b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:25 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-aa3b4a7f-b338-425a-b01e-bcb0d8bdfe43 tempest-CreateVolumesFromImageTest-799253929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d62b327-2561-4432-b11d-751e9157e91b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:25 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-aa3b4a7f-b338-425a-b01e-bcb0d8bdfe43 tempest-CreateVolumesFromImageTest-799253929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d62b327-2561-4432-b11d-751e9157e91b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c95fc2a5-c186-4b1d-b35b-57723fca8159', 'volume_name': 'volume-c95fc2a5-c186-4b1d-b35b-57723fca8159', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:25 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-aa3b4a7f-b338-425a-b01e-bcb0d8bdfe43 tempest-CreateVolumesFromImageTest-799253929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9087d1ce-5135-4bf5-8693-1f3568a336b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:25 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-aa3b4a7f-b338-425a-b01e-bcb0d8bdfe43 tempest-CreateVolumesFromImageTest-799253929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9087d1ce-5135-4bf5-8693-1f3568a336b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:25 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-aa3b4a7f-b338-425a-b01e-bcb0d8bdfe43 tempest-CreateVolumesFromImageTest-799253929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f3071b6-106c-4293-b8b9-f387a5e034c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:25 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-aa3b4a7f-b338-425a-b01e-bcb0d8bdfe43 tempest-CreateVolumesFromImageTest-799253929 None] Volume c95fc2a5-c186-4b1d-b35b-57723fca8159: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c95fc2a5-c186-4b1d-b35b-57723fca8159', 'volume_size': 1}
Jul 30 20:40:25 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-aa3b4a7f-b338-425a-b01e-bcb0d8bdfe43 tempest-CreateVolumesFromImageTest-799253929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:40:25 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-776b248e-e11b-4eb0-97af-78c4125505ef tempest-CreateVolumesFromSnapshotTest-1096389075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-efae64d4-0356-42c0-8d82-bf512cf6c201" returned: 0 in 0.414s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:25 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-776b248e-e11b-4eb0-97af-78c4125505ef tempest-CreateVolumesFromSnapshotTest-1096389075 None] <== create_volume: return (1162ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:40:25 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-776b248e-e11b-4eb0-97af-78c4125505ef tempest-CreateVolumesFromSnapshotTest-1096389075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.165s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:40:25 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-fcd001a0-e707-4015-ac19-340664635dd7 tempest-CreateVolumesFromImageTest-799253929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.021s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:40:25 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-fcd001a0-e707-4015-ac19-340664635dd7 tempest-CreateVolumesFromImageTest-799253929 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:40:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-871431489',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1766edab-1aa4-48c2-be6d-a33ed85fe7ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f881be5c37a42bcaefca9600e4c0f80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:40:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:40:24Z,use_quota=True,user_id='3c1b0976b78f4526a9abb7737ccace29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:40:25 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-fcd001a0-e707-4015-ac19-340664635dd7 tempest-CreateVolumesFromImageTest-799253929 None] Creating volume 1766edab-1aa4-48c2-be6d-a33ed85fe7ba {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:40:25 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-fcd001a0-e707-4015-ac19-340664635dd7 tempest-CreateVolumesFromImageTest-799253929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:40:25 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-fcd001a0-e707-4015-ac19-340664635dd7 tempest-CreateVolumesFromImageTest-799253929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:40:25 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-fcd001a0-e707-4015-ac19-340664635dd7 tempest-CreateVolumesFromImageTest-799253929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:40:25 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-fcd001a0-e707-4015-ac19-340664635dd7 tempest-CreateVolumesFromImageTest-799253929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:40:25 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-fcd001a0-e707-4015-ac19-340664635dd7 tempest-CreateVolumesFromImageTest-799253929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:40:25 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-fcd001a0-e707-4015-ac19-340664635dd7 tempest-CreateVolumesFromImageTest-799253929 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:40:25 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-fcd001a0-e707-4015-ac19-340664635dd7 tempest-CreateVolumesFromImageTest-799253929 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:40:25 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-fcd001a0-e707-4015-ac19-340664635dd7 tempest-CreateVolumesFromImageTest-799253929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1766edab-1aa4-48c2-be6d-a33ed85fe7ba 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:25 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-776b248e-e11b-4eb0-97af-78c4125505ef tempest-CreateVolumesFromSnapshotTest-1096389075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a91b9989-4f20-4870-af1d-cbcb48be40ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efae64d4-0356-42c0-8d82-bf512cf6c201', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:25 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-776b248e-e11b-4eb0-97af-78c4125505ef tempest-CreateVolumesFromSnapshotTest-1096389075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85b01e01-78dd-43cc-b97c-d4d016e5070e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:25 devstack sudo[107147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1766edab-1aa4-48c2-be6d-a33ed85fe7ba 1073741824
Jul 30 20:40:25 devstack sudo[107147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:25 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-776b248e-e11b-4eb0-97af-78c4125505ef tempest-CreateVolumesFromSnapshotTest-1096389075 None] Volume volume-efae64d4-0356-42c0-8d82-bf512cf6c201 (efae64d4-0356-42c0-8d82-bf512cf6c201): created successfully
Jul 30 20:40:25 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-776b248e-e11b-4eb0-97af-78c4125505ef tempest-CreateVolumesFromSnapshotTest-1096389075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85b01e01-78dd-43cc-b97c-d4d016e5070e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:25 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-776b248e-e11b-4eb0-97af-78c4125505ef tempest-CreateVolumesFromSnapshotTest-1096389075 None] Flow 'volume_create_manager' (b7d176e5-e3ca-4950-aa8f-4557ff728150) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:40:25 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-776b248e-e11b-4eb0-97af-78c4125505ef tempest-CreateVolumesFromSnapshotTest-1096389075 None] Created volume successfully.
Jul 30 20:40:25 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-81166f7c-d9d6-4ea8-bde3-4ea16a1b2611 tempest-CreateVolumesFromImageTest-799253929 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:40:25 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-81166f7c-d9d6-4ea8-bde3-4ea16a1b2611 tempest-CreateVolumesFromImageTest-799253929 None] Flow 'volume_create_manager' (9b0e1fc6-2ae1-42d2-aaf4-a9cd42c060c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:40:25 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-81166f7c-d9d6-4ea8-bde3-4ea16a1b2611 tempest-CreateVolumesFromImageTest-799253929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6465966f-7f34-4fda-a99d-ba7e1693870b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:25 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-81166f7c-d9d6-4ea8-bde3-4ea16a1b2611 tempest-CreateVolumesFromImageTest-799253929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6465966f-7f34-4fda-a99d-ba7e1693870b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:40:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-485993618',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7a3262f-2b2a-4dd8-9770-0157a49a66cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f881be5c37a42bcaefca9600e4c0f80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:40:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:40:26Z,use_quota=True,user_id='3c1b0976b78f4526a9abb7737ccace29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:25 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-81166f7c-d9d6-4ea8-bde3-4ea16a1b2611 tempest-CreateVolumesFromImageTest-799253929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aea28673-bda7-4478-b900-784c371d0c5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:25 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-81166f7c-d9d6-4ea8-bde3-4ea16a1b2611 tempest-CreateVolumesFromImageTest-799253929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aea28673-bda7-4478-b900-784c371d0c5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:25 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-81166f7c-d9d6-4ea8-bde3-4ea16a1b2611 tempest-CreateVolumesFromImageTest-799253929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4362fd9-c712-4b67-b646-e0669832dbf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:25 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-81166f7c-d9d6-4ea8-bde3-4ea16a1b2611 tempest-CreateVolumesFromImageTest-799253929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4362fd9-c712-4b67-b646-e0669832dbf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7a3262f-2b2a-4dd8-9770-0157a49a66cf', 'volume_name': 'volume-e7a3262f-2b2a-4dd8-9770-0157a49a66cf', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:25 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-81166f7c-d9d6-4ea8-bde3-4ea16a1b2611 tempest-CreateVolumesFromImageTest-799253929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c42cc869-46e4-4c53-aced-99fe7e1b0d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:25 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-81166f7c-d9d6-4ea8-bde3-4ea16a1b2611 tempest-CreateVolumesFromImageTest-799253929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c42cc869-46e4-4c53-aced-99fe7e1b0d04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:25 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-81166f7c-d9d6-4ea8-bde3-4ea16a1b2611 tempest-CreateVolumesFromImageTest-799253929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdcdb6ac-1ea1-4687-8cce-97786d803260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:25 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-81166f7c-d9d6-4ea8-bde3-4ea16a1b2611 tempest-CreateVolumesFromImageTest-799253929 None] Volume e7a3262f-2b2a-4dd8-9770-0157a49a66cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7a3262f-2b2a-4dd8-9770-0157a49a66cf', 'volume_size': 1}
Jul 30 20:40:25 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-81166f7c-d9d6-4ea8-bde3-4ea16a1b2611 tempest-CreateVolumesFromImageTest-799253929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:40:26 devstack sudo[107147]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:26 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-fcd001a0-e707-4015-ac19-340664635dd7 tempest-CreateVolumesFromImageTest-799253929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1766edab-1aa4-48c2-be6d-a33ed85fe7ba 1073741824" returned: 0 in 0.589s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:26 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-fcd001a0-e707-4015-ac19-340664635dd7 tempest-CreateVolumesFromImageTest-799253929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1766edab-1aa4-48c2-be6d-a33ed85fe7ba {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:26 devstack sudo[107153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1766edab-1aa4-48c2-be6d-a33ed85fe7ba
Jul 30 20:40:26 devstack sudo[107153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:26 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf440558-d154-45bf-a08c-9b18fbbaff16 tempest-CreateVolumesFromImageTest-799253929 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:40:26 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-cf440558-d154-45bf-a08c-9b18fbbaff16 tempest-CreateVolumesFromImageTest-799253929 None] Flow 'volume_create_manager' (250da22b-6635-42ee-9a1c-84d003b6004c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:40:26 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-cf440558-d154-45bf-a08c-9b18fbbaff16 tempest-CreateVolumesFromImageTest-799253929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21b68ed0-62da-4623-bb09-11a5195cdb65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:26 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-cf440558-d154-45bf-a08c-9b18fbbaff16 tempest-CreateVolumesFromImageTest-799253929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21b68ed0-62da-4623-bb09-11a5195cdb65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:40:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1153545834',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e62b302e-0025-4fe3-aee0-3e3617a1e36c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f881be5c37a42bcaefca9600e4c0f80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:40:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:40:26Z,use_quota=True,user_id='3c1b0976b78f4526a9abb7737ccace29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:26 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-cf440558-d154-45bf-a08c-9b18fbbaff16 tempest-CreateVolumesFromImageTest-799253929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4068f38c-3018-43fd-aae9-40b3b31ea1bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:26 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-cf440558-d154-45bf-a08c-9b18fbbaff16 tempest-CreateVolumesFromImageTest-799253929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4068f38c-3018-43fd-aae9-40b3b31ea1bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:26 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-cf440558-d154-45bf-a08c-9b18fbbaff16 tempest-CreateVolumesFromImageTest-799253929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5029d327-cc3f-4800-b27d-4fd290754ca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:26 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-cf440558-d154-45bf-a08c-9b18fbbaff16 tempest-CreateVolumesFromImageTest-799253929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5029d327-cc3f-4800-b27d-4fd290754ca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e62b302e-0025-4fe3-aee0-3e3617a1e36c', 'volume_name': 'volume-e62b302e-0025-4fe3-aee0-3e3617a1e36c', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:26 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-cf440558-d154-45bf-a08c-9b18fbbaff16 tempest-CreateVolumesFromImageTest-799253929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d19af5b1-c83d-4b18-9531-e422ecc0174f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:26 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-cf440558-d154-45bf-a08c-9b18fbbaff16 tempest-CreateVolumesFromImageTest-799253929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d19af5b1-c83d-4b18-9531-e422ecc0174f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:26 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-cf440558-d154-45bf-a08c-9b18fbbaff16 tempest-CreateVolumesFromImageTest-799253929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d51a0c29-0bee-45dd-9bc0-f73726d31d9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:26 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-cf440558-d154-45bf-a08c-9b18fbbaff16 tempest-CreateVolumesFromImageTest-799253929 None] Volume e62b302e-0025-4fe3-aee0-3e3617a1e36c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e62b302e-0025-4fe3-aee0-3e3617a1e36c', 'volume_size': 1}
Jul 30 20:40:26 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-cf440558-d154-45bf-a08c-9b18fbbaff16 tempest-CreateVolumesFromImageTest-799253929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:40:26 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-c3480cf1-ad61-4e9b-a162-7154a4a77a78 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:40:26 devstack sudo[107153]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:26 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-fcd001a0-e707-4015-ac19-340664635dd7 tempest-CreateVolumesFromImageTest-799253929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1766edab-1aa4-48c2-be6d-a33ed85fe7ba" returned: 0 in 0.308s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:26 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-fcd001a0-e707-4015-ac19-340664635dd7 tempest-CreateVolumesFromImageTest-799253929 None] <== create_volume: return (977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:40:26 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-fcd001a0-e707-4015-ac19-340664635dd7 tempest-CreateVolumesFromImageTest-799253929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:40:26 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-d1ec799e-83f0-44e0-a738-9f515fa0502a tempest-CreateVolumesFromImageTest-799253929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.633s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:40:26 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-d1ec799e-83f0-44e0-a738-9f515fa0502a tempest-CreateVolumesFromImageTest-799253929 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:40:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-632146547',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a65807b-1dc6-4183-822c-c925dbc7e9c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f881be5c37a42bcaefca9600e4c0f80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:40:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:40:25Z,use_quota=True,user_id='3c1b0976b78f4526a9abb7737ccace29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:40:26 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-d1ec799e-83f0-44e0-a738-9f515fa0502a tempest-CreateVolumesFromImageTest-799253929 None] Creating volume 1a65807b-1dc6-4183-822c-c925dbc7e9c0 {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:40:26 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-d1ec799e-83f0-44e0-a738-9f515fa0502a tempest-CreateVolumesFromImageTest-799253929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:40:26 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-d1ec799e-83f0-44e0-a738-9f515fa0502a tempest-CreateVolumesFromImageTest-799253929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:40:26 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-d1ec799e-83f0-44e0-a738-9f515fa0502a tempest-CreateVolumesFromImageTest-799253929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:40:26 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-d1ec799e-83f0-44e0-a738-9f515fa0502a tempest-CreateVolumesFromImageTest-799253929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:40:26 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-d1ec799e-83f0-44e0-a738-9f515fa0502a tempest-CreateVolumesFromImageTest-799253929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:40:26 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-d1ec799e-83f0-44e0-a738-9f515fa0502a tempest-CreateVolumesFromImageTest-799253929 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:40:26 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-d1ec799e-83f0-44e0-a738-9f515fa0502a tempest-CreateVolumesFromImageTest-799253929 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:40:26 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-d1ec799e-83f0-44e0-a738-9f515fa0502a tempest-CreateVolumesFromImageTest-799253929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1a65807b-1dc6-4183-822c-c925dbc7e9c0 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:26 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-fcd001a0-e707-4015-ac19-340664635dd7 tempest-CreateVolumesFromImageTest-799253929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79896a37-e4ff-4d31-96fa-607b42e63637) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1766edab-1aa4-48c2-be6d-a33ed85fe7ba', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:26 devstack sudo[107156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1a65807b-1dc6-4183-822c-c925dbc7e9c0 1073741824
Jul 30 20:40:26 devstack sudo[107156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:26 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-fcd001a0-e707-4015-ac19-340664635dd7 tempest-CreateVolumesFromImageTest-799253929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc20af05-e075-45ed-bfc6-93288195ea52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:26 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-fcd001a0-e707-4015-ac19-340664635dd7 tempest-CreateVolumesFromImageTest-799253929 None] Volume volume-1766edab-1aa4-48c2-be6d-a33ed85fe7ba (1766edab-1aa4-48c2-be6d-a33ed85fe7ba): created successfully
Jul 30 20:40:26 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-fcd001a0-e707-4015-ac19-340664635dd7 tempest-CreateVolumesFromImageTest-799253929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc20af05-e075-45ed-bfc6-93288195ea52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:26 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-fcd001a0-e707-4015-ac19-340664635dd7 tempest-CreateVolumesFromImageTest-799253929 None] Flow 'volume_create_manager' (953a9b87-6c5f-4a44-9bfd-55bafe0c39cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:40:26 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-fcd001a0-e707-4015-ac19-340664635dd7 tempest-CreateVolumesFromImageTest-799253929 None] Created volume successfully.
Jul 30 20:40:26 devstack sudo[107156]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:26 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-d1ec799e-83f0-44e0-a738-9f515fa0502a tempest-CreateVolumesFromImageTest-799253929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1a65807b-1dc6-4183-822c-c925dbc7e9c0 1073741824" returned: 0 in 0.453s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:26 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-d1ec799e-83f0-44e0-a738-9f515fa0502a tempest-CreateVolumesFromImageTest-799253929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1a65807b-1dc6-4183-822c-c925dbc7e9c0 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:26 devstack sudo[107162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1a65807b-1dc6-4183-822c-c925dbc7e9c0
Jul 30 20:40:26 devstack sudo[107162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:27 devstack sudo[107162]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:27 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-d1ec799e-83f0-44e0-a738-9f515fa0502a tempest-CreateVolumesFromImageTest-799253929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1a65807b-1dc6-4183-822c-c925dbc7e9c0" returned: 0 in 0.270s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:27 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-d1ec799e-83f0-44e0-a738-9f515fa0502a tempest-CreateVolumesFromImageTest-799253929 None] <== create_volume: return (763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:40:27 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-d1ec799e-83f0-44e0-a738-9f515fa0502a tempest-CreateVolumesFromImageTest-799253929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.767s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:40:27 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-2f6b13db-9455-4d31-9591-212b293b43ad tempest-VolumeDependencyTests-326923044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.890s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:40:27 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-2f6b13db-9455-4d31-9591-212b293b43ad tempest-VolumeDependencyTests-326923044 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:40:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1869590365',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc1416a2-99d8-447c-aa4f-7fe69fe04b59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d28a4825cf764961bd16d185f93fcf68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:40:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:40:25Z,use_quota=True,user_id='e34818f899eb4081bb3e236997e77dda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:40:27 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-2f6b13db-9455-4d31-9591-212b293b43ad tempest-VolumeDependencyTests-326923044 None] Creating volume dc1416a2-99d8-447c-aa4f-7fe69fe04b59 {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:40:27 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-2f6b13db-9455-4d31-9591-212b293b43ad tempest-VolumeDependencyTests-326923044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:40:27 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-2f6b13db-9455-4d31-9591-212b293b43ad tempest-VolumeDependencyTests-326923044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:40:27 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-2f6b13db-9455-4d31-9591-212b293b43ad tempest-VolumeDependencyTests-326923044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:40:27 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-2f6b13db-9455-4d31-9591-212b293b43ad tempest-VolumeDependencyTests-326923044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:40:27 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-2f6b13db-9455-4d31-9591-212b293b43ad tempest-VolumeDependencyTests-326923044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:40:27 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-2f6b13db-9455-4d31-9591-212b293b43ad tempest-VolumeDependencyTests-326923044 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:40:27 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-2f6b13db-9455-4d31-9591-212b293b43ad tempest-VolumeDependencyTests-326923044 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:40:27 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2f6b13db-9455-4d31-9591-212b293b43ad tempest-VolumeDependencyTests-326923044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-dc1416a2-99d8-447c-aa4f-7fe69fe04b59 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:27 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-d1ec799e-83f0-44e0-a738-9f515fa0502a tempest-CreateVolumesFromImageTest-799253929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed7299f4-aab3-4e46-a124-24aad749098f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a65807b-1dc6-4183-822c-c925dbc7e9c0', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:27 devstack sudo[107165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-dc1416a2-99d8-447c-aa4f-7fe69fe04b59 1073741824
Jul 30 20:40:27 devstack sudo[107165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:27 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-d1ec799e-83f0-44e0-a738-9f515fa0502a tempest-CreateVolumesFromImageTest-799253929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29afea77-87c1-416d-ab33-2c49c599c15f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:27 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-d1ec799e-83f0-44e0-a738-9f515fa0502a tempest-CreateVolumesFromImageTest-799253929 None] Volume volume-1a65807b-1dc6-4183-822c-c925dbc7e9c0 (1a65807b-1dc6-4183-822c-c925dbc7e9c0): created successfully
Jul 30 20:40:27 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-d1ec799e-83f0-44e0-a738-9f515fa0502a tempest-CreateVolumesFromImageTest-799253929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29afea77-87c1-416d-ab33-2c49c599c15f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:27 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-d1ec799e-83f0-44e0-a738-9f515fa0502a tempest-CreateVolumesFromImageTest-799253929 None] Flow 'volume_create_manager' (64857f1e-f5b8-46f1-a912-252d0f771d27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:40:27 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-d1ec799e-83f0-44e0-a738-9f515fa0502a tempest-CreateVolumesFromImageTest-799253929 None] Created volume successfully.
Jul 30 20:40:27 devstack sudo[107165]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:27 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2f6b13db-9455-4d31-9591-212b293b43ad tempest-VolumeDependencyTests-326923044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-dc1416a2-99d8-447c-aa4f-7fe69fe04b59 1073741824" returned: 0 in 0.454s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:27 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2f6b13db-9455-4d31-9591-212b293b43ad tempest-VolumeDependencyTests-326923044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-dc1416a2-99d8-447c-aa4f-7fe69fe04b59 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:27 devstack sudo[107171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-dc1416a2-99d8-447c-aa4f-7fe69fe04b59
Jul 30 20:40:27 devstack sudo[107171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:27 devstack sudo[107171]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:27 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2f6b13db-9455-4d31-9591-212b293b43ad tempest-VolumeDependencyTests-326923044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-dc1416a2-99d8-447c-aa4f-7fe69fe04b59" returned: 0 in 0.260s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:27 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-2f6b13db-9455-4d31-9591-212b293b43ad tempest-VolumeDependencyTests-326923044 None] <== create_volume: return (755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:40:27 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-2f6b13db-9455-4d31-9591-212b293b43ad tempest-VolumeDependencyTests-326923044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.758s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:40:27 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-aa3b4a7f-b338-425a-b01e-bcb0d8bdfe43 tempest-CreateVolumesFromImageTest-799253929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.526s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:40:27 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-aa3b4a7f-b338-425a-b01e-bcb0d8bdfe43 tempest-CreateVolumesFromImageTest-799253929 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:40:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-687350592',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c95fc2a5-c186-4b1d-b35b-57723fca8159,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f881be5c37a42bcaefca9600e4c0f80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:40:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:40:25Z,use_quota=True,user_id='3c1b0976b78f4526a9abb7737ccace29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:40:27 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-aa3b4a7f-b338-425a-b01e-bcb0d8bdfe43 tempest-CreateVolumesFromImageTest-799253929 None] Creating volume c95fc2a5-c186-4b1d-b35b-57723fca8159 {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:40:27 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-aa3b4a7f-b338-425a-b01e-bcb0d8bdfe43 tempest-CreateVolumesFromImageTest-799253929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:40:27 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-aa3b4a7f-b338-425a-b01e-bcb0d8bdfe43 tempest-CreateVolumesFromImageTest-799253929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:40:27 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-aa3b4a7f-b338-425a-b01e-bcb0d8bdfe43 tempest-CreateVolumesFromImageTest-799253929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:40:27 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-aa3b4a7f-b338-425a-b01e-bcb0d8bdfe43 tempest-CreateVolumesFromImageTest-799253929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:40:27 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-aa3b4a7f-b338-425a-b01e-bcb0d8bdfe43 tempest-CreateVolumesFromImageTest-799253929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:40:27 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-aa3b4a7f-b338-425a-b01e-bcb0d8bdfe43 tempest-CreateVolumesFromImageTest-799253929 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:40:27 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-aa3b4a7f-b338-425a-b01e-bcb0d8bdfe43 tempest-CreateVolumesFromImageTest-799253929 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:40:27 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-aa3b4a7f-b338-425a-b01e-bcb0d8bdfe43 tempest-CreateVolumesFromImageTest-799253929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c95fc2a5-c186-4b1d-b35b-57723fca8159 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:27 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2f6b13db-9455-4d31-9591-212b293b43ad tempest-VolumeDependencyTests-326923044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdff075e-9ca7-4605-abb4-c2aae1f3a92a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc1416a2-99d8-447c-aa4f-7fe69fe04b59', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:27 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2f6b13db-9455-4d31-9591-212b293b43ad tempest-VolumeDependencyTests-326923044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eafdd312-a994-4af2-b617-0b50ad9645aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:27 devstack sudo[107174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c95fc2a5-c186-4b1d-b35b-57723fca8159 1073741824
Jul 30 20:40:27 devstack sudo[107174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:27 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-2f6b13db-9455-4d31-9591-212b293b43ad tempest-VolumeDependencyTests-326923044 None] Volume volume-dc1416a2-99d8-447c-aa4f-7fe69fe04b59 (dc1416a2-99d8-447c-aa4f-7fe69fe04b59): created successfully
Jul 30 20:40:28 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2f6b13db-9455-4d31-9591-212b293b43ad tempest-VolumeDependencyTests-326923044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eafdd312-a994-4af2-b617-0b50ad9645aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:28 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-2f6b13db-9455-4d31-9591-212b293b43ad tempest-VolumeDependencyTests-326923044 None] Flow 'volume_create_manager' (597bd323-ed44-4895-afca-483ac001da45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:40:28 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-2f6b13db-9455-4d31-9591-212b293b43ad tempest-VolumeDependencyTests-326923044 None] Created volume successfully.
Jul 30 20:40:28 devstack sudo[107174]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:28 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-aa3b4a7f-b338-425a-b01e-bcb0d8bdfe43 tempest-CreateVolumesFromImageTest-799253929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c95fc2a5-c186-4b1d-b35b-57723fca8159 1073741824" returned: 0 in 0.510s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:28 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-aa3b4a7f-b338-425a-b01e-bcb0d8bdfe43 tempest-CreateVolumesFromImageTest-799253929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c95fc2a5-c186-4b1d-b35b-57723fca8159 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:28 devstack sudo[107179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c95fc2a5-c186-4b1d-b35b-57723fca8159
Jul 30 20:40:28 devstack sudo[107179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:28 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-aca54c50-0de1-43de-939e-3512bd414f89 tempest-VolumeAndVolumeTypeFromImageTest-776863720 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:40:28 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-aca54c50-0de1-43de-939e-3512bd414f89 tempest-VolumeAndVolumeTypeFromImageTest-776863720 None] Flow 'volume_create_manager' (3ccfbac0-ae96-450b-9f2f-907ebf88f266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:40:28 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-aca54c50-0de1-43de-939e-3512bd414f89 tempest-VolumeAndVolumeTypeFromImageTest-776863720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (021a0d34-7507-4196-b811-143f73fac881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:28 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-aca54c50-0de1-43de-939e-3512bd414f89 tempest-VolumeAndVolumeTypeFromImageTest-776863720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (021a0d34-7507-4196-b811-143f73fac881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:40:28Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66f15175-b846-4cef-ad55-04e653dbbb52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='264ff733820c4646961c042ae4a9f05c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:40:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:40:29Z,use_quota=True,user_id='2a150087093c4d9e9c8fbde65dd7526b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8066632c-2790-47f9-becf-8dfc3b0c65d5),volume_type_id=8066632c-2790-47f9-becf-8dfc3b0c65d5)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:28 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-aca54c50-0de1-43de-939e-3512bd414f89 tempest-VolumeAndVolumeTypeFromImageTest-776863720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f43427af-6793-4401-bbc0-a8d22ef23704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:28 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-aca54c50-0de1-43de-939e-3512bd414f89 tempest-VolumeAndVolumeTypeFromImageTest-776863720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f43427af-6793-4401-bbc0-a8d22ef23704) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:28 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-aca54c50-0de1-43de-939e-3512bd414f89 tempest-VolumeAndVolumeTypeFromImageTest-776863720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac3ca75b-1cb3-419b-b50a-ba1b1ffb6399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:28 devstack cinder-volume[88719]: DEBUG cinder.image.glance [None req-aca54c50-0de1-43de-939e-3512bd414f89 tempest-VolumeAndVolumeTypeFromImageTest-776863720 None] Creating Keystone auth plugin from conf {{(pid=88719) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 30 20:40:28 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-c9eb7cd3-ef8c-4344-badd-10ca9f5a2b5f tempest-VolumeDependencyTests-326923044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:40:28 devstack sudo[107179]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:28 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-aa3b4a7f-b338-425a-b01e-bcb0d8bdfe43 tempest-CreateVolumesFromImageTest-799253929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c95fc2a5-c186-4b1d-b35b-57723fca8159" returned: 0 in 0.306s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:28 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-aa3b4a7f-b338-425a-b01e-bcb0d8bdfe43 tempest-CreateVolumesFromImageTest-799253929 None] <== create_volume: return (882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:40:28 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-aa3b4a7f-b338-425a-b01e-bcb0d8bdfe43 tempest-CreateVolumesFromImageTest-799253929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:40:28 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-81166f7c-d9d6-4ea8-bde3-4ea16a1b2611 tempest-CreateVolumesFromImageTest-799253929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.049s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:40:28 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-81166f7c-d9d6-4ea8-bde3-4ea16a1b2611 tempest-CreateVolumesFromImageTest-799253929 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:40:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-485993618',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7a3262f-2b2a-4dd8-9770-0157a49a66cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f881be5c37a42bcaefca9600e4c0f80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:40:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:40:26Z,use_quota=True,user_id='3c1b0976b78f4526a9abb7737ccace29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:40:28 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-81166f7c-d9d6-4ea8-bde3-4ea16a1b2611 tempest-CreateVolumesFromImageTest-799253929 None] Creating volume e7a3262f-2b2a-4dd8-9770-0157a49a66cf {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:40:28 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-81166f7c-d9d6-4ea8-bde3-4ea16a1b2611 tempest-CreateVolumesFromImageTest-799253929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:40:28 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-81166f7c-d9d6-4ea8-bde3-4ea16a1b2611 tempest-CreateVolumesFromImageTest-799253929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:40:28 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-81166f7c-d9d6-4ea8-bde3-4ea16a1b2611 tempest-CreateVolumesFromImageTest-799253929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:40:28 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-81166f7c-d9d6-4ea8-bde3-4ea16a1b2611 tempest-CreateVolumesFromImageTest-799253929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:40:28 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-81166f7c-d9d6-4ea8-bde3-4ea16a1b2611 tempest-CreateVolumesFromImageTest-799253929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:40:28 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-81166f7c-d9d6-4ea8-bde3-4ea16a1b2611 tempest-CreateVolumesFromImageTest-799253929 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:40:28 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-81166f7c-d9d6-4ea8-bde3-4ea16a1b2611 tempest-CreateVolumesFromImageTest-799253929 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:40:28 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-81166f7c-d9d6-4ea8-bde3-4ea16a1b2611 tempest-CreateVolumesFromImageTest-799253929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-e7a3262f-2b2a-4dd8-9770-0157a49a66cf 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:28 devstack sudo[107182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-e7a3262f-2b2a-4dd8-9770-0157a49a66cf 1073741824
Jul 30 20:40:28 devstack sudo[107182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:28 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-aa3b4a7f-b338-425a-b01e-bcb0d8bdfe43 tempest-CreateVolumesFromImageTest-799253929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f3071b6-106c-4293-b8b9-f387a5e034c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c95fc2a5-c186-4b1d-b35b-57723fca8159', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:28 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-aa3b4a7f-b338-425a-b01e-bcb0d8bdfe43 tempest-CreateVolumesFromImageTest-799253929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f2bd115-1376-4b37-a64f-667331c9ed98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:28 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-aa3b4a7f-b338-425a-b01e-bcb0d8bdfe43 tempest-CreateVolumesFromImageTest-799253929 None] Volume volume-c95fc2a5-c186-4b1d-b35b-57723fca8159 (c95fc2a5-c186-4b1d-b35b-57723fca8159): created successfully
Jul 30 20:40:28 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-aa3b4a7f-b338-425a-b01e-bcb0d8bdfe43 tempest-CreateVolumesFromImageTest-799253929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f2bd115-1376-4b37-a64f-667331c9ed98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:28 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-aa3b4a7f-b338-425a-b01e-bcb0d8bdfe43 tempest-CreateVolumesFromImageTest-799253929 None] Flow 'volume_create_manager' (509edab2-36c6-460f-88d5-0e112a6e0d8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:40:28 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-aa3b4a7f-b338-425a-b01e-bcb0d8bdfe43 tempest-CreateVolumesFromImageTest-799253929 None] Created volume successfully.
Jul 30 20:40:29 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-aca54c50-0de1-43de-939e-3512bd414f89 tempest-VolumeAndVolumeTypeFromImageTest-776863720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac3ca75b-1cb3-419b-b50a-ba1b1ffb6399) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '66f15175-b846-4cef-ad55-04e653dbbb52', 'volume_name': 'volume-66f15175-b846-4cef-ad55-04e653dbbb52', 'volume_size': 1, 'image_id': '68360f71-c92a-4f20-b4ab-20a67fb6dcd4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/68360f71-c92a-4f20-b4ab-20a67fb6dcd4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'be7a58dd27e8b83dc62d4c065b870224', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '264ff733820c4646961c042ae4a9f05c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3f0ccef9aa89f0fb3c1d3b22088817af8e182008cf9a551f5e9ad5d0a4c4d8e0cec803dfe13ee37941adeb2369290ee8d1cd4b147a85851610a6568ff103c3f1', 'id': '68360f71-c92a-4f20-b4ab-20a67fb6dcd4', 'created_at': datetime.datetime(2026, 7, 30, 18, 40, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 18, 40, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/68360f71-c92a-4f20-b4ab-20a67fb6dcd4/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x78687a45abd0>}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:29 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-aca54c50-0de1-43de-939e-3512bd414f89 tempest-VolumeAndVolumeTypeFromImageTest-776863720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb4ea434-47d8-4368-a9e9-bc66d9402ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:29 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-aca54c50-0de1-43de-939e-3512bd414f89 tempest-VolumeAndVolumeTypeFromImageTest-776863720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb4ea434-47d8-4368-a9e9-bc66d9402ef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:29 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-aca54c50-0de1-43de-939e-3512bd414f89 tempest-VolumeAndVolumeTypeFromImageTest-776863720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17206fc4-b1aa-417d-9ead-9c50ad28fad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:29 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-aca54c50-0de1-43de-939e-3512bd414f89 tempest-VolumeAndVolumeTypeFromImageTest-776863720 None] Volume 66f15175-b846-4cef-ad55-04e653dbbb52: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-66f15175-b846-4cef-ad55-04e653dbbb52', 'volume_size': 1, 'image_id': '68360f71-c92a-4f20-b4ab-20a67fb6dcd4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/68360f71-c92a-4f20-b4ab-20a67fb6dcd4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'be7a58dd27e8b83dc62d4c065b870224', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '264ff733820c4646961c042ae4a9f05c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3f0ccef9aa89f0fb3c1d3b22088817af8e182008cf9a551f5e9ad5d0a4c4d8e0cec803dfe13ee37941adeb2369290ee8d1cd4b147a85851610a6568ff103c3f1', 'id': '68360f71-c92a-4f20-b4ab-20a67fb6dcd4', 'created_at': datetime.datetime(2026, 7, 30, 18, 40, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 18, 40, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/68360f71-c92a-4f20-b4ab-20a67fb6dcd4/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x78687a45abd0>}
Jul 30 20:40:29 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-aca54c50-0de1-43de-939e-3512bd414f89 tempest-VolumeAndVolumeTypeFromImageTest-776863720 None] Trying to clone 66f15175-b846-4cef-ad55-04e653dbbb52 from image 68360f71-c92a-4f20-b4ab-20a67fb6dcd4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/68360f71-c92a-4f20-b4ab-20a67fb6dcd4', 'metadata': {}}]). {{(pid=88719) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 30 20:40:29 devstack cinder-volume[88719]: DEBUG cinder.image.image_utils [None req-aca54c50-0de1-43de-939e-3512bd414f89 tempest-VolumeAndVolumeTypeFromImageTest-776863720 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_68360f71-c92a-4f20-b4ab-20a67fb6dcd4_mlw76xufdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88719) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 30 20:40:29 devstack cinder-volume[88719]: INFO cinder.image.image_utils [None req-aca54c50-0de1-43de-939e-3512bd414f89 tempest-VolumeAndVolumeTypeFromImageTest-776863720 None] Image download 0.00 MB at 0.00 MB/s
Jul 30 20:40:29 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b5ccb1-0695-45a8-9ac7-21cb9496e01a]: (4, 'raw') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:40:29 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-aca54c50-0de1-43de-939e-3512bd414f89 tempest-VolumeAndVolumeTypeFromImageTest-776863720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_68360f71-c92a-4f20-b4ab-20a67fb6dcd4_mlw76xufdevstack@QuobyteHD {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:29 devstack sudo[107188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_68360f71-c92a-4f20-b4ab-20a67fb6dcd4_mlw76xufdevstack@QuobyteHD
Jul 30 20:40:29 devstack sudo[107188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:29 devstack sudo[107182]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:29 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-81166f7c-d9d6-4ea8-bde3-4ea16a1b2611 tempest-CreateVolumesFromImageTest-799253929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-e7a3262f-2b2a-4dd8-9770-0157a49a66cf 1073741824" returned: 0 in 0.536s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:29 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-81166f7c-d9d6-4ea8-bde3-4ea16a1b2611 tempest-CreateVolumesFromImageTest-799253929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-e7a3262f-2b2a-4dd8-9770-0157a49a66cf {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:29 devstack sudo[107190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-e7a3262f-2b2a-4dd8-9770-0157a49a66cf
Jul 30 20:40:29 devstack sudo[107190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:29 devstack sudo[107188]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:29 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-aca54c50-0de1-43de-939e-3512bd414f89 tempest-VolumeAndVolumeTypeFromImageTest-776863720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_68360f71-c92a-4f20-b4ab-20a67fb6dcd4_mlw76xufdevstack@QuobyteHD" returned: 0 in 0.372s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:29 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-aca54c50-0de1-43de-939e-3512bd414f89 tempest-VolumeAndVolumeTypeFromImageTest-776863720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_68360f71-c92a-4f20-b4ab-20a67fb6dcd4_mlw76xufdevstack@QuobyteHD {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:29 devstack sudo[107190]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:29 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-81166f7c-d9d6-4ea8-bde3-4ea16a1b2611 tempest-CreateVolumesFromImageTest-799253929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-e7a3262f-2b2a-4dd8-9770-0157a49a66cf" returned: 0 in 0.267s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:29 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-81166f7c-d9d6-4ea8-bde3-4ea16a1b2611 tempest-CreateVolumesFromImageTest-799253929 None] <== create_volume: return (848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:40:29 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-81166f7c-d9d6-4ea8-bde3-4ea16a1b2611 tempest-CreateVolumesFromImageTest-799253929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.851s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:40:29 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-cf440558-d154-45bf-a08c-9b18fbbaff16 tempest-CreateVolumesFromImageTest-799253929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.437s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:40:29 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-cf440558-d154-45bf-a08c-9b18fbbaff16 tempest-CreateVolumesFromImageTest-799253929 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:40:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1153545834',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e62b302e-0025-4fe3-aee0-3e3617a1e36c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f881be5c37a42bcaefca9600e4c0f80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:40:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:40:26Z,use_quota=True,user_id='3c1b0976b78f4526a9abb7737ccace29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:40:29 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-cf440558-d154-45bf-a08c-9b18fbbaff16 tempest-CreateVolumesFromImageTest-799253929 None] Creating volume e62b302e-0025-4fe3-aee0-3e3617a1e36c {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:40:29 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-cf440558-d154-45bf-a08c-9b18fbbaff16 tempest-CreateVolumesFromImageTest-799253929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:40:29 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-cf440558-d154-45bf-a08c-9b18fbbaff16 tempest-CreateVolumesFromImageTest-799253929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:40:29 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-cf440558-d154-45bf-a08c-9b18fbbaff16 tempest-CreateVolumesFromImageTest-799253929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:40:29 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-cf440558-d154-45bf-a08c-9b18fbbaff16 tempest-CreateVolumesFromImageTest-799253929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:40:29 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-cf440558-d154-45bf-a08c-9b18fbbaff16 tempest-CreateVolumesFromImageTest-799253929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:40:29 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-cf440558-d154-45bf-a08c-9b18fbbaff16 tempest-CreateVolumesFromImageTest-799253929 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:40:29 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-cf440558-d154-45bf-a08c-9b18fbbaff16 tempest-CreateVolumesFromImageTest-799253929 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:40:29 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-cf440558-d154-45bf-a08c-9b18fbbaff16 tempest-CreateVolumesFromImageTest-799253929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-e62b302e-0025-4fe3-aee0-3e3617a1e36c 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:29 devstack sudo[107196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-e62b302e-0025-4fe3-aee0-3e3617a1e36c 1073741824
Jul 30 20:40:29 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-81166f7c-d9d6-4ea8-bde3-4ea16a1b2611 tempest-CreateVolumesFromImageTest-799253929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdcdb6ac-1ea1-4687-8cce-97786d803260) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7a3262f-2b2a-4dd8-9770-0157a49a66cf', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:29 devstack sudo[107196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:29 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-81166f7c-d9d6-4ea8-bde3-4ea16a1b2611 tempest-CreateVolumesFromImageTest-799253929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1448ac41-c4f4-4ff4-97c8-30247325094f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:29 devstack sudo[107194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_68360f71-c92a-4f20-b4ab-20a67fb6dcd4_mlw76xufdevstack@QuobyteHD
Jul 30 20:40:29 devstack sudo[107194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:29 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-81166f7c-d9d6-4ea8-bde3-4ea16a1b2611 tempest-CreateVolumesFromImageTest-799253929 None] Volume volume-e7a3262f-2b2a-4dd8-9770-0157a49a66cf (e7a3262f-2b2a-4dd8-9770-0157a49a66cf): created successfully
Jul 30 20:40:29 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-81166f7c-d9d6-4ea8-bde3-4ea16a1b2611 tempest-CreateVolumesFromImageTest-799253929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1448ac41-c4f4-4ff4-97c8-30247325094f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:29 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-81166f7c-d9d6-4ea8-bde3-4ea16a1b2611 tempest-CreateVolumesFromImageTest-799253929 None] Flow 'volume_create_manager' (9b0e1fc6-2ae1-42d2-aaf4-a9cd42c060c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:40:29 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-81166f7c-d9d6-4ea8-bde3-4ea16a1b2611 tempest-CreateVolumesFromImageTest-799253929 None] Created volume successfully.
Jul 30 20:40:29 devstack sudo[107194]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:29 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-aca54c50-0de1-43de-939e-3512bd414f89 tempest-VolumeAndVolumeTypeFromImageTest-776863720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_68360f71-c92a-4f20-b4ab-20a67fb6dcd4_mlw76xufdevstack@QuobyteHD" returned: 1 in 0.387s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:29 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-aca54c50-0de1-43de-939e-3512bd414f89 tempest-VolumeAndVolumeTypeFromImageTest-776863720 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_68360f71-c92a-4f20-b4ab-20a67fb6dcd4_mlw76xufdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 30 20:40:29 devstack cinder-volume[88719]: DEBUG cinder.image.image_utils [None req-aca54c50-0de1-43de-939e-3512bd414f89 tempest-VolumeAndVolumeTypeFromImageTest-776863720 None] Temporary image 68360f71-c92a-4f20-b4ab-20a67fb6dcd4 is fetched for user 2a150087093c4d9e9c8fbde65dd7526b. {{(pid=88719) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 30 20:40:30 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[967b0f7c-3975-486c-97c1-55bb9cc5f990]: (4, 'raw') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:40:30 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-aca54c50-0de1-43de-939e-3512bd414f89 tempest-VolumeAndVolumeTypeFromImageTest-776863720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_68360f71-c92a-4f20-b4ab-20a67fb6dcd4_mlw76xufdevstack@QuobyteHD {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:30 devstack sudo[107196]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:30 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-cf440558-d154-45bf-a08c-9b18fbbaff16 tempest-CreateVolumesFromImageTest-799253929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-e62b302e-0025-4fe3-aee0-3e3617a1e36c 1073741824" returned: 0 in 0.478s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:30 devstack sudo[107206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_68360f71-c92a-4f20-b4ab-20a67fb6dcd4_mlw76xufdevstack@QuobyteHD
Jul 30 20:40:30 devstack sudo[107206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:30 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-cf440558-d154-45bf-a08c-9b18fbbaff16 tempest-CreateVolumesFromImageTest-799253929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-e62b302e-0025-4fe3-aee0-3e3617a1e36c {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:30 devstack sudo[107208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-e62b302e-0025-4fe3-aee0-3e3617a1e36c
Jul 30 20:40:30 devstack sudo[107208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:30 devstack sudo[107206]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:30 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-aca54c50-0de1-43de-939e-3512bd414f89 tempest-VolumeAndVolumeTypeFromImageTest-776863720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_68360f71-c92a-4f20-b4ab-20a67fb6dcd4_mlw76xufdevstack@QuobyteHD" returned: 0 in 0.349s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:30 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-aca54c50-0de1-43de-939e-3512bd414f89 tempest-VolumeAndVolumeTypeFromImageTest-776863720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_68360f71-c92a-4f20-b4ab-20a67fb6dcd4_mlw76xufdevstack@QuobyteHD {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:30 devstack sudo[107208]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:30 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-cf440558-d154-45bf-a08c-9b18fbbaff16 tempest-CreateVolumesFromImageTest-799253929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-e62b302e-0025-4fe3-aee0-3e3617a1e36c" returned: 0 in 0.262s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:30 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-cf440558-d154-45bf-a08c-9b18fbbaff16 tempest-CreateVolumesFromImageTest-799253929 None] <== create_volume: return (787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:40:30 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-cf440558-d154-45bf-a08c-9b18fbbaff16 tempest-CreateVolumesFromImageTest-799253929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.790s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:40:30 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-c3480cf1-ad61-4e9b-a162-7154a4a77a78 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.102s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:40:30 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-c3480cf1-ad61-4e9b-a162-7154a4a77a78 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Creating offline snapshot 72345298-cbcd-4d6e-ad88-78f62729b6f1 of volume efae64d4-0356-42c0-8d82-bf512cf6c201 {{(pid=88719) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 30 20:40:30 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-cf440558-d154-45bf-a08c-9b18fbbaff16 tempest-CreateVolumesFromImageTest-799253929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d51a0c29-0bee-45dd-9bc0-f73726d31d9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e62b302e-0025-4fe3-aee0-3e3617a1e36c', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:30 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-cf440558-d154-45bf-a08c-9b18fbbaff16 tempest-CreateVolumesFromImageTest-799253929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d9eb5cf-88b9-4894-bb15-a65012946e8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:30 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[237e17c4-a1d8-42a8-827c-feb0b7d87089]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:40:30 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-c3480cf1-ad61-4e9b-a162-7154a4a77a78 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-efae64d4-0356-42c0-8d82-bf512cf6c201 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:30 devstack sudo[107213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_68360f71-c92a-4f20-b4ab-20a67fb6dcd4_mlw76xufdevstack@QuobyteHD
Jul 30 20:40:30 devstack sudo[107213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:30 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-cf440558-d154-45bf-a08c-9b18fbbaff16 tempest-CreateVolumesFromImageTest-799253929 None] Volume volume-e62b302e-0025-4fe3-aee0-3e3617a1e36c (e62b302e-0025-4fe3-aee0-3e3617a1e36c): created successfully
Jul 30 20:40:30 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-cf440558-d154-45bf-a08c-9b18fbbaff16 tempest-CreateVolumesFromImageTest-799253929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d9eb5cf-88b9-4894-bb15-a65012946e8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:30 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-cf440558-d154-45bf-a08c-9b18fbbaff16 tempest-CreateVolumesFromImageTest-799253929 None] Flow 'volume_create_manager' (250da22b-6635-42ee-9a1c-84d003b6004c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:40:30 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-cf440558-d154-45bf-a08c-9b18fbbaff16 tempest-CreateVolumesFromImageTest-799253929 None] Created volume successfully.
Jul 30 20:40:30 devstack sudo[107214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-efae64d4-0356-42c0-8d82-bf512cf6c201
Jul 30 20:40:30 devstack sudo[107214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:30 devstack sudo[107213]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:30 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-aca54c50-0de1-43de-939e-3512bd414f89 tempest-VolumeAndVolumeTypeFromImageTest-776863720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_68360f71-c92a-4f20-b4ab-20a67fb6dcd4_mlw76xufdevstack@QuobyteHD" returned: 1 in 0.382s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:30 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-aca54c50-0de1-43de-939e-3512bd414f89 tempest-VolumeAndVolumeTypeFromImageTest-776863720 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_68360f71-c92a-4f20-b4ab-20a67fb6dcd4_mlw76xufdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 30 20:40:30 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-aca54c50-0de1-43de-939e-3512bd414f89 tempest-VolumeAndVolumeTypeFromImageTest-776863720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:40:30 devstack sudo[107214]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:30 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-c3480cf1-ad61-4e9b-a162-7154a4a77a78 tempest-CreateVolumesFromSnapshotTest-1096389075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-efae64d4-0356-42c0-8d82-bf512cf6c201" returned: 0 in 0.413s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:30 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-c3480cf1-ad61-4e9b-a162-7154a4a77a78 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-efae64d4-0356-42c0-8d82-bf512cf6c201,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-efae64d4-0356-42c0-8d82-bf512cf6c201.72345298-cbcd-4d6e-ad88-78f62729b6f1 1G {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:30 devstack sudo[107224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-efae64d4-0356-42c0-8d82-bf512cf6c201,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-efae64d4-0356-42c0-8d82-bf512cf6c201.72345298-cbcd-4d6e-ad88-78f62729b6f1 1G
Jul 30 20:40:30 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-30d73522-8c1f-49bd-a47d-9961ed817acf tempest-CreateVolumesFromImageTest-799253929 None] Acquiring lock "cinder-e62b302e-0025-4fe3-aee0-3e3617a1e36c-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:40:30 devstack sudo[107224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:30 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-30d73522-8c1f-49bd-a47d-9961ed817acf tempest-CreateVolumesFromImageTest-799253929 None] Lock "cinder-e62b302e-0025-4fe3-aee0-3e3617a1e36c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:40:31 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-30d73522-8c1f-49bd-a47d-9961ed817acf tempest-CreateVolumesFromImageTest-799253929 None] Acquiring lock "cinder-quobyte-e62b302e-0025-4fe3-aee0-3e3617a1e36c" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:40:31 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-30d73522-8c1f-49bd-a47d-9961ed817acf tempest-CreateVolumesFromImageTest-799253929 None] Lock "cinder-quobyte-e62b302e-0025-4fe3-aee0-3e3617a1e36c" acquired by "delete_volume" :: waited 0.015s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:40:31 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[124402a9-e77b-466a-b842-af318c793ef1]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:40:31 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-30d73522-8c1f-49bd-a47d-9961ed817acf tempest-CreateVolumesFromImageTest-799253929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-e62b302e-0025-4fe3-aee0-3e3617a1e36c {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:31 devstack sudo[107226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-e62b302e-0025-4fe3-aee0-3e3617a1e36c
Jul 30 20:40:31 devstack sudo[107226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:31 devstack sudo[107224]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:31 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-c3480cf1-ad61-4e9b-a162-7154a4a77a78 tempest-CreateVolumesFromSnapshotTest-1096389075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-efae64d4-0356-42c0-8d82-bf512cf6c201,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-efae64d4-0356-42c0-8d82-bf512cf6c201.72345298-cbcd-4d6e-ad88-78f62729b6f1 1G" returned: 0 in 0.461s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:31 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-c3480cf1-ad61-4e9b-a162-7154a4a77a78 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efae64d4-0356-42c0-8d82-bf512cf6c201 -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-efae64d4-0356-42c0-8d82-bf512cf6c201.72345298-cbcd-4d6e-ad88-78f62729b6f1 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:31 devstack sudo[107232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efae64d4-0356-42c0-8d82-bf512cf6c201 -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-efae64d4-0356-42c0-8d82-bf512cf6c201.72345298-cbcd-4d6e-ad88-78f62729b6f1
Jul 30 20:40:31 devstack sudo[107232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:31 devstack sudo[107226]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:31 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-30d73522-8c1f-49bd-a47d-9961ed817acf tempest-CreateVolumesFromImageTest-799253929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-e62b302e-0025-4fe3-aee0-3e3617a1e36c" returned: 0 in 0.409s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:31 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-30d73522-8c1f-49bd-a47d-9961ed817acf tempest-CreateVolumesFromImageTest-799253929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-e62b302e-0025-4fe3-aee0-3e3617a1e36c {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:31 devstack sudo[107236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-e62b302e-0025-4fe3-aee0-3e3617a1e36c
Jul 30 20:40:31 devstack sudo[107236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:31 devstack sudo[107232]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:31 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-c3480cf1-ad61-4e9b-a162-7154a4a77a78 tempest-CreateVolumesFromSnapshotTest-1096389075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efae64d4-0356-42c0-8d82-bf512cf6c201 -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-efae64d4-0356-42c0-8d82-bf512cf6c201.72345298-cbcd-4d6e-ad88-78f62729b6f1" returned: 0 in 0.291s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:31 devstack cinder-volume[88719]: WARNING cinder.volume.drivers.remotefs [None req-c3480cf1-ad61-4e9b-a162-7154a4a77a78 tempest-CreateVolumesFromSnapshotTest-1096389075 None] /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-efae64d4-0356-42c0-8d82-bf512cf6c201.72345298-cbcd-4d6e-ad88-78f62729b6f1 is being set with open permissions: ugo+rw
Jul 30 20:40:31 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-c3480cf1-ad61-4e9b-a162-7154a4a77a78 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-efae64d4-0356-42c0-8d82-bf512cf6c201.72345298-cbcd-4d6e-ad88-78f62729b6f1 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:31 devstack sudo[107242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-efae64d4-0356-42c0-8d82-bf512cf6c201.72345298-cbcd-4d6e-ad88-78f62729b6f1
Jul 30 20:40:31 devstack sudo[107242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:31 devstack sudo[107236]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:31 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-30d73522-8c1f-49bd-a47d-9961ed817acf tempest-CreateVolumesFromImageTest-799253929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-e62b302e-0025-4fe3-aee0-3e3617a1e36c" returned: 0 in 0.270s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:31 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-30d73522-8c1f-49bd-a47d-9961ed817acf tempest-CreateVolumesFromImageTest-799253929 None] Lock "cinder-quobyte-e62b302e-0025-4fe3-aee0-3e3617a1e36c" released by "delete_volume" :: held 0.720s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:40:31 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-30d73522-8c1f-49bd-a47d-9961ed817acf tempest-CreateVolumesFromImageTest-799253929 None] Created reservations ['57f60745-04d5-46ed-938c-9b29b628d21f', 'ea096a5c-82c3-4976-8923-7cc17d7d1417', 'c40600f1-6069-499d-8a84-5075b1a9da6f', '3d20af76-77bd-427c-ad54-507a2159e2ac'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:40:31 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-30d73522-8c1f-49bd-a47d-9961ed817acf tempest-CreateVolumesFromImageTest-799253929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:40:31 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-30d73522-8c1f-49bd-a47d-9961ed817acf tempest-CreateVolumesFromImageTest-799253929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:40:31 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-30d73522-8c1f-49bd-a47d-9961ed817acf tempest-CreateVolumesFromImageTest-799253929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:40:31 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-30d73522-8c1f-49bd-a47d-9961ed817acf tempest-CreateVolumesFromImageTest-799253929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:40:31 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-30d73522-8c1f-49bd-a47d-9961ed817acf tempest-CreateVolumesFromImageTest-799253929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:40:31 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-30d73522-8c1f-49bd-a47d-9961ed817acf tempest-CreateVolumesFromImageTest-799253929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:31 devstack sudo[107244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:40:31 devstack sudo[107244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:31 devstack sudo[107242]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:31 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-c3480cf1-ad61-4e9b-a162-7154a4a77a78 tempest-CreateVolumesFromSnapshotTest-1096389075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-efae64d4-0356-42c0-8d82-bf512cf6c201.72345298-cbcd-4d6e-ad88-78f62729b6f1" returned: 0 in 0.286s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:32 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-c3480cf1-ad61-4e9b-a162-7154a4a77a78 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-efae64d4-0356-42c0-8d82-bf512cf6c201.info {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:32 devstack sudo[107247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-efae64d4-0356-42c0-8d82-bf512cf6c201.info
Jul 30 20:40:32 devstack sudo[107247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:32 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-077d45aa-4f90-4a95-aab3-5b48c436221c tempest-CreateVolumesFromImageTest-799253929 None] Acquiring lock "cinder-e7a3262f-2b2a-4dd8-9770-0157a49a66cf-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:40:32 devstack sudo[107244]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:32 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-077d45aa-4f90-4a95-aab3-5b48c436221c tempest-CreateVolumesFromImageTest-799253929 None] Lock "cinder-e7a3262f-2b2a-4dd8-9770-0157a49a66cf-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:40:32 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-30d73522-8c1f-49bd-a47d-9961ed817acf tempest-CreateVolumesFromImageTest-799253929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.297s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:32 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-30d73522-8c1f-49bd-a47d-9961ed817acf tempest-CreateVolumesFromImageTest-799253929 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:40:32 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-30d73522-8c1f-49bd-a47d-9961ed817acf tempest-CreateVolumesFromImageTest-799253929 None] Deleted volume successfully.
Jul 30 20:40:32 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-30d73522-8c1f-49bd-a47d-9961ed817acf tempest-CreateVolumesFromImageTest-799253929 None] Lock "cinder-e62b302e-0025-4fe3-aee0-3e3617a1e36c-delete_volume" released by "delete_volume" :: held 1.258s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:40:32 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-077d45aa-4f90-4a95-aab3-5b48c436221c tempest-CreateVolumesFromImageTest-799253929 None] Acquiring lock "cinder-quobyte-e7a3262f-2b2a-4dd8-9770-0157a49a66cf" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:40:32 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-077d45aa-4f90-4a95-aab3-5b48c436221c tempest-CreateVolumesFromImageTest-799253929 None] Lock "cinder-quobyte-e7a3262f-2b2a-4dd8-9770-0157a49a66cf" acquired by "delete_volume" :: waited 0.015s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:40:32 devstack sudo[107247]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:32 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-c3480cf1-ad61-4e9b-a162-7154a4a77a78 tempest-CreateVolumesFromSnapshotTest-1096389075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-efae64d4-0356-42c0-8d82-bf512cf6c201.info" returned: 0 in 0.281s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:32 devstack cinder-volume[88719]: WARNING cinder.volume.drivers.remotefs [None req-c3480cf1-ad61-4e9b-a162-7154a4a77a78 tempest-CreateVolumesFromSnapshotTest-1096389075 None] /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-efae64d4-0356-42c0-8d82-bf512cf6c201.info is being set with open permissions: ugo+rw
Jul 30 20:40:32 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-c3480cf1-ad61-4e9b-a162-7154a4a77a78 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-efae64d4-0356-42c0-8d82-bf512cf6c201.info {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:32 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[383a7bad-8c44-4eb7-9904-c78f6ad7255b]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:40:32 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-077d45aa-4f90-4a95-aab3-5b48c436221c tempest-CreateVolumesFromImageTest-799253929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-e7a3262f-2b2a-4dd8-9770-0157a49a66cf {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:32 devstack sudo[107251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-efae64d4-0356-42c0-8d82-bf512cf6c201.info
Jul 30 20:40:32 devstack sudo[107251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:32 devstack sudo[107252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-e7a3262f-2b2a-4dd8-9770-0157a49a66cf
Jul 30 20:40:32 devstack sudo[107252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:32 devstack sudo[107251]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:32 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-c3480cf1-ad61-4e9b-a162-7154a4a77a78 tempest-CreateVolumesFromSnapshotTest-1096389075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-efae64d4-0356-42c0-8d82-bf512cf6c201.info" returned: 0 in 0.269s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:32 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-c3480cf1-ad61-4e9b-a162-7154a4a77a78 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.104s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:40:32 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-c9eb7cd3-ef8c-4344-badd-10ca9f5a2b5f tempest-VolumeDependencyTests-326923044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.819s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:40:32 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-c9eb7cd3-ef8c-4344-badd-10ca9f5a2b5f tempest-VolumeDependencyTests-326923044 None] Creating offline snapshot bb8f3fc7-a73c-4aea-abff-bdafe21b7b32 of volume dc1416a2-99d8-447c-aa4f-7fe69fe04b59 {{(pid=88719) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 30 20:40:32 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-c3480cf1-ad61-4e9b-a162-7154a4a77a78 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Create snapshot completed successfully
Jul 30 20:40:32 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c5d3c33-52f7-4b2a-a304-04c108c9d393]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:40:32 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-c9eb7cd3-ef8c-4344-badd-10ca9f5a2b5f tempest-VolumeDependencyTests-326923044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-dc1416a2-99d8-447c-aa4f-7fe69fe04b59 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:32 devstack sudo[107252]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:32 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-077d45aa-4f90-4a95-aab3-5b48c436221c tempest-CreateVolumesFromImageTest-799253929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-e7a3262f-2b2a-4dd8-9770-0157a49a66cf" returned: 0 in 0.381s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:32 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-077d45aa-4f90-4a95-aab3-5b48c436221c tempest-CreateVolumesFromImageTest-799253929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-e7a3262f-2b2a-4dd8-9770-0157a49a66cf {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:32 devstack sudo[107260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-e7a3262f-2b2a-4dd8-9770-0157a49a66cf
Jul 30 20:40:32 devstack sudo[107260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:32 devstack sudo[107259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-dc1416a2-99d8-447c-aa4f-7fe69fe04b59
Jul 30 20:40:32 devstack sudo[107259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:32 devstack sudo[107260]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:32 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-077d45aa-4f90-4a95-aab3-5b48c436221c tempest-CreateVolumesFromImageTest-799253929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-e7a3262f-2b2a-4dd8-9770-0157a49a66cf" returned: 0 in 0.261s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:32 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-077d45aa-4f90-4a95-aab3-5b48c436221c tempest-CreateVolumesFromImageTest-799253929 None] Lock "cinder-quobyte-e7a3262f-2b2a-4dd8-9770-0157a49a66cf" released by "delete_volume" :: held 0.692s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:40:33 devstack sudo[107259]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:33 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-c9eb7cd3-ef8c-4344-badd-10ca9f5a2b5f tempest-VolumeDependencyTests-326923044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-dc1416a2-99d8-447c-aa4f-7fe69fe04b59" returned: 0 in 0.376s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:33 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-c9eb7cd3-ef8c-4344-badd-10ca9f5a2b5f tempest-VolumeDependencyTests-326923044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-dc1416a2-99d8-447c-aa4f-7fe69fe04b59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-dc1416a2-99d8-447c-aa4f-7fe69fe04b59.bb8f3fc7-a73c-4aea-abff-bdafe21b7b32 1G {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:33 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-077d45aa-4f90-4a95-aab3-5b48c436221c tempest-CreateVolumesFromImageTest-799253929 None] Created reservations ['cb93a6a5-503a-499f-ad1a-cab37f4815a0', '0067e4c6-6a79-40e5-95f0-e0f01aca46fa', '0951036d-b634-45da-bb5a-12faab6cd74a', 'a6219267-99fa-4afb-9398-fe6f292f703f'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:40:33 devstack sudo[107267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-dc1416a2-99d8-447c-aa4f-7fe69fe04b59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-dc1416a2-99d8-447c-aa4f-7fe69fe04b59.bb8f3fc7-a73c-4aea-abff-bdafe21b7b32 1G
Jul 30 20:40:33 devstack sudo[107267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:33 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-077d45aa-4f90-4a95-aab3-5b48c436221c tempest-CreateVolumesFromImageTest-799253929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:40:33 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-077d45aa-4f90-4a95-aab3-5b48c436221c tempest-CreateVolumesFromImageTest-799253929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:40:33 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-077d45aa-4f90-4a95-aab3-5b48c436221c tempest-CreateVolumesFromImageTest-799253929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:40:33 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-077d45aa-4f90-4a95-aab3-5b48c436221c tempest-CreateVolumesFromImageTest-799253929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:40:33 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-077d45aa-4f90-4a95-aab3-5b48c436221c tempest-CreateVolumesFromImageTest-799253929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:40:33 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-077d45aa-4f90-4a95-aab3-5b48c436221c tempest-CreateVolumesFromImageTest-799253929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:33 devstack sudo[107269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:40:33 devstack sudo[107269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:33 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-f8fdfee1-60f2-476a-a121-793c4ee32267 tempest-CreateVolumesFromImageTest-799253929 None] Acquiring lock "cinder-c95fc2a5-c186-4b1d-b35b-57723fca8159-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:40:33 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-f8fdfee1-60f2-476a-a121-793c4ee32267 tempest-CreateVolumesFromImageTest-799253929 None] Lock "cinder-c95fc2a5-c186-4b1d-b35b-57723fca8159-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:40:33 devstack sudo[107269]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:33 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-077d45aa-4f90-4a95-aab3-5b48c436221c tempest-CreateVolumesFromImageTest-799253929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.281s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:33 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-077d45aa-4f90-4a95-aab3-5b48c436221c tempest-CreateVolumesFromImageTest-799253929 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:40:33 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-077d45aa-4f90-4a95-aab3-5b48c436221c tempest-CreateVolumesFromImageTest-799253929 None] Deleted volume successfully.
Jul 30 20:40:33 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-f8fdfee1-60f2-476a-a121-793c4ee32267 tempest-CreateVolumesFromImageTest-799253929 None] Acquiring lock "cinder-quobyte-c95fc2a5-c186-4b1d-b35b-57723fca8159" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:40:33 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-077d45aa-4f90-4a95-aab3-5b48c436221c tempest-CreateVolumesFromImageTest-799253929 None] Lock "cinder-e7a3262f-2b2a-4dd8-9770-0157a49a66cf-delete_volume" released by "delete_volume" :: held 1.257s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:40:33 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-f8fdfee1-60f2-476a-a121-793c4ee32267 tempest-CreateVolumesFromImageTest-799253929 None] Lock "cinder-quobyte-c95fc2a5-c186-4b1d-b35b-57723fca8159" acquired by "delete_volume" :: waited 0.019s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:40:33 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c2f51e2-4248-45ad-b5fa-82729a802b6f]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:40:33 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f8fdfee1-60f2-476a-a121-793c4ee32267 tempest-CreateVolumesFromImageTest-799253929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c95fc2a5-c186-4b1d-b35b-57723fca8159 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:33 devstack sudo[107267]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:33 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-c9eb7cd3-ef8c-4344-badd-10ca9f5a2b5f tempest-VolumeDependencyTests-326923044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-dc1416a2-99d8-447c-aa4f-7fe69fe04b59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-dc1416a2-99d8-447c-aa4f-7fe69fe04b59.bb8f3fc7-a73c-4aea-abff-bdafe21b7b32 1G" returned: 0 in 0.492s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:33 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-c9eb7cd3-ef8c-4344-badd-10ca9f5a2b5f tempest-VolumeDependencyTests-326923044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc1416a2-99d8-447c-aa4f-7fe69fe04b59 -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-dc1416a2-99d8-447c-aa4f-7fe69fe04b59.bb8f3fc7-a73c-4aea-abff-bdafe21b7b32 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:33 devstack sudo[107278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc1416a2-99d8-447c-aa4f-7fe69fe04b59 -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-dc1416a2-99d8-447c-aa4f-7fe69fe04b59.bb8f3fc7-a73c-4aea-abff-bdafe21b7b32
Jul 30 20:40:33 devstack sudo[107278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:33 devstack sudo[107277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c95fc2a5-c186-4b1d-b35b-57723fca8159
Jul 30 20:40:33 devstack sudo[107277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:33 devstack sudo[107278]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:33 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-c9eb7cd3-ef8c-4344-badd-10ca9f5a2b5f tempest-VolumeDependencyTests-326923044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc1416a2-99d8-447c-aa4f-7fe69fe04b59 -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-dc1416a2-99d8-447c-aa4f-7fe69fe04b59.bb8f3fc7-a73c-4aea-abff-bdafe21b7b32" returned: 0 in 0.321s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:33 devstack cinder-volume[88719]: WARNING cinder.volume.drivers.remotefs [None req-c9eb7cd3-ef8c-4344-badd-10ca9f5a2b5f tempest-VolumeDependencyTests-326923044 None] /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-dc1416a2-99d8-447c-aa4f-7fe69fe04b59.bb8f3fc7-a73c-4aea-abff-bdafe21b7b32 is being set with open permissions: ugo+rw
Jul 30 20:40:33 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-c9eb7cd3-ef8c-4344-badd-10ca9f5a2b5f tempest-VolumeDependencyTests-326923044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-dc1416a2-99d8-447c-aa4f-7fe69fe04b59.bb8f3fc7-a73c-4aea-abff-bdafe21b7b32 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:33 devstack sudo[107287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-dc1416a2-99d8-447c-aa4f-7fe69fe04b59.bb8f3fc7-a73c-4aea-abff-bdafe21b7b32
Jul 30 20:40:33 devstack sudo[107287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:33 devstack sudo[107277]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:33 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f8fdfee1-60f2-476a-a121-793c4ee32267 tempest-CreateVolumesFromImageTest-799253929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c95fc2a5-c186-4b1d-b35b-57723fca8159" returned: 0 in 0.434s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:33 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f8fdfee1-60f2-476a-a121-793c4ee32267 tempest-CreateVolumesFromImageTest-799253929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c95fc2a5-c186-4b1d-b35b-57723fca8159 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:33 devstack sudo[107289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c95fc2a5-c186-4b1d-b35b-57723fca8159
Jul 30 20:40:33 devstack sudo[107289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:34 devstack sudo[107287]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:34 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-c9eb7cd3-ef8c-4344-badd-10ca9f5a2b5f tempest-VolumeDependencyTests-326923044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-dc1416a2-99d8-447c-aa4f-7fe69fe04b59.bb8f3fc7-a73c-4aea-abff-bdafe21b7b32" returned: 0 in 0.291s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:34 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-c9eb7cd3-ef8c-4344-badd-10ca9f5a2b5f tempest-VolumeDependencyTests-326923044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-dc1416a2-99d8-447c-aa4f-7fe69fe04b59.info {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:34 devstack sudo[107293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-dc1416a2-99d8-447c-aa4f-7fe69fe04b59.info
Jul 30 20:40:34 devstack sudo[107293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:34 devstack sudo[107289]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:34 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f8fdfee1-60f2-476a-a121-793c4ee32267 tempest-CreateVolumesFromImageTest-799253929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c95fc2a5-c186-4b1d-b35b-57723fca8159" returned: 0 in 0.318s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:34 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-f8fdfee1-60f2-476a-a121-793c4ee32267 tempest-CreateVolumesFromImageTest-799253929 None] Lock "cinder-quobyte-c95fc2a5-c186-4b1d-b35b-57723fca8159" released by "delete_volume" :: held 0.800s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:40:34 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ff17ac8-a3df-4c62-b0ee-447bae6e9cc4 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:40:34 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-1ff17ac8-a3df-4c62-b0ee-447bae6e9cc4 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Flow 'volume_create_manager' (100bf316-c55c-440f-a641-eda9776d7c24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:40:34 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-1ff17ac8-a3df-4c62-b0ee-447bae6e9cc4 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77f7786a-d1fc-4b26-945c-52ab63e7c68a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:34 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-1ff17ac8-a3df-4c62-b0ee-447bae6e9cc4 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77f7786a-d1fc-4b26-945c-52ab63e7c68a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:40:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-104664606',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5732cb39-eeb5-4f52-9e64-c698a128b605,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd1f96963de14944bf651afe61967374',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:40:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:40:34Z,use_quota=True,user_id='e8bf019004ba44838613267030b09257',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:34 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-1ff17ac8-a3df-4c62-b0ee-447bae6e9cc4 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2c7ee5d-3c1a-4418-aba8-6cd1e02e9158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:34 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-1ff17ac8-a3df-4c62-b0ee-447bae6e9cc4 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2c7ee5d-3c1a-4418-aba8-6cd1e02e9158) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:34 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-1ff17ac8-a3df-4c62-b0ee-447bae6e9cc4 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (842031c2-019d-4022-a7a7-ccd711963018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:34 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-1ff17ac8-a3df-4c62-b0ee-447bae6e9cc4 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (842031c2-019d-4022-a7a7-ccd711963018) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5732cb39-eeb5-4f52-9e64-c698a128b605', 'volume_name': 'volume-5732cb39-eeb5-4f52-9e64-c698a128b605', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:34 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-1ff17ac8-a3df-4c62-b0ee-447bae6e9cc4 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bea91e1-5003-4841-acac-0090e9ba6805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:34 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-1ff17ac8-a3df-4c62-b0ee-447bae6e9cc4 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bea91e1-5003-4841-acac-0090e9ba6805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:34 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-1ff17ac8-a3df-4c62-b0ee-447bae6e9cc4 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a047c4ca-325f-43c6-9d02-a6ba2a336110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:34 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-1ff17ac8-a3df-4c62-b0ee-447bae6e9cc4 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Volume 5732cb39-eeb5-4f52-9e64-c698a128b605: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5732cb39-eeb5-4f52-9e64-c698a128b605', 'volume_size': 1}
Jul 30 20:40:34 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-1ff17ac8-a3df-4c62-b0ee-447bae6e9cc4 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:40:34 devstack sudo[107293]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:34 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-c9eb7cd3-ef8c-4344-badd-10ca9f5a2b5f tempest-VolumeDependencyTests-326923044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-dc1416a2-99d8-447c-aa4f-7fe69fe04b59.info" returned: 0 in 0.312s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:34 devstack cinder-volume[88719]: WARNING cinder.volume.drivers.remotefs [None req-c9eb7cd3-ef8c-4344-badd-10ca9f5a2b5f tempest-VolumeDependencyTests-326923044 None] /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-dc1416a2-99d8-447c-aa4f-7fe69fe04b59.info is being set with open permissions: ugo+rw
Jul 30 20:40:34 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-c9eb7cd3-ef8c-4344-badd-10ca9f5a2b5f tempest-VolumeDependencyTests-326923044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-dc1416a2-99d8-447c-aa4f-7fe69fe04b59.info {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:34 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-f8fdfee1-60f2-476a-a121-793c4ee32267 tempest-CreateVolumesFromImageTest-799253929 None] Created reservations ['ff1c9295-b352-474a-ba39-ff425f04189e', 'b1772111-6a31-4c59-b022-6cc2c7b1dfd1', '14cd834b-d24c-435b-b0e9-78bd26be5a15', 'ea3fb32e-b8cc-4044-a7cc-eafe09ee1568'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:40:34 devstack sudo[107296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-dc1416a2-99d8-447c-aa4f-7fe69fe04b59.info
Jul 30 20:40:34 devstack sudo[107296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:34 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-f8fdfee1-60f2-476a-a121-793c4ee32267 tempest-CreateVolumesFromImageTest-799253929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:40:34 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-f8fdfee1-60f2-476a-a121-793c4ee32267 tempest-CreateVolumesFromImageTest-799253929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:40:34 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-f8fdfee1-60f2-476a-a121-793c4ee32267 tempest-CreateVolumesFromImageTest-799253929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:40:34 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-f8fdfee1-60f2-476a-a121-793c4ee32267 tempest-CreateVolumesFromImageTest-799253929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:40:34 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-f8fdfee1-60f2-476a-a121-793c4ee32267 tempest-CreateVolumesFromImageTest-799253929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:40:34 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f8fdfee1-60f2-476a-a121-793c4ee32267 tempest-CreateVolumesFromImageTest-799253929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:34 devstack sudo[107298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:40:34 devstack sudo[107298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:34 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-4813c78c-2aa9-4878-9eaa-993061173002 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:40:34 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-4813c78c-2aa9-4878-9eaa-993061173002 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Flow 'volume_create_manager' (6821549a-05bb-4dbe-8f39-b3708d3a6747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:40:34 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-4813c78c-2aa9-4878-9eaa-993061173002 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb60bc11-c6dd-48c8-8e59-0e4daded974a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:34 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-4813c78c-2aa9-4878-9eaa-993061173002 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb60bc11-c6dd-48c8-8e59-0e4daded974a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:40:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2140766404',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=328de093-2a7f-4055-9014-3a590e46d99c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd1f96963de14944bf651afe61967374',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:40:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:40:35Z,use_quota=True,user_id='e8bf019004ba44838613267030b09257',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:34 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-4813c78c-2aa9-4878-9eaa-993061173002 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a65056c-52a3-4b94-9966-a6c43606ad14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:34 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-4813c78c-2aa9-4878-9eaa-993061173002 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a65056c-52a3-4b94-9966-a6c43606ad14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:34 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-4813c78c-2aa9-4878-9eaa-993061173002 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e293a46-99a0-4558-b392-080a42ed64ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:34 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-4813c78c-2aa9-4878-9eaa-993061173002 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e293a46-99a0-4558-b392-080a42ed64ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '328de093-2a7f-4055-9014-3a590e46d99c', 'volume_name': 'volume-328de093-2a7f-4055-9014-3a590e46d99c', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:34 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-4813c78c-2aa9-4878-9eaa-993061173002 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f4a66d1-264a-48be-af46-f52e373e2fb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:34 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-4813c78c-2aa9-4878-9eaa-993061173002 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f4a66d1-264a-48be-af46-f52e373e2fb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:34 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-4813c78c-2aa9-4878-9eaa-993061173002 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05a677a2-73b6-4062-9b64-990aec5a097d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:34 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-4813c78c-2aa9-4878-9eaa-993061173002 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Volume 328de093-2a7f-4055-9014-3a590e46d99c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-328de093-2a7f-4055-9014-3a590e46d99c', 'volume_size': 1}
Jul 30 20:40:34 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-4813c78c-2aa9-4878-9eaa-993061173002 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:40:34 devstack sudo[107296]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:34 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-c9eb7cd3-ef8c-4344-badd-10ca9f5a2b5f tempest-VolumeDependencyTests-326923044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-dc1416a2-99d8-447c-aa4f-7fe69fe04b59.info" returned: 0 in 0.357s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:34 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-c9eb7cd3-ef8c-4344-badd-10ca9f5a2b5f tempest-VolumeDependencyTests-326923044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.278s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:40:34 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-aca54c50-0de1-43de-939e-3512bd414f89 tempest-VolumeAndVolumeTypeFromImageTest-776863720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.060s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:40:34 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-aca54c50-0de1-43de-939e-3512bd414f89 tempest-VolumeAndVolumeTypeFromImageTest-776863720 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:40:28Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66f15175-b846-4cef-ad55-04e653dbbb52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='264ff733820c4646961c042ae4a9f05c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:40:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:40:29Z,use_quota=True,user_id='2a150087093c4d9e9c8fbde65dd7526b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8066632c-2790-47f9-becf-8dfc3b0c65d5),volume_type_id=8066632c-2790-47f9-becf-8dfc3b0c65d5)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:40:34 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-aca54c50-0de1-43de-939e-3512bd414f89 tempest-VolumeAndVolumeTypeFromImageTest-776863720 None] Creating volume 66f15175-b846-4cef-ad55-04e653dbbb52 {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:40:34 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-aca54c50-0de1-43de-939e-3512bd414f89 tempest-VolumeAndVolumeTypeFromImageTest-776863720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:40:34 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-aca54c50-0de1-43de-939e-3512bd414f89 tempest-VolumeAndVolumeTypeFromImageTest-776863720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:40:34 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-aca54c50-0de1-43de-939e-3512bd414f89 tempest-VolumeAndVolumeTypeFromImageTest-776863720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:40:34 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-aca54c50-0de1-43de-939e-3512bd414f89 tempest-VolumeAndVolumeTypeFromImageTest-776863720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:40:34 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-aca54c50-0de1-43de-939e-3512bd414f89 tempest-VolumeAndVolumeTypeFromImageTest-776863720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:40:34 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-aca54c50-0de1-43de-939e-3512bd414f89 tempest-VolumeAndVolumeTypeFromImageTest-776863720 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:40:34 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-aca54c50-0de1-43de-939e-3512bd414f89 tempest-VolumeAndVolumeTypeFromImageTest-776863720 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:40:34 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-aca54c50-0de1-43de-939e-3512bd414f89 tempest-VolumeAndVolumeTypeFromImageTest-776863720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-66f15175-b846-4cef-ad55-04e653dbbb52 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:34 devstack sudo[107298]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:34 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f8fdfee1-60f2-476a-a121-793c4ee32267 tempest-CreateVolumesFromImageTest-799253929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.294s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:34 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-f8fdfee1-60f2-476a-a121-793c4ee32267 tempest-CreateVolumesFromImageTest-799253929 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:40:34 devstack sudo[107302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-66f15175-b846-4cef-ad55-04e653dbbb52 1073741824
Jul 30 20:40:34 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-f8fdfee1-60f2-476a-a121-793c4ee32267 tempest-CreateVolumesFromImageTest-799253929 None] Deleted volume successfully.
Jul 30 20:40:34 devstack sudo[107302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:34 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-c9eb7cd3-ef8c-4344-badd-10ca9f5a2b5f tempest-VolumeDependencyTests-326923044 None] Create snapshot completed successfully
Jul 30 20:40:34 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-f8fdfee1-60f2-476a-a121-793c4ee32267 tempest-CreateVolumesFromImageTest-799253929 None] Lock "cinder-c95fc2a5-c186-4b1d-b35b-57723fca8159-delete_volume" released by "delete_volume" :: held 1.579s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:40:35 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-110d01f9-63f4-4a87-91dc-269c62d52e74 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:40:35 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-110d01f9-63f4-4a87-91dc-269c62d52e74 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Flow 'volume_create_manager' (df1b42e3-6218-413c-9ada-dbb0a44e0d31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:40:35 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-110d01f9-63f4-4a87-91dc-269c62d52e74 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0e8b7f7-82dd-4a1b-a834-63d2670425ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:35 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-110d01f9-63f4-4a87-91dc-269c62d52e74 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0e8b7f7-82dd-4a1b-a834-63d2670425ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:40:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1593976045',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92c736cc-7160-48f0-b763-19afc3d07080,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd1f96963de14944bf651afe61967374',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:40:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:40:35Z,use_quota=True,user_id='e8bf019004ba44838613267030b09257',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:35 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-110d01f9-63f4-4a87-91dc-269c62d52e74 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ddf93b7-cfb6-4f90-ba42-c692b2cb728b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:35 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-110d01f9-63f4-4a87-91dc-269c62d52e74 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ddf93b7-cfb6-4f90-ba42-c692b2cb728b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:35 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-110d01f9-63f4-4a87-91dc-269c62d52e74 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08525e76-49a0-492e-b2d0-3ad9dfd08f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:35 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-110d01f9-63f4-4a87-91dc-269c62d52e74 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08525e76-49a0-492e-b2d0-3ad9dfd08f38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92c736cc-7160-48f0-b763-19afc3d07080', 'volume_name': 'volume-92c736cc-7160-48f0-b763-19afc3d07080', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:35 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-110d01f9-63f4-4a87-91dc-269c62d52e74 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5778925-30cd-4742-a8b0-868deb6d5cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:35 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-110d01f9-63f4-4a87-91dc-269c62d52e74 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5778925-30cd-4742-a8b0-868deb6d5cc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:35 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-110d01f9-63f4-4a87-91dc-269c62d52e74 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a12f4f41-2ab3-429d-a842-703e7c769604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:35 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-110d01f9-63f4-4a87-91dc-269c62d52e74 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Volume 92c736cc-7160-48f0-b763-19afc3d07080: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92c736cc-7160-48f0-b763-19afc3d07080', 'volume_size': 1}
Jul 30 20:40:35 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-110d01f9-63f4-4a87-91dc-269c62d52e74 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:40:35 devstack sudo[107302]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:35 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-aca54c50-0de1-43de-939e-3512bd414f89 tempest-VolumeAndVolumeTypeFromImageTest-776863720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-66f15175-b846-4cef-ad55-04e653dbbb52 1073741824" returned: 0 in 0.628s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:35 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-aca54c50-0de1-43de-939e-3512bd414f89 tempest-VolumeAndVolumeTypeFromImageTest-776863720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-66f15175-b846-4cef-ad55-04e653dbbb52 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:35 devstack sudo[107309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-66f15175-b846-4cef-ad55-04e653dbbb52
Jul 30 20:40:35 devstack sudo[107309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:35 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-5c6dcd85-89ee-424b-b872-e86ae2f70a3b tempest-CreateVolumesFromImageTest-799253929 None] Acquiring lock "cinder-1a65807b-1dc6-4183-822c-c925dbc7e9c0-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:40:35 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-5c6dcd85-89ee-424b-b872-e86ae2f70a3b tempest-CreateVolumesFromImageTest-799253929 None] Lock "cinder-1a65807b-1dc6-4183-822c-c925dbc7e9c0-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:40:35 devstack sudo[107309]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:35 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-aca54c50-0de1-43de-939e-3512bd414f89 tempest-VolumeAndVolumeTypeFromImageTest-776863720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-66f15175-b846-4cef-ad55-04e653dbbb52" returned: 0 in 0.338s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:35 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-aca54c50-0de1-43de-939e-3512bd414f89 tempest-VolumeAndVolumeTypeFromImageTest-776863720 None] <== create_volume: return (1031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:40:35 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-aca54c50-0de1-43de-939e-3512bd414f89 tempest-VolumeAndVolumeTypeFromImageTest-776863720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:40:35 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-1ff17ac8-a3df-4c62-b0ee-447bae6e9cc4 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.454s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:40:35 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-1ff17ac8-a3df-4c62-b0ee-447bae6e9cc4 tempest-CreateVolumesFromSnapshotTest-1096389075 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:40:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-104664606',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5732cb39-eeb5-4f52-9e64-c698a128b605,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd1f96963de14944bf651afe61967374',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:40:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:40:34Z,use_quota=True,user_id='e8bf019004ba44838613267030b09257',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:40:35 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-1ff17ac8-a3df-4c62-b0ee-447bae6e9cc4 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Creating volume 5732cb39-eeb5-4f52-9e64-c698a128b605 {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:40:35 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-1ff17ac8-a3df-4c62-b0ee-447bae6e9cc4 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:40:35 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-1ff17ac8-a3df-4c62-b0ee-447bae6e9cc4 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:40:35 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-1ff17ac8-a3df-4c62-b0ee-447bae6e9cc4 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:40:35 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-1ff17ac8-a3df-4c62-b0ee-447bae6e9cc4 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:40:35 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-1ff17ac8-a3df-4c62-b0ee-447bae6e9cc4 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:40:35 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-1ff17ac8-a3df-4c62-b0ee-447bae6e9cc4 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:40:35 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-1ff17ac8-a3df-4c62-b0ee-447bae6e9cc4 tempest-CreateVolumesFromSnapshotTest-1096389075 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:40:35 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-1ff17ac8-a3df-4c62-b0ee-447bae6e9cc4 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5732cb39-eeb5-4f52-9e64-c698a128b605 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:35 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-5c6dcd85-89ee-424b-b872-e86ae2f70a3b tempest-CreateVolumesFromImageTest-799253929 None] Acquiring lock "cinder-quobyte-1a65807b-1dc6-4183-822c-c925dbc7e9c0" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:40:35 devstack sudo[107312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5732cb39-eeb5-4f52-9e64-c698a128b605 1073741824
Jul 30 20:40:35 devstack sudo[107312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:35 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-5c6dcd85-89ee-424b-b872-e86ae2f70a3b tempest-CreateVolumesFromImageTest-799253929 None] Lock "cinder-quobyte-1a65807b-1dc6-4183-822c-c925dbc7e9c0" acquired by "delete_volume" :: waited 0.034s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:40:36 devstack cinder-volume[88719]: DEBUG cinder.volume.volume_utils [None req-aca54c50-0de1-43de-939e-3512bd414f89 tempest-VolumeAndVolumeTypeFromImageTest-776863720 None] Attempting download of 68360f71-c92a-4f20-b4ab-20a67fb6dcd4 ((None, [{'url': 'file:///opt/stack/data/glance/images/68360f71-c92a-4f20-b4ab-20a67fb6dcd4', 'metadata': {}}])) to volume 66f15175-b846-4cef-ad55-04e653dbbb52. {{(pid=88719) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 30 20:40:36 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[a40951fd-dadd-42ac-832b-da1d125a366e]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:40:36 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-5c6dcd85-89ee-424b-b872-e86ae2f70a3b tempest-CreateVolumesFromImageTest-799253929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1a65807b-1dc6-4183-822c-c925dbc7e9c0 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:36 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0642f72-6e12-4dbb-b9c2-f9840eca0478]: (4, 'raw') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:40:36 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-aca54c50-0de1-43de-939e-3512bd414f89 tempest-VolumeAndVolumeTypeFromImageTest-776863720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_68360f71-c92a-4f20-b4ab-20a67fb6dcd4_af9lh_3c {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:36 devstack sudo[107314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1a65807b-1dc6-4183-822c-c925dbc7e9c0
Jul 30 20:40:36 devstack sudo[107314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:36 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5b0a589-d51e-4aca-a355-6f6ae27a030a tempest-VolumeDependencyTests-326923044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:40:36 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-31697e85-b705-44a1-a7b1-3389c71f86a3 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:40:36 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-31697e85-b705-44a1-a7b1-3389c71f86a3 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Flow 'volume_create_manager' (d9db64f2-89a9-406d-9fc1-86ee65cca143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:40:36 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-31697e85-b705-44a1-a7b1-3389c71f86a3 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecdd2c84-b56a-4ee4-96d6-efbb5331d971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:36 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-31697e85-b705-44a1-a7b1-3389c71f86a3 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecdd2c84-b56a-4ee4-96d6-efbb5331d971) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:40:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1465685240',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46f56366-c53c-4d7f-8c1c-a22b2209b9ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd1f96963de14944bf651afe61967374',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:40:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:40:36Z,use_quota=True,user_id='e8bf019004ba44838613267030b09257',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:36 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-31697e85-b705-44a1-a7b1-3389c71f86a3 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (224fe7ab-9bda-4dea-8fd2-e6924f1035b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:36 devstack sudo[107315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_68360f71-c92a-4f20-b4ab-20a67fb6dcd4_af9lh_3c
Jul 30 20:40:36 devstack sudo[107315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:36 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-31697e85-b705-44a1-a7b1-3389c71f86a3 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (224fe7ab-9bda-4dea-8fd2-e6924f1035b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:36 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-31697e85-b705-44a1-a7b1-3389c71f86a3 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76e6fac1-611c-4723-94aa-c754651c1c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:36 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-31697e85-b705-44a1-a7b1-3389c71f86a3 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76e6fac1-611c-4723-94aa-c754651c1c5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46f56366-c53c-4d7f-8c1c-a22b2209b9ba', 'volume_name': 'volume-46f56366-c53c-4d7f-8c1c-a22b2209b9ba', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:36 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-31697e85-b705-44a1-a7b1-3389c71f86a3 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36ea93cd-abad-42e0-867f-e2124d92ffdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:36 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-31697e85-b705-44a1-a7b1-3389c71f86a3 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36ea93cd-abad-42e0-867f-e2124d92ffdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:36 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-31697e85-b705-44a1-a7b1-3389c71f86a3 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d162d54e-d32e-41f4-bd30-1ddfafa5b48e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:36 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-31697e85-b705-44a1-a7b1-3389c71f86a3 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Volume 46f56366-c53c-4d7f-8c1c-a22b2209b9ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46f56366-c53c-4d7f-8c1c-a22b2209b9ba', 'volume_size': 1}
Jul 30 20:40:36 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-31697e85-b705-44a1-a7b1-3389c71f86a3 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:40:36 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e5b0a589-d51e-4aca-a355-6f6ae27a030a tempest-VolumeDependencyTests-326923044 None] Flow 'volume_create_manager' (0594219b-42b9-4d13-9437-fc28ed7f9918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:40:36 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e5b0a589-d51e-4aca-a355-6f6ae27a030a tempest-VolumeDependencyTests-326923044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ba086a8-258a-436c-98d4-8ddc688a03e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:36 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-af476d73-9255-4a78-9853-57a9221fdacd tempest-CreateVolumesFromSnapshotTest-1096389075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:40:36 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-af476d73-9255-4a78-9853-57a9221fdacd tempest-CreateVolumesFromSnapshotTest-1096389075 None] Flow 'volume_create_manager' (cd5a30e2-21c3-4478-ab3b-9b296f8cf9a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:40:36 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-af476d73-9255-4a78-9853-57a9221fdacd tempest-CreateVolumesFromSnapshotTest-1096389075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (228c6bae-0071-4340-8af7-599c81dc18cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:36 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e5b0a589-d51e-4aca-a355-6f6ae27a030a tempest-VolumeDependencyTests-326923044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ba086a8-258a-436c-98d4-8ddc688a03e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:40:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-236080735',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d87c1db1-cf52-4da0-a840-6fc53223e94f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d28a4825cf764961bd16d185f93fcf68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:40:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=bb8f3fc7-a73c-4aea-abff-bdafe21b7b32,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:40:36Z,use_quota=True,user_id='e34818f899eb4081bb3e236997e77dda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:36 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e5b0a589-d51e-4aca-a355-6f6ae27a030a tempest-VolumeDependencyTests-326923044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7122c81f-93b3-4323-a048-90e03bce4ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:36 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e5b0a589-d51e-4aca-a355-6f6ae27a030a tempest-VolumeDependencyTests-326923044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7122c81f-93b3-4323-a048-90e03bce4ad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:36 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e5b0a589-d51e-4aca-a355-6f6ae27a030a tempest-VolumeDependencyTests-326923044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b01167f-9aa0-4946-bead-3b858c3a8348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:36 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e5b0a589-d51e-4aca-a355-6f6ae27a030a tempest-VolumeDependencyTests-326923044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b01167f-9aa0-4946-bead-3b858c3a8348) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd87c1db1-cf52-4da0-a840-6fc53223e94f', 'volume_name': 'volume-d87c1db1-cf52-4da0-a840-6fc53223e94f', 'volume_size': 1, 'snapshot_id': 'bb8f3fc7-a73c-4aea-abff-bdafe21b7b32'}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:36 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e5b0a589-d51e-4aca-a355-6f6ae27a030a tempest-VolumeDependencyTests-326923044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad88765c-e126-4ab2-8b9b-c7aea5bc9def) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:36 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e5b0a589-d51e-4aca-a355-6f6ae27a030a tempest-VolumeDependencyTests-326923044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad88765c-e126-4ab2-8b9b-c7aea5bc9def) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:36 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e5b0a589-d51e-4aca-a355-6f6ae27a030a tempest-VolumeDependencyTests-326923044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a53d0227-05ac-4b33-b666-c7d9ad755019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:36 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-e5b0a589-d51e-4aca-a355-6f6ae27a030a tempest-VolumeDependencyTests-326923044 None] Volume d87c1db1-cf52-4da0-a840-6fc53223e94f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d87c1db1-cf52-4da0-a840-6fc53223e94f', 'volume_size': 1, 'snapshot_id': 'bb8f3fc7-a73c-4aea-abff-bdafe21b7b32'}
Jul 30 20:40:36 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-af476d73-9255-4a78-9853-57a9221fdacd tempest-CreateVolumesFromSnapshotTest-1096389075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (228c6bae-0071-4340-8af7-599c81dc18cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:40:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-336376985',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1d94e02-1490-47cb-bb2c-478a83a6bf50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd1f96963de14944bf651afe61967374',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:40:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:40:36Z,use_quota=True,user_id='e8bf019004ba44838613267030b09257',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:36 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-af476d73-9255-4a78-9853-57a9221fdacd tempest-CreateVolumesFromSnapshotTest-1096389075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fc1a0b1-80cc-4c9a-8492-635f203e1dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:36 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-af476d73-9255-4a78-9853-57a9221fdacd tempest-CreateVolumesFromSnapshotTest-1096389075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fc1a0b1-80cc-4c9a-8492-635f203e1dd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:36 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-af476d73-9255-4a78-9853-57a9221fdacd tempest-CreateVolumesFromSnapshotTest-1096389075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e89b12a-e460-47e0-b128-0dfebcb28ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:36 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-af476d73-9255-4a78-9853-57a9221fdacd tempest-CreateVolumesFromSnapshotTest-1096389075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e89b12a-e460-47e0-b128-0dfebcb28ecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1d94e02-1490-47cb-bb2c-478a83a6bf50', 'volume_name': 'volume-c1d94e02-1490-47cb-bb2c-478a83a6bf50', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:36 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-af476d73-9255-4a78-9853-57a9221fdacd tempest-CreateVolumesFromSnapshotTest-1096389075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ff1c312-3bcc-4e1a-a4e6-3b994ddadfc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:36 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-af476d73-9255-4a78-9853-57a9221fdacd tempest-CreateVolumesFromSnapshotTest-1096389075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ff1c312-3bcc-4e1a-a4e6-3b994ddadfc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:36 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-af476d73-9255-4a78-9853-57a9221fdacd tempest-CreateVolumesFromSnapshotTest-1096389075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bec7791-aa29-428b-8b53-117a6b221e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:36 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-af476d73-9255-4a78-9853-57a9221fdacd tempest-CreateVolumesFromSnapshotTest-1096389075 None] Volume c1d94e02-1490-47cb-bb2c-478a83a6bf50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1d94e02-1490-47cb-bb2c-478a83a6bf50', 'volume_size': 1}
Jul 30 20:40:36 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-af476d73-9255-4a78-9853-57a9221fdacd tempest-CreateVolumesFromSnapshotTest-1096389075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:40:36 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-e5b0a589-d51e-4aca-a355-6f6ae27a030a tempest-VolumeDependencyTests-326923044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:40:36 devstack sudo[107314]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:36 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-5c6dcd85-89ee-424b-b872-e86ae2f70a3b tempest-CreateVolumesFromImageTest-799253929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1a65807b-1dc6-4183-822c-c925dbc7e9c0" returned: 0 in 0.538s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:36 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-5c6dcd85-89ee-424b-b872-e86ae2f70a3b tempest-CreateVolumesFromImageTest-799253929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1a65807b-1dc6-4183-822c-c925dbc7e9c0 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:36 devstack sudo[107312]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:36 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-1ff17ac8-a3df-4c62-b0ee-447bae6e9cc4 tempest-CreateVolumesFromSnapshotTest-1096389075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5732cb39-eeb5-4f52-9e64-c698a128b605 1073741824" returned: 0 in 0.651s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:36 devstack sudo[107327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1a65807b-1dc6-4183-822c-c925dbc7e9c0
Jul 30 20:40:36 devstack sudo[107327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:36 devstack sudo[107315]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:36 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-aca54c50-0de1-43de-939e-3512bd414f89 tempest-VolumeAndVolumeTypeFromImageTest-776863720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_68360f71-c92a-4f20-b4ab-20a67fb6dcd4_af9lh_3c" returned: 0 in 0.463s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:36 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-aca54c50-0de1-43de-939e-3512bd414f89 tempest-VolumeAndVolumeTypeFromImageTest-776863720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_68360f71-c92a-4f20-b4ab-20a67fb6dcd4_af9lh_3c {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:36 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-1ff17ac8-a3df-4c62-b0ee-447bae6e9cc4 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5732cb39-eeb5-4f52-9e64-c698a128b605 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:36 devstack sudo[107330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5732cb39-eeb5-4f52-9e64-c698a128b605
Jul 30 20:40:36 devstack sudo[107330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:36 devstack sudo[107329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_68360f71-c92a-4f20-b4ab-20a67fb6dcd4_af9lh_3c
Jul 30 20:40:36 devstack sudo[107329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:36 devstack sudo[107327]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:36 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-5c6dcd85-89ee-424b-b872-e86ae2f70a3b tempest-CreateVolumesFromImageTest-799253929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1a65807b-1dc6-4183-822c-c925dbc7e9c0" returned: 0 in 0.267s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:36 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-5c6dcd85-89ee-424b-b872-e86ae2f70a3b tempest-CreateVolumesFromImageTest-799253929 None] Lock "cinder-quobyte-1a65807b-1dc6-4183-822c-c925dbc7e9c0" released by "delete_volume" :: held 0.860s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:40:36 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-5c6dcd85-89ee-424b-b872-e86ae2f70a3b tempest-CreateVolumesFromImageTest-799253929 None] Created reservations ['08b5f9f2-0178-4ca2-aba3-a9115c283429', '33b9ad38-fa13-4d30-a0af-ac0e41d81810', '7d1dc4b2-319a-4ceb-bb05-78f72385f165', 'b62479c7-c399-473f-ba10-38af2f873f47'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:40:36 devstack sudo[107330]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:36 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-1ff17ac8-a3df-4c62-b0ee-447bae6e9cc4 tempest-CreateVolumesFromSnapshotTest-1096389075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5732cb39-eeb5-4f52-9e64-c698a128b605" returned: 0 in 0.300s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:36 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-1ff17ac8-a3df-4c62-b0ee-447bae6e9cc4 tempest-CreateVolumesFromSnapshotTest-1096389075 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:40:36 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-1ff17ac8-a3df-4c62-b0ee-447bae6e9cc4 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:40:36 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-4813c78c-2aa9-4878-9eaa-993061173002 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.126s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:40:36 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-4813c78c-2aa9-4878-9eaa-993061173002 tempest-CreateVolumesFromSnapshotTest-1096389075 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:40:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2140766404',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=328de093-2a7f-4055-9014-3a590e46d99c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd1f96963de14944bf651afe61967374',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:40:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:40:35Z,use_quota=True,user_id='e8bf019004ba44838613267030b09257',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:40:36 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-4813c78c-2aa9-4878-9eaa-993061173002 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Creating volume 328de093-2a7f-4055-9014-3a590e46d99c {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:40:36 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-4813c78c-2aa9-4878-9eaa-993061173002 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:40:36 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-4813c78c-2aa9-4878-9eaa-993061173002 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:40:36 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-4813c78c-2aa9-4878-9eaa-993061173002 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:40:36 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-4813c78c-2aa9-4878-9eaa-993061173002 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:40:36 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-4813c78c-2aa9-4878-9eaa-993061173002 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:40:36 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-4813c78c-2aa9-4878-9eaa-993061173002 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:40:36 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-4813c78c-2aa9-4878-9eaa-993061173002 tempest-CreateVolumesFromSnapshotTest-1096389075 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:40:36 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-4813c78c-2aa9-4878-9eaa-993061173002 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-328de093-2a7f-4055-9014-3a590e46d99c 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:36 devstack sudo[107329]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:36 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-aca54c50-0de1-43de-939e-3512bd414f89 tempest-VolumeAndVolumeTypeFromImageTest-776863720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_68360f71-c92a-4f20-b4ab-20a67fb6dcd4_af9lh_3c" returned: 1 in 0.396s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:36 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-aca54c50-0de1-43de-939e-3512bd414f89 tempest-VolumeAndVolumeTypeFromImageTest-776863720 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_68360f71-c92a-4f20-b4ab-20a67fb6dcd4_af9lh_3c' failed. Not Retrying. {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 30 20:40:37 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[4126e136-6b39-4904-8b8b-cdd6bee96ece]: (4, 'raw') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:40:37 devstack sudo[107337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-328de093-2a7f-4055-9014-3a590e46d99c 1073741824
Jul 30 20:40:37 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-1ff17ac8-a3df-4c62-b0ee-447bae6e9cc4 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a047c4ca-325f-43c6-9d02-a6ba2a336110) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5732cb39-eeb5-4f52-9e64-c698a128b605', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:37 devstack sudo[107337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:37 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-1ff17ac8-a3df-4c62-b0ee-447bae6e9cc4 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d720d5c-90b0-414a-b0fa-19aa09dacd46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:37 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-aca54c50-0de1-43de-939e-3512bd414f89 tempest-VolumeAndVolumeTypeFromImageTest-776863720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_68360f71-c92a-4f20-b4ab-20a67fb6dcd4_mlw76xufdevstack@QuobyteHD {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:37 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-1ff17ac8-a3df-4c62-b0ee-447bae6e9cc4 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Volume volume-5732cb39-eeb5-4f52-9e64-c698a128b605 (5732cb39-eeb5-4f52-9e64-c698a128b605): created successfully
Jul 30 20:40:37 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-1ff17ac8-a3df-4c62-b0ee-447bae6e9cc4 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d720d5c-90b0-414a-b0fa-19aa09dacd46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:37 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-1ff17ac8-a3df-4c62-b0ee-447bae6e9cc4 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Flow 'volume_create_manager' (100bf316-c55c-440f-a641-eda9776d7c24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:40:37 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-5c6dcd85-89ee-424b-b872-e86ae2f70a3b tempest-CreateVolumesFromImageTest-799253929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:40:37 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-5c6dcd85-89ee-424b-b872-e86ae2f70a3b tempest-CreateVolumesFromImageTest-799253929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:40:37 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-5c6dcd85-89ee-424b-b872-e86ae2f70a3b tempest-CreateVolumesFromImageTest-799253929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:40:37 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-5c6dcd85-89ee-424b-b872-e86ae2f70a3b tempest-CreateVolumesFromImageTest-799253929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:40:37 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-5c6dcd85-89ee-424b-b872-e86ae2f70a3b tempest-CreateVolumesFromImageTest-799253929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:40:37 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-5c6dcd85-89ee-424b-b872-e86ae2f70a3b tempest-CreateVolumesFromImageTest-799253929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:37 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-4ae9dd7a-60e3-4521-a944-f23f47023bbb tempest-CreateVolumesFromImageTest-799253929 None] Acquiring lock "cinder-1766edab-1aa4-48c2-be6d-a33ed85fe7ba-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:40:37 devstack sudo[107340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:40:37 devstack sudo[107340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:37 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-1ff17ac8-a3df-4c62-b0ee-447bae6e9cc4 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Created volume successfully.
Jul 30 20:40:37 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-4ae9dd7a-60e3-4521-a944-f23f47023bbb tempest-CreateVolumesFromImageTest-799253929 None] Lock "cinder-1766edab-1aa4-48c2-be6d-a33ed85fe7ba-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:40:37 devstack sudo[107339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_68360f71-c92a-4f20-b4ab-20a67fb6dcd4_mlw76xufdevstack@QuobyteHD
Jul 30 20:40:37 devstack sudo[107339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:37 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-4ae9dd7a-60e3-4521-a944-f23f47023bbb tempest-CreateVolumesFromImageTest-799253929 None] Acquiring lock "cinder-quobyte-1766edab-1aa4-48c2-be6d-a33ed85fe7ba" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:40:37 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-4ae9dd7a-60e3-4521-a944-f23f47023bbb tempest-CreateVolumesFromImageTest-799253929 None] Lock "cinder-quobyte-1766edab-1aa4-48c2-be6d-a33ed85fe7ba" acquired by "delete_volume" :: waited 0.020s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:40:37 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f4a2b6a-20ff-4faf-8be3-066f8099b0ff]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:40:37 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-4ae9dd7a-60e3-4521-a944-f23f47023bbb tempest-CreateVolumesFromImageTest-799253929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1766edab-1aa4-48c2-be6d-a33ed85fe7ba {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:37 devstack sudo[107343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1766edab-1aa4-48c2-be6d-a33ed85fe7ba
Jul 30 20:40:37 devstack sudo[107343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:37 devstack sudo[107340]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:37 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-5c6dcd85-89ee-424b-b872-e86ae2f70a3b tempest-CreateVolumesFromImageTest-799253929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.313s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:37 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-5c6dcd85-89ee-424b-b872-e86ae2f70a3b tempest-CreateVolumesFromImageTest-799253929 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:40:37 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-5c6dcd85-89ee-424b-b872-e86ae2f70a3b tempest-CreateVolumesFromImageTest-799253929 None] Deleted volume successfully.
Jul 30 20:40:37 devstack sudo[107339]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:37 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-aca54c50-0de1-43de-939e-3512bd414f89 tempest-VolumeAndVolumeTypeFromImageTest-776863720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_68360f71-c92a-4f20-b4ab-20a67fb6dcd4_mlw76xufdevstack@QuobyteHD" returned: 0 in 0.404s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:37 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-aca54c50-0de1-43de-939e-3512bd414f89 tempest-VolumeAndVolumeTypeFromImageTest-776863720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_68360f71-c92a-4f20-b4ab-20a67fb6dcd4_mlw76xufdevstack@QuobyteHD {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:37 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-5c6dcd85-89ee-424b-b872-e86ae2f70a3b tempest-CreateVolumesFromImageTest-799253929 None] Lock "cinder-1a65807b-1dc6-4183-822c-c925dbc7e9c0-delete_volume" released by "delete_volume" :: held 1.628s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:40:37 devstack sudo[107351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_68360f71-c92a-4f20-b4ab-20a67fb6dcd4_mlw76xufdevstack@QuobyteHD
Jul 30 20:40:37 devstack sudo[107351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:37 devstack sudo[107337]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:37 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-4813c78c-2aa9-4878-9eaa-993061173002 tempest-CreateVolumesFromSnapshotTest-1096389075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-328de093-2a7f-4055-9014-3a590e46d99c 1073741824" returned: 0 in 0.623s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:37 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-4813c78c-2aa9-4878-9eaa-993061173002 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-328de093-2a7f-4055-9014-3a590e46d99c {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:37 devstack sudo[107343]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:37 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-4ae9dd7a-60e3-4521-a944-f23f47023bbb tempest-CreateVolumesFromImageTest-799253929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1766edab-1aa4-48c2-be6d-a33ed85fe7ba" returned: 0 in 0.419s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:37 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-4ae9dd7a-60e3-4521-a944-f23f47023bbb tempest-CreateVolumesFromImageTest-799253929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1766edab-1aa4-48c2-be6d-a33ed85fe7ba {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:37 devstack sudo[107357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-328de093-2a7f-4055-9014-3a590e46d99c
Jul 30 20:40:37 devstack sudo[107357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:37 devstack sudo[107359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1766edab-1aa4-48c2-be6d-a33ed85fe7ba
Jul 30 20:40:37 devstack sudo[107359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:37 devstack sudo[107351]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:37 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-aca54c50-0de1-43de-939e-3512bd414f89 tempest-VolumeAndVolumeTypeFromImageTest-776863720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_68360f71-c92a-4f20-b4ab-20a67fb6dcd4_mlw76xufdevstack@QuobyteHD" returned: 1 in 0.394s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:37 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-aca54c50-0de1-43de-939e-3512bd414f89 tempest-VolumeAndVolumeTypeFromImageTest-776863720 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_68360f71-c92a-4f20-b4ab-20a67fb6dcd4_mlw76xufdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 30 20:40:37 devstack cinder-volume[88719]: DEBUG cinder.image.image_utils [None req-aca54c50-0de1-43de-939e-3512bd414f89 tempest-VolumeAndVolumeTypeFromImageTest-776863720 None] 68360f71-c92a-4f20-b4ab-20a67fb6dcd4 was raw, converting to qcow2 {{(pid=88719) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 30 20:40:37 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-aca54c50-0de1-43de-939e-3512bd414f89 tempest-VolumeAndVolumeTypeFromImageTest-776863720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_68360f71-c92a-4f20-b4ab-20a67fb6dcd4_mlw76xufdevstack@QuobyteHD /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-66f15175-b846-4cef-ad55-04e653dbbb52 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:37 devstack sudo[107366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_68360f71-c92a-4f20-b4ab-20a67fb6dcd4_mlw76xufdevstack@QuobyteHD /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-66f15175-b846-4cef-ad55-04e653dbbb52
Jul 30 20:40:37 devstack sudo[107366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:37 devstack sudo[107357]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:37 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-4813c78c-2aa9-4878-9eaa-993061173002 tempest-CreateVolumesFromSnapshotTest-1096389075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-328de093-2a7f-4055-9014-3a590e46d99c" returned: 0 in 0.258s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:37 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-4813c78c-2aa9-4878-9eaa-993061173002 tempest-CreateVolumesFromSnapshotTest-1096389075 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:40:37 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-4813c78c-2aa9-4878-9eaa-993061173002 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:40:37 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-110d01f9-63f4-4a87-91dc-269c62d52e74 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.553s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:40:37 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-110d01f9-63f4-4a87-91dc-269c62d52e74 tempest-CreateVolumesFromSnapshotTest-1096389075 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:40:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1593976045',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92c736cc-7160-48f0-b763-19afc3d07080,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd1f96963de14944bf651afe61967374',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:40:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:40:35Z,use_quota=True,user_id='e8bf019004ba44838613267030b09257',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:40:37 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-110d01f9-63f4-4a87-91dc-269c62d52e74 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Creating volume 92c736cc-7160-48f0-b763-19afc3d07080 {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:40:37 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-110d01f9-63f4-4a87-91dc-269c62d52e74 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:40:37 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-110d01f9-63f4-4a87-91dc-269c62d52e74 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:40:37 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-110d01f9-63f4-4a87-91dc-269c62d52e74 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:40:37 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-110d01f9-63f4-4a87-91dc-269c62d52e74 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:40:37 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-110d01f9-63f4-4a87-91dc-269c62d52e74 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:40:37 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-110d01f9-63f4-4a87-91dc-269c62d52e74 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:40:37 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-110d01f9-63f4-4a87-91dc-269c62d52e74 tempest-CreateVolumesFromSnapshotTest-1096389075 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:40:37 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-110d01f9-63f4-4a87-91dc-269c62d52e74 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-92c736cc-7160-48f0-b763-19afc3d07080 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:37 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-4813c78c-2aa9-4878-9eaa-993061173002 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05a677a2-73b6-4062-9b64-990aec5a097d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-328de093-2a7f-4055-9014-3a590e46d99c', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:37 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-4813c78c-2aa9-4878-9eaa-993061173002 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67f17b8c-ae4d-47c9-aa88-08465ee872ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:37 devstack sudo[107370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-92c736cc-7160-48f0-b763-19afc3d07080 1073741824
Jul 30 20:40:37 devstack sudo[107370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:37 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-4813c78c-2aa9-4878-9eaa-993061173002 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Volume volume-328de093-2a7f-4055-9014-3a590e46d99c (328de093-2a7f-4055-9014-3a590e46d99c): created successfully
Jul 30 20:40:37 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-4813c78c-2aa9-4878-9eaa-993061173002 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67f17b8c-ae4d-47c9-aa88-08465ee872ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:37 devstack sudo[107359]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:37 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-4813c78c-2aa9-4878-9eaa-993061173002 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Flow 'volume_create_manager' (6821549a-05bb-4dbe-8f39-b3708d3a6747) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:40:37 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-4ae9dd7a-60e3-4521-a944-f23f47023bbb tempest-CreateVolumesFromImageTest-799253929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1766edab-1aa4-48c2-be6d-a33ed85fe7ba" returned: 0 in 0.304s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:37 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-4ae9dd7a-60e3-4521-a944-f23f47023bbb tempest-CreateVolumesFromImageTest-799253929 None] Lock "cinder-quobyte-1766edab-1aa4-48c2-be6d-a33ed85fe7ba" released by "delete_volume" :: held 0.772s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:40:37 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-4813c78c-2aa9-4878-9eaa-993061173002 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Created volume successfully.
Jul 30 20:40:38 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-4ae9dd7a-60e3-4521-a944-f23f47023bbb tempest-CreateVolumesFromImageTest-799253929 None] Created reservations ['0f954669-75d0-4379-93d8-a1f2cd9336a0', 'a9592f01-749f-4f8a-856e-ddaf81e87d34', '0f0fa612-cc81-4745-8886-c54f9dfd8cfd', 'edec191f-8bbe-4f27-b3e3-5055a470f2b0'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:40:38 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-4ae9dd7a-60e3-4521-a944-f23f47023bbb tempest-CreateVolumesFromImageTest-799253929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:40:38 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-4ae9dd7a-60e3-4521-a944-f23f47023bbb tempest-CreateVolumesFromImageTest-799253929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:40:38 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-4ae9dd7a-60e3-4521-a944-f23f47023bbb tempest-CreateVolumesFromImageTest-799253929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:40:38 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-4ae9dd7a-60e3-4521-a944-f23f47023bbb tempest-CreateVolumesFromImageTest-799253929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:40:38 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-4ae9dd7a-60e3-4521-a944-f23f47023bbb tempest-CreateVolumesFromImageTest-799253929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:40:38 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-4ae9dd7a-60e3-4521-a944-f23f47023bbb tempest-CreateVolumesFromImageTest-799253929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:38 devstack sudo[107375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:40:38 devstack sudo[107375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:38 devstack sudo[107366]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:38 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-aca54c50-0de1-43de-939e-3512bd414f89 tempest-VolumeAndVolumeTypeFromImageTest-776863720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_68360f71-c92a-4f20-b4ab-20a67fb6dcd4_mlw76xufdevstack@QuobyteHD /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-66f15175-b846-4cef-ad55-04e653dbbb52" returned: 0 in 0.617s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:38 devstack cinder-volume[88719]: DEBUG cinder.image.image_utils [None req-aca54c50-0de1-43de-939e-3512bd414f89 tempest-VolumeAndVolumeTypeFromImageTest-776863720 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_68360f71-c92a-4f20-b4ab-20a67fb6dcd4_mlw76xufdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-66f15175-b846-4cef-ad55-04e653dbbb52 {{(pid=88719) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 30 20:40:38 devstack cinder-volume[88719]: INFO cinder.image.image_utils [None req-aca54c50-0de1-43de-939e-3512bd414f89 tempest-VolumeAndVolumeTypeFromImageTest-776863720 None] Converted 0.00 MB image at 0.00 MB/s
Jul 30 20:40:38 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-aca54c50-0de1-43de-939e-3512bd414f89 tempest-VolumeAndVolumeTypeFromImageTest-776863720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-66f15175-b846-4cef-ad55-04e653dbbb52 1G {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:38 devstack sudo[107375]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:38 devstack sudo[107382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-66f15175-b846-4cef-ad55-04e653dbbb52 1G
Jul 30 20:40:38 devstack sudo[107382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:38 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-4ae9dd7a-60e3-4521-a944-f23f47023bbb tempest-CreateVolumesFromImageTest-799253929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.337s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:38 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-4ae9dd7a-60e3-4521-a944-f23f47023bbb tempest-CreateVolumesFromImageTest-799253929 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:40:38 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-4ae9dd7a-60e3-4521-a944-f23f47023bbb tempest-CreateVolumesFromImageTest-799253929 None] Deleted volume successfully.
Jul 30 20:40:38 devstack sudo[107370]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:38 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-110d01f9-63f4-4a87-91dc-269c62d52e74 tempest-CreateVolumesFromSnapshotTest-1096389075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-92c736cc-7160-48f0-b763-19afc3d07080 1073741824" returned: 0 in 0.604s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:38 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-4ae9dd7a-60e3-4521-a944-f23f47023bbb tempest-CreateVolumesFromImageTest-799253929 None] Lock "cinder-1766edab-1aa4-48c2-be6d-a33ed85fe7ba-delete_volume" released by "delete_volume" :: held 1.393s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:40:38 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-110d01f9-63f4-4a87-91dc-269c62d52e74 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-92c736cc-7160-48f0-b763-19afc3d07080 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:38 devstack sudo[107384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-92c736cc-7160-48f0-b763-19afc3d07080
Jul 30 20:40:38 devstack sudo[107384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:38 devstack sudo[107384]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:38 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-110d01f9-63f4-4a87-91dc-269c62d52e74 tempest-CreateVolumesFromSnapshotTest-1096389075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-92c736cc-7160-48f0-b763-19afc3d07080" returned: 0 in 0.264s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:38 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-110d01f9-63f4-4a87-91dc-269c62d52e74 tempest-CreateVolumesFromSnapshotTest-1096389075 None] <== create_volume: return (922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:40:38 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-110d01f9-63f4-4a87-91dc-269c62d52e74 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:40:38 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-31697e85-b705-44a1-a7b1-3389c71f86a3 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.482s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:40:38 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-31697e85-b705-44a1-a7b1-3389c71f86a3 tempest-CreateVolumesFromSnapshotTest-1096389075 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:40:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1465685240',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46f56366-c53c-4d7f-8c1c-a22b2209b9ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd1f96963de14944bf651afe61967374',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:40:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:40:36Z,use_quota=True,user_id='e8bf019004ba44838613267030b09257',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:40:38 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-31697e85-b705-44a1-a7b1-3389c71f86a3 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Creating volume 46f56366-c53c-4d7f-8c1c-a22b2209b9ba {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:40:38 devstack sudo[107382]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:38 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-31697e85-b705-44a1-a7b1-3389c71f86a3 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:40:38 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-31697e85-b705-44a1-a7b1-3389c71f86a3 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:40:38 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-31697e85-b705-44a1-a7b1-3389c71f86a3 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:40:38 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-31697e85-b705-44a1-a7b1-3389c71f86a3 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:40:38 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-31697e85-b705-44a1-a7b1-3389c71f86a3 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:40:38 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-31697e85-b705-44a1-a7b1-3389c71f86a3 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:40:38 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-31697e85-b705-44a1-a7b1-3389c71f86a3 tempest-CreateVolumesFromSnapshotTest-1096389075 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:40:38 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-31697e85-b705-44a1-a7b1-3389c71f86a3 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-46f56366-c53c-4d7f-8c1c-a22b2209b9ba 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:38 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-aca54c50-0de1-43de-939e-3512bd414f89 tempest-VolumeAndVolumeTypeFromImageTest-776863720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-66f15175-b846-4cef-ad55-04e653dbbb52 1G" returned: 0 in 0.412s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:38 devstack cinder-volume[88719]: DEBUG cinder.volume.volume_utils [None req-aca54c50-0de1-43de-939e-3512bd414f89 tempest-VolumeAndVolumeTypeFromImageTest-776863720 None] Downloaded image 68360f71-c92a-4f20-b4ab-20a67fb6dcd4 ((None, [{'url': 'file:///opt/stack/data/glance/images/68360f71-c92a-4f20-b4ab-20a67fb6dcd4', 'metadata': {}}])) to volume 66f15175-b846-4cef-ad55-04e653dbbb52 successfully. {{(pid=88719) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 30 20:40:38 devstack cinder-volume[88719]: DEBUG cinder.image.image_utils [None req-aca54c50-0de1-43de-939e-3512bd414f89 tempest-VolumeAndVolumeTypeFromImageTest-776863720 None] Temporary image 68360f71-c92a-4f20-b4ab-20a67fb6dcd4 for user 2a150087093c4d9e9c8fbde65dd7526b is deleted. {{(pid=88719) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 30 20:40:38 devstack cinder-volume[88719]: DEBUG cinder.volume.volume_utils [None req-aca54c50-0de1-43de-939e-3512bd414f89 tempest-VolumeAndVolumeTypeFromImageTest-776863720 None] Marking volume 66f15175-b846-4cef-ad55-04e653dbbb52 as bootable. {{(pid=88719) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 30 20:40:38 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-110d01f9-63f4-4a87-91dc-269c62d52e74 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a12f4f41-2ab3-429d-a842-703e7c769604) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92c736cc-7160-48f0-b763-19afc3d07080', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:38 devstack sudo[107391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-46f56366-c53c-4d7f-8c1c-a22b2209b9ba 1073741824
Jul 30 20:40:38 devstack sudo[107391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:38 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-110d01f9-63f4-4a87-91dc-269c62d52e74 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a978b487-9145-4ff9-9ea8-25f6c90a55b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:38 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-aca54c50-0de1-43de-939e-3512bd414f89 tempest-VolumeAndVolumeTypeFromImageTest-776863720 None] Copying metadata from image 68360f71-c92a-4f20-b4ab-20a67fb6dcd4 to 66f15175-b846-4cef-ad55-04e653dbbb52. {{(pid=88719) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 30 20:40:38 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-aca54c50-0de1-43de-939e-3512bd414f89 tempest-VolumeAndVolumeTypeFromImageTest-776863720 None] Creating volume glance metadata for volume 66f15175-b846-4cef-ad55-04e653dbbb52 backed by image 68360f71-c92a-4f20-b4ab-20a67fb6dcd4 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '68360f71-c92a-4f20-b4ab-20a67fb6dcd4', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'be7a58dd27e8b83dc62d4c065b870224', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88719) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 30 20:40:38 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-110d01f9-63f4-4a87-91dc-269c62d52e74 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Volume volume-92c736cc-7160-48f0-b763-19afc3d07080 (92c736cc-7160-48f0-b763-19afc3d07080): created successfully
Jul 30 20:40:38 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-110d01f9-63f4-4a87-91dc-269c62d52e74 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a978b487-9145-4ff9-9ea8-25f6c90a55b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:38 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-110d01f9-63f4-4a87-91dc-269c62d52e74 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Flow 'volume_create_manager' (df1b42e3-6218-413c-9ada-dbb0a44e0d31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:40:38 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-110d01f9-63f4-4a87-91dc-269c62d52e74 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Created volume successfully.
Jul 30 20:40:38 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-aca54c50-0de1-43de-939e-3512bd414f89 tempest-VolumeAndVolumeTypeFromImageTest-776863720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17206fc4-b1aa-417d-9ead-9c50ad28fad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66f15175-b846-4cef-ad55-04e653dbbb52', 'volume_size': 1, 'image_id': '68360f71-c92a-4f20-b4ab-20a67fb6dcd4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/68360f71-c92a-4f20-b4ab-20a67fb6dcd4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'be7a58dd27e8b83dc62d4c065b870224', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '264ff733820c4646961c042ae4a9f05c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3f0ccef9aa89f0fb3c1d3b22088817af8e182008cf9a551f5e9ad5d0a4c4d8e0cec803dfe13ee37941adeb2369290ee8d1cd4b147a85851610a6568ff103c3f1', 'id': '68360f71-c92a-4f20-b4ab-20a67fb6dcd4', 'created_at': datetime.datetime(2026, 7, 30, 18, 40, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 18, 40, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/68360f71-c92a-4f20-b4ab-20a67fb6dcd4/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x78687a45abd0>}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:38 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-aca54c50-0de1-43de-939e-3512bd414f89 tempest-VolumeAndVolumeTypeFromImageTest-776863720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb6521b2-5fee-41ab-9fbe-66c701d6b1ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:39 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-aca54c50-0de1-43de-939e-3512bd414f89 tempest-VolumeAndVolumeTypeFromImageTest-776863720 None] Volume volume-66f15175-b846-4cef-ad55-04e653dbbb52 (66f15175-b846-4cef-ad55-04e653dbbb52): created successfully
Jul 30 20:40:39 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-aca54c50-0de1-43de-939e-3512bd414f89 tempest-VolumeAndVolumeTypeFromImageTest-776863720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb6521b2-5fee-41ab-9fbe-66c701d6b1ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:39 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-aca54c50-0de1-43de-939e-3512bd414f89 tempest-VolumeAndVolumeTypeFromImageTest-776863720 None] Flow 'volume_create_manager' (3ccfbac0-ae96-450b-9f2f-907ebf88f266) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:40:39 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-aca54c50-0de1-43de-939e-3512bd414f89 tempest-VolumeAndVolumeTypeFromImageTest-776863720 None] Created volume successfully.
Jul 30 20:40:39 devstack sudo[107391]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:39 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-31697e85-b705-44a1-a7b1-3389c71f86a3 tempest-CreateVolumesFromSnapshotTest-1096389075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-46f56366-c53c-4d7f-8c1c-a22b2209b9ba 1073741824" returned: 0 in 0.505s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:39 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-31697e85-b705-44a1-a7b1-3389c71f86a3 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-46f56366-c53c-4d7f-8c1c-a22b2209b9ba {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:39 devstack sudo[107398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-46f56366-c53c-4d7f-8c1c-a22b2209b9ba
Jul 30 20:40:39 devstack sudo[107398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:39 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-3c7ceb84-5531-4a41-8ce5-5d8812c80607 tempest-VolumeAndVolumeTypeFromImageTest-776863720 None] Acquiring lock "cinder-66f15175-b846-4cef-ad55-04e653dbbb52-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:40:39 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-3c7ceb84-5531-4a41-8ce5-5d8812c80607 tempest-VolumeAndVolumeTypeFromImageTest-776863720 None] Lock "cinder-66f15175-b846-4cef-ad55-04e653dbbb52-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:40:39 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-3c7ceb84-5531-4a41-8ce5-5d8812c80607 tempest-VolumeAndVolumeTypeFromImageTest-776863720 None] Acquiring lock "cinder-quobyte-66f15175-b846-4cef-ad55-04e653dbbb52" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:40:39 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-3c7ceb84-5531-4a41-8ce5-5d8812c80607 tempest-VolumeAndVolumeTypeFromImageTest-776863720 None] Lock "cinder-quobyte-66f15175-b846-4cef-ad55-04e653dbbb52" acquired by "delete_volume" :: waited 0.021s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:40:39 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7308d68-50b3-4978-aaef-33b90bb12a49]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:40:39 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3c7ceb84-5531-4a41-8ce5-5d8812c80607 tempest-VolumeAndVolumeTypeFromImageTest-776863720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-66f15175-b846-4cef-ad55-04e653dbbb52 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:39 devstack sudo[107398]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:39 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-31697e85-b705-44a1-a7b1-3389c71f86a3 tempest-CreateVolumesFromSnapshotTest-1096389075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-46f56366-c53c-4d7f-8c1c-a22b2209b9ba" returned: 0 in 0.337s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:39 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-31697e85-b705-44a1-a7b1-3389c71f86a3 tempest-CreateVolumesFromSnapshotTest-1096389075 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:40:39 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-31697e85-b705-44a1-a7b1-3389c71f86a3 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:40:39 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-af476d73-9255-4a78-9853-57a9221fdacd tempest-CreateVolumesFromSnapshotTest-1096389075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.204s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:40:39 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-af476d73-9255-4a78-9853-57a9221fdacd tempest-CreateVolumesFromSnapshotTest-1096389075 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:40:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-336376985',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1d94e02-1490-47cb-bb2c-478a83a6bf50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd1f96963de14944bf651afe61967374',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:40:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:40:36Z,use_quota=True,user_id='e8bf019004ba44838613267030b09257',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:40:39 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-af476d73-9255-4a78-9853-57a9221fdacd tempest-CreateVolumesFromSnapshotTest-1096389075 None] Creating volume c1d94e02-1490-47cb-bb2c-478a83a6bf50 {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:40:39 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-af476d73-9255-4a78-9853-57a9221fdacd tempest-CreateVolumesFromSnapshotTest-1096389075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:40:39 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-af476d73-9255-4a78-9853-57a9221fdacd tempest-CreateVolumesFromSnapshotTest-1096389075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:40:39 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-af476d73-9255-4a78-9853-57a9221fdacd tempest-CreateVolumesFromSnapshotTest-1096389075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:40:39 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-af476d73-9255-4a78-9853-57a9221fdacd tempest-CreateVolumesFromSnapshotTest-1096389075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:40:39 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-af476d73-9255-4a78-9853-57a9221fdacd tempest-CreateVolumesFromSnapshotTest-1096389075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:40:39 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-af476d73-9255-4a78-9853-57a9221fdacd tempest-CreateVolumesFromSnapshotTest-1096389075 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:40:39 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-af476d73-9255-4a78-9853-57a9221fdacd tempest-CreateVolumesFromSnapshotTest-1096389075 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:40:39 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-af476d73-9255-4a78-9853-57a9221fdacd tempest-CreateVolumesFromSnapshotTest-1096389075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c1d94e02-1490-47cb-bb2c-478a83a6bf50 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:39 devstack sudo[107400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-66f15175-b846-4cef-ad55-04e653dbbb52
Jul 30 20:40:39 devstack sudo[107400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:39 devstack sudo[107402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c1d94e02-1490-47cb-bb2c-478a83a6bf50 1073741824
Jul 30 20:40:39 devstack sudo[107402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:39 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-31697e85-b705-44a1-a7b1-3389c71f86a3 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d162d54e-d32e-41f4-bd30-1ddfafa5b48e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46f56366-c53c-4d7f-8c1c-a22b2209b9ba', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:39 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-31697e85-b705-44a1-a7b1-3389c71f86a3 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23ce135d-940b-4e89-bb4c-2f69e37f2005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:39 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-31697e85-b705-44a1-a7b1-3389c71f86a3 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Volume volume-46f56366-c53c-4d7f-8c1c-a22b2209b9ba (46f56366-c53c-4d7f-8c1c-a22b2209b9ba): created successfully
Jul 30 20:40:39 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-31697e85-b705-44a1-a7b1-3389c71f86a3 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23ce135d-940b-4e89-bb4c-2f69e37f2005) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:39 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-31697e85-b705-44a1-a7b1-3389c71f86a3 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Flow 'volume_create_manager' (d9db64f2-89a9-406d-9fc1-86ee65cca143) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:40:39 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-31697e85-b705-44a1-a7b1-3389c71f86a3 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Created volume successfully.
Jul 30 20:40:40 devstack sudo[107400]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:40 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3c7ceb84-5531-4a41-8ce5-5d8812c80607 tempest-VolumeAndVolumeTypeFromImageTest-776863720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-66f15175-b846-4cef-ad55-04e653dbbb52" returned: 0 in 0.418s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:40 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3c7ceb84-5531-4a41-8ce5-5d8812c80607 tempest-VolumeAndVolumeTypeFromImageTest-776863720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-66f15175-b846-4cef-ad55-04e653dbbb52 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:40 devstack sudo[107411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-66f15175-b846-4cef-ad55-04e653dbbb52
Jul 30 20:40:40 devstack sudo[107411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:40 devstack sudo[107402]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:40 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-af476d73-9255-4a78-9853-57a9221fdacd tempest-CreateVolumesFromSnapshotTest-1096389075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c1d94e02-1490-47cb-bb2c-478a83a6bf50 1073741824" returned: 0 in 0.482s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:40 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-af476d73-9255-4a78-9853-57a9221fdacd tempest-CreateVolumesFromSnapshotTest-1096389075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c1d94e02-1490-47cb-bb2c-478a83a6bf50 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:40 devstack sudo[107414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c1d94e02-1490-47cb-bb2c-478a83a6bf50
Jul 30 20:40:40 devstack sudo[107414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:40 devstack sudo[107411]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:40 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3c7ceb84-5531-4a41-8ce5-5d8812c80607 tempest-VolumeAndVolumeTypeFromImageTest-776863720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-66f15175-b846-4cef-ad55-04e653dbbb52" returned: 0 in 0.269s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:40 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-3c7ceb84-5531-4a41-8ce5-5d8812c80607 tempest-VolumeAndVolumeTypeFromImageTest-776863720 None] Lock "cinder-quobyte-66f15175-b846-4cef-ad55-04e653dbbb52" released by "delete_volume" :: held 0.745s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:40:40 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-3c7ceb84-5531-4a41-8ce5-5d8812c80607 tempest-VolumeAndVolumeTypeFromImageTest-776863720 None] Created reservations ['2e2f921f-8c3d-4948-9f03-0a9b629a3c68', '5411e262-0324-4dab-bc25-99be69ac4e18', 'fec003fc-481d-4e22-9380-ce286ba78f19', '3d11d388-0d48-4657-b2ad-c891076944a4'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:40:40 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-3c7ceb84-5531-4a41-8ce5-5d8812c80607 tempest-VolumeAndVolumeTypeFromImageTest-776863720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:40:40 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-3c7ceb84-5531-4a41-8ce5-5d8812c80607 tempest-VolumeAndVolumeTypeFromImageTest-776863720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:40:40 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-3c7ceb84-5531-4a41-8ce5-5d8812c80607 tempest-VolumeAndVolumeTypeFromImageTest-776863720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:40:40 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-3c7ceb84-5531-4a41-8ce5-5d8812c80607 tempest-VolumeAndVolumeTypeFromImageTest-776863720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:40:40 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-3c7ceb84-5531-4a41-8ce5-5d8812c80607 tempest-VolumeAndVolumeTypeFromImageTest-776863720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:40:40 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3c7ceb84-5531-4a41-8ce5-5d8812c80607 tempest-VolumeAndVolumeTypeFromImageTest-776863720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:40 devstack sudo[107414]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:40 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-af476d73-9255-4a78-9853-57a9221fdacd tempest-CreateVolumesFromSnapshotTest-1096389075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c1d94e02-1490-47cb-bb2c-478a83a6bf50" returned: 0 in 0.290s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:40 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-af476d73-9255-4a78-9853-57a9221fdacd tempest-CreateVolumesFromSnapshotTest-1096389075 None] <== create_volume: return (815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:40:40 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-af476d73-9255-4a78-9853-57a9221fdacd tempest-CreateVolumesFromSnapshotTest-1096389075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.821s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:40:40 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-e5b0a589-d51e-4aca-a355-6f6ae27a030a tempest-VolumeDependencyTests-326923044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.024s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:40:40 devstack sudo[107418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:40:40 devstack sudo[107418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:40 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-e5b0a589-d51e-4aca-a355-6f6ae27a030a tempest-VolumeDependencyTests-326923044 None] Acquiring lock "cinder-quobyte-bb8f3fc7-a73c-4aea-abff-bdafe21b7b32-d87c1db1-cf52-4da0-a840-6fc53223e94f" by "_create_volume_from_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:40:40 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-af476d73-9255-4a78-9853-57a9221fdacd tempest-CreateVolumesFromSnapshotTest-1096389075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bec7791-aa29-428b-8b53-117a6b221e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1d94e02-1490-47cb-bb2c-478a83a6bf50', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:40 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-af476d73-9255-4a78-9853-57a9221fdacd tempest-CreateVolumesFromSnapshotTest-1096389075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3573bbdd-a47f-4a70-bcef-9421983b18a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:40 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-e5b0a589-d51e-4aca-a355-6f6ae27a030a tempest-VolumeDependencyTests-326923044 None] Lock "cinder-quobyte-bb8f3fc7-a73c-4aea-abff-bdafe21b7b32-d87c1db1-cf52-4da0-a840-6fc53223e94f" acquired by "_create_volume_from_snapshot" :: waited 0.035s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:40:40 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-e5b0a589-d51e-4aca-a355-6f6ae27a030a tempest-VolumeDependencyTests-326923044 None] Creating volume d87c1db1-cf52-4da0-a840-6fc53223e94f from snapshot bb8f3fc7-a73c-4aea-abff-bdafe21b7b32 {{(pid=88719) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Jul 30 20:40:40 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-e5b0a589-d51e-4aca-a355-6f6ae27a030a tempest-VolumeDependencyTests-326923044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:40:40 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-e5b0a589-d51e-4aca-a355-6f6ae27a030a tempest-VolumeDependencyTests-326923044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:40:40 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-e5b0a589-d51e-4aca-a355-6f6ae27a030a tempest-VolumeDependencyTests-326923044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:40:40 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-e5b0a589-d51e-4aca-a355-6f6ae27a030a tempest-VolumeDependencyTests-326923044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:40:40 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-e5b0a589-d51e-4aca-a355-6f6ae27a030a tempest-VolumeDependencyTests-326923044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:40:40 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-e5b0a589-d51e-4aca-a355-6f6ae27a030a tempest-VolumeDependencyTests-326923044 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:40:40 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-e5b0a589-d51e-4aca-a355-6f6ae27a030a tempest-VolumeDependencyTests-326923044 None] Acquiring lock "cinder-quobyte-d87c1db1-cf52-4da0-a840-6fc53223e94f" by "_copy_volume_from_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:40:40 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-af476d73-9255-4a78-9853-57a9221fdacd tempest-CreateVolumesFromSnapshotTest-1096389075 None] Volume volume-c1d94e02-1490-47cb-bb2c-478a83a6bf50 (c1d94e02-1490-47cb-bb2c-478a83a6bf50): created successfully
Jul 30 20:40:40 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-af476d73-9255-4a78-9853-57a9221fdacd tempest-CreateVolumesFromSnapshotTest-1096389075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3573bbdd-a47f-4a70-bcef-9421983b18a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:40 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-af476d73-9255-4a78-9853-57a9221fdacd tempest-CreateVolumesFromSnapshotTest-1096389075 None] Flow 'volume_create_manager' (cd5a30e2-21c3-4478-ab3b-9b296f8cf9a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:40:40 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-e5b0a589-d51e-4aca-a355-6f6ae27a030a tempest-VolumeDependencyTests-326923044 None] Lock "cinder-quobyte-d87c1db1-cf52-4da0-a840-6fc53223e94f" acquired by "_copy_volume_from_snapshot" :: waited 0.046s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:40:40 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-e5b0a589-d51e-4aca-a355-6f6ae27a030a tempest-VolumeDependencyTests-326923044 None] snapshot: bb8f3fc7-a73c-4aea-abff-bdafe21b7b32, volume: d87c1db1-cf52-4da0-a840-6fc53223e94f,  {{(pid=88719) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}}
Jul 30 20:40:40 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-af476d73-9255-4a78-9853-57a9221fdacd tempest-CreateVolumesFromSnapshotTest-1096389075 None] Created volume successfully.
Jul 30 20:40:40 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-e5b0a589-d51e-4aca-a355-6f6ae27a030a tempest-VolumeDependencyTests-326923044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:40:40 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-e5b0a589-d51e-4aca-a355-6f6ae27a030a tempest-VolumeDependencyTests-326923044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:40:40 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-e5b0a589-d51e-4aca-a355-6f6ae27a030a tempest-VolumeDependencyTests-326923044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:40:40 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-e5b0a589-d51e-4aca-a355-6f6ae27a030a tempest-VolumeDependencyTests-326923044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:40:40 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-e5b0a589-d51e-4aca-a355-6f6ae27a030a tempest-VolumeDependencyTests-326923044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:40:40 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[695ab2cf-821c-4ccc-a6bf-13b69ea371eb]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:40:40 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-e5b0a589-d51e-4aca-a355-6f6ae27a030a tempest-VolumeDependencyTests-326923044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-dc1416a2-99d8-447c-aa4f-7fe69fe04b59.bb8f3fc7-a73c-4aea-abff-bdafe21b7b32 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:40 devstack sudo[107420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-dc1416a2-99d8-447c-aa4f-7fe69fe04b59.bb8f3fc7-a73c-4aea-abff-bdafe21b7b32
Jul 30 20:40:40 devstack sudo[107420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:40 devstack sudo[107418]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:40 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3c7ceb84-5531-4a41-8ce5-5d8812c80607 tempest-VolumeAndVolumeTypeFromImageTest-776863720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.354s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:40 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-3c7ceb84-5531-4a41-8ce5-5d8812c80607 tempest-VolumeAndVolumeTypeFromImageTest-776863720 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:40:40 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-3c7ceb84-5531-4a41-8ce5-5d8812c80607 tempest-VolumeAndVolumeTypeFromImageTest-776863720 None] Deleted volume successfully.
Jul 30 20:40:40 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-3c7ceb84-5531-4a41-8ce5-5d8812c80607 tempest-VolumeAndVolumeTypeFromImageTest-776863720 None] Lock "cinder-66f15175-b846-4cef-ad55-04e653dbbb52-delete_volume" released by "delete_volume" :: held 1.413s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:40:41 devstack sudo[107420]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:41 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-e5b0a589-d51e-4aca-a355-6f6ae27a030a tempest-VolumeDependencyTests-326923044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-dc1416a2-99d8-447c-aa4f-7fe69fe04b59.bb8f3fc7-a73c-4aea-abff-bdafe21b7b32" returned: 0 in 0.401s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:41 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-e5b0a589-d51e-4aca-a355-6f6ae27a030a tempest-VolumeDependencyTests-326923044 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dc1416a2-99d8-447c-aa4f-7fe69fe04b59(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88719) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 30 20:40:41 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[76390f3d-9fc3-43fc-991c-4b4bd9f54747]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:40:41 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-e5b0a589-d51e-4aca-a355-6f6ae27a030a tempest-VolumeDependencyTests-326923044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-dc1416a2-99d8-447c-aa4f-7fe69fe04b59 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:41 devstack sudo[107427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-dc1416a2-99d8-447c-aa4f-7fe69fe04b59
Jul 30 20:40:41 devstack sudo[107427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:41 devstack sudo[107427]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:41 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-e5b0a589-d51e-4aca-a355-6f6ae27a030a tempest-VolumeDependencyTests-326923044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-dc1416a2-99d8-447c-aa4f-7fe69fe04b59" returned: 0 in 0.475s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:41 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-e5b0a589-d51e-4aca-a355-6f6ae27a030a tempest-VolumeDependencyTests-326923044 None] will copy from snapshot at /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-dc1416a2-99d8-447c-aa4f-7fe69fe04b59 {{(pid=88719) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}}
Jul 30 20:40:41 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-e5b0a589-d51e-4aca-a355-6f6ae27a030a tempest-VolumeDependencyTests-326923044 None] Creating direct copy from snapshot {{(pid=88719) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}}
Jul 30 20:40:41 devstack cinder-volume[88719]: DEBUG cinder.utils [None req-e5b0a589-d51e-4aca-a355-6f6ae27a030a tempest-VolumeDependencyTests-326923044 None] Path /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d87c1db1-cf52-4da0-a840-6fc53223e94f not found in is_blk_device check {{(pid=88719) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 30 20:40:41 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-e5b0a589-d51e-4aca-a355-6f6ae27a030a tempest-VolumeDependencyTests-326923044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-dc1416a2-99d8-447c-aa4f-7fe69fe04b59 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d87c1db1-cf52-4da0-a840-6fc53223e94f {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:41 devstack sudo[107432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-dc1416a2-99d8-447c-aa4f-7fe69fe04b59 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d87c1db1-cf52-4da0-a840-6fc53223e94f
Jul 30 20:40:41 devstack sudo[107432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:41 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-8d32400b-bdda-48a3-a803-25662dfe014d tempest-CreateVolumesFromSnapshotTest-1096389075 None] Acquiring lock "cinder-c1d94e02-1490-47cb-bb2c-478a83a6bf50-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:40:41 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-8d32400b-bdda-48a3-a803-25662dfe014d tempest-CreateVolumesFromSnapshotTest-1096389075 None] Lock "cinder-c1d94e02-1490-47cb-bb2c-478a83a6bf50-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:40:41 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-8d32400b-bdda-48a3-a803-25662dfe014d tempest-CreateVolumesFromSnapshotTest-1096389075 None] Acquiring lock "cinder-quobyte-c1d94e02-1490-47cb-bb2c-478a83a6bf50" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:40:41 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-8d32400b-bdda-48a3-a803-25662dfe014d tempest-CreateVolumesFromSnapshotTest-1096389075 None] Lock "cinder-quobyte-c1d94e02-1490-47cb-bb2c-478a83a6bf50" acquired by "delete_volume" :: waited 0.019s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:40:41 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[562d88cd-df3f-44dd-823a-0ef9a3ebfd73]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:40:41 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8d32400b-bdda-48a3-a803-25662dfe014d tempest-CreateVolumesFromSnapshotTest-1096389075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c1d94e02-1490-47cb-bb2c-478a83a6bf50 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:42 devstack sudo[107437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c1d94e02-1490-47cb-bb2c-478a83a6bf50
Jul 30 20:40:42 devstack sudo[107437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:42 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-961033e9-3c28-4f27-970b-5d5e186d3c8b tempest-ProjectAdminTests-330290212 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.754093170166, 'free_capacity_gb': 1775.754093170166, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88719) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Jul 30 20:40:42 devstack sudo[107437]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:42 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8d32400b-bdda-48a3-a803-25662dfe014d tempest-CreateVolumesFromSnapshotTest-1096389075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c1d94e02-1490-47cb-bb2c-478a83a6bf50" returned: 0 in 0.678s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:42 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8d32400b-bdda-48a3-a803-25662dfe014d tempest-CreateVolumesFromSnapshotTest-1096389075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c1d94e02-1490-47cb-bb2c-478a83a6bf50 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:42 devstack sudo[107449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c1d94e02-1490-47cb-bb2c-478a83a6bf50
Jul 30 20:40:42 devstack sudo[107449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:43 devstack sudo[107449]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:43 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8d32400b-bdda-48a3-a803-25662dfe014d tempest-CreateVolumesFromSnapshotTest-1096389075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c1d94e02-1490-47cb-bb2c-478a83a6bf50" returned: 0 in 0.680s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:43 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-8d32400b-bdda-48a3-a803-25662dfe014d tempest-CreateVolumesFromSnapshotTest-1096389075 None] Lock "cinder-quobyte-c1d94e02-1490-47cb-bb2c-478a83a6bf50" released by "delete_volume" :: held 1.438s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:40:43 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-8d32400b-bdda-48a3-a803-25662dfe014d tempest-CreateVolumesFromSnapshotTest-1096389075 None] Created reservations ['fea90c53-c1cb-472e-b786-795b51b1e8de', 'fbbbca53-dc86-4139-9fe0-d56bf7e8b1d8', 'e263fe39-292c-45ef-b958-228ab433148c', '9d821c91-c840-4a1f-ba11-3708b4ee10a8'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:40:43 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-8d32400b-bdda-48a3-a803-25662dfe014d tempest-CreateVolumesFromSnapshotTest-1096389075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:40:43 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-8d32400b-bdda-48a3-a803-25662dfe014d tempest-CreateVolumesFromSnapshotTest-1096389075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:40:43 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-8d32400b-bdda-48a3-a803-25662dfe014d tempest-CreateVolumesFromSnapshotTest-1096389075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:40:43 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-8d32400b-bdda-48a3-a803-25662dfe014d tempest-CreateVolumesFromSnapshotTest-1096389075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:40:43 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-8d32400b-bdda-48a3-a803-25662dfe014d tempest-CreateVolumesFromSnapshotTest-1096389075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:40:43 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8d32400b-bdda-48a3-a803-25662dfe014d tempest-CreateVolumesFromSnapshotTest-1096389075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:43 devstack sudo[107453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:40:43 devstack sudo[107453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:44 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-8de80fdd-ec44-4f20-b3fb-0611b389d9a0 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Acquiring lock "cinder-46f56366-c53c-4d7f-8c1c-a22b2209b9ba-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:40:44 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-8de80fdd-ec44-4f20-b3fb-0611b389d9a0 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Lock "cinder-46f56366-c53c-4d7f-8c1c-a22b2209b9ba-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:40:44 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-8de80fdd-ec44-4f20-b3fb-0611b389d9a0 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Acquiring lock "cinder-quobyte-46f56366-c53c-4d7f-8c1c-a22b2209b9ba" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:40:44 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-8de80fdd-ec44-4f20-b3fb-0611b389d9a0 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Lock "cinder-quobyte-46f56366-c53c-4d7f-8c1c-a22b2209b9ba" acquired by "delete_volume" :: waited 0.042s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:40:44 devstack sudo[107453]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:44 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8d32400b-bdda-48a3-a803-25662dfe014d tempest-CreateVolumesFromSnapshotTest-1096389075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.960s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:44 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-8d32400b-bdda-48a3-a803-25662dfe014d tempest-CreateVolumesFromSnapshotTest-1096389075 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:40:44 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-8d32400b-bdda-48a3-a803-25662dfe014d tempest-CreateVolumesFromSnapshotTest-1096389075 None] Deleted volume successfully.
Jul 30 20:40:44 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f0e811d-1a41-4334-9953-dfd99f4b6171]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:40:44 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8de80fdd-ec44-4f20-b3fb-0611b389d9a0 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-46f56366-c53c-4d7f-8c1c-a22b2209b9ba {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:44 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-8d32400b-bdda-48a3-a803-25662dfe014d tempest-CreateVolumesFromSnapshotTest-1096389075 None] Lock "cinder-c1d94e02-1490-47cb-bb2c-478a83a6bf50-delete_volume" released by "delete_volume" :: held 2.859s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:40:45 devstack sudo[107456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-46f56366-c53c-4d7f-8c1c-a22b2209b9ba
Jul 30 20:40:45 devstack sudo[107456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:45 devstack sudo[107456]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:45 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8de80fdd-ec44-4f20-b3fb-0611b389d9a0 tempest-CreateVolumesFromSnapshotTest-1096389075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-46f56366-c53c-4d7f-8c1c-a22b2209b9ba" returned: 0 in 1.046s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:45 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8de80fdd-ec44-4f20-b3fb-0611b389d9a0 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-46f56366-c53c-4d7f-8c1c-a22b2209b9ba {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:45 devstack sudo[107462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-46f56366-c53c-4d7f-8c1c-a22b2209b9ba
Jul 30 20:40:45 devstack sudo[107462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:46 devstack sudo[107462]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:46 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8de80fdd-ec44-4f20-b3fb-0611b389d9a0 tempest-CreateVolumesFromSnapshotTest-1096389075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-46f56366-c53c-4d7f-8c1c-a22b2209b9ba" returned: 0 in 0.619s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:46 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-8de80fdd-ec44-4f20-b3fb-0611b389d9a0 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Lock "cinder-quobyte-46f56366-c53c-4d7f-8c1c-a22b2209b9ba" released by "delete_volume" :: held 1.824s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:40:46 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-8de80fdd-ec44-4f20-b3fb-0611b389d9a0 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Created reservations ['72dc1a14-4209-43f4-bc6d-9673e59a82e3', '9a37036f-703e-49f8-9d73-8ef691641c04', '4a279eee-2ef5-4162-8603-da1913916e3f', '4193a3d3-5208-4ad7-b747-048ed31c2201'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:40:46 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-8de80fdd-ec44-4f20-b3fb-0611b389d9a0 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:40:46 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-8de80fdd-ec44-4f20-b3fb-0611b389d9a0 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:40:46 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-8de80fdd-ec44-4f20-b3fb-0611b389d9a0 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:40:46 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-8de80fdd-ec44-4f20-b3fb-0611b389d9a0 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:40:46 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-8de80fdd-ec44-4f20-b3fb-0611b389d9a0 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:40:46 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8de80fdd-ec44-4f20-b3fb-0611b389d9a0 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:46 devstack sudo[107465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:40:46 devstack sudo[107465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:47 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-94e813b8-164d-4528-ad36-c0b53c73df19 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Acquiring lock "cinder-92c736cc-7160-48f0-b763-19afc3d07080-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:40:47 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-94e813b8-164d-4528-ad36-c0b53c73df19 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Lock "cinder-92c736cc-7160-48f0-b763-19afc3d07080-delete_volume" acquired by "delete_volume" :: waited 0.092s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:40:47 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-94e813b8-164d-4528-ad36-c0b53c73df19 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Acquiring lock "cinder-quobyte-92c736cc-7160-48f0-b763-19afc3d07080" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:40:47 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-94e813b8-164d-4528-ad36-c0b53c73df19 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Lock "cinder-quobyte-92c736cc-7160-48f0-b763-19afc3d07080" acquired by "delete_volume" :: waited 0.050s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:40:47 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[5562b9a6-9ca4-4fed-8114-0c12d76998d6]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:40:47 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-94e813b8-164d-4528-ad36-c0b53c73df19 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-92c736cc-7160-48f0-b763-19afc3d07080 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:47 devstack sudo[107465]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:47 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8de80fdd-ec44-4f20-b3fb-0611b389d9a0 tempest-CreateVolumesFromSnapshotTest-1096389075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.758s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:47 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-8de80fdd-ec44-4f20-b3fb-0611b389d9a0 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:40:47 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-8de80fdd-ec44-4f20-b3fb-0611b389d9a0 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Deleted volume successfully.
Jul 30 20:40:47 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-8de80fdd-ec44-4f20-b3fb-0611b389d9a0 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Lock "cinder-46f56366-c53c-4d7f-8c1c-a22b2209b9ba-delete_volume" released by "delete_volume" :: held 3.257s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:40:47 devstack sudo[107468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-92c736cc-7160-48f0-b763-19afc3d07080
Jul 30 20:40:47 devstack sudo[107468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:48 devstack sudo[107432]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:48 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-e5b0a589-d51e-4aca-a355-6f6ae27a030a tempest-VolumeDependencyTests-326923044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-dc1416a2-99d8-447c-aa4f-7fe69fe04b59 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d87c1db1-cf52-4da0-a840-6fc53223e94f" returned: 0 in 6.489s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:48 devstack cinder-volume[88719]: DEBUG cinder.image.image_utils [None req-e5b0a589-d51e-4aca-a355-6f6ae27a030a tempest-VolumeDependencyTests-326923044 None] Image conversion details: src /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-dc1416a2-99d8-447c-aa4f-7fe69fe04b59, size 1024.00 MB, duration 6.49 sec, destination /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d87c1db1-cf52-4da0-a840-6fc53223e94f {{(pid=88719) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 30 20:40:48 devstack cinder-volume[88719]: INFO cinder.image.image_utils [None req-e5b0a589-d51e-4aca-a355-6f6ae27a030a tempest-VolumeDependencyTests-326923044 None] Converted 1024.00 MB image at 157.78 MB/s
Jul 30 20:40:48 devstack cinder-volume[88719]: WARNING cinder.volume.drivers.remotefs [None req-e5b0a589-d51e-4aca-a355-6f6ae27a030a tempest-VolumeDependencyTests-326923044 None] /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d87c1db1-cf52-4da0-a840-6fc53223e94f is being set with open permissions: ugo+rw
Jul 30 20:40:48 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-e5b0a589-d51e-4aca-a355-6f6ae27a030a tempest-VolumeDependencyTests-326923044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d87c1db1-cf52-4da0-a840-6fc53223e94f {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:48 devstack sudo[107472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d87c1db1-cf52-4da0-a840-6fc53223e94f
Jul 30 20:40:48 devstack sudo[107472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:48 devstack sudo[107468]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:48 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-94e813b8-164d-4528-ad36-c0b53c73df19 tempest-CreateVolumesFromSnapshotTest-1096389075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-92c736cc-7160-48f0-b763-19afc3d07080" returned: 0 in 0.711s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:48 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-94e813b8-164d-4528-ad36-c0b53c73df19 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-92c736cc-7160-48f0-b763-19afc3d07080 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:48 devstack sudo[107475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-92c736cc-7160-48f0-b763-19afc3d07080
Jul 30 20:40:48 devstack sudo[107475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:48 devstack sudo[107472]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:48 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-e5b0a589-d51e-4aca-a355-6f6ae27a030a tempest-VolumeDependencyTests-326923044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d87c1db1-cf52-4da0-a840-6fc53223e94f" returned: 0 in 0.325s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:48 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-e5b0a589-d51e-4aca-a355-6f6ae27a030a tempest-VolumeDependencyTests-326923044 None] Lock "cinder-quobyte-d87c1db1-cf52-4da0-a840-6fc53223e94f" released by "_copy_volume_from_snapshot" :: held 7.818s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:40:48 devstack sudo[107475]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:48 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-94e813b8-164d-4528-ad36-c0b53c73df19 tempest-CreateVolumesFromSnapshotTest-1096389075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-92c736cc-7160-48f0-b763-19afc3d07080" returned: 0 in 0.263s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:48 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-94e813b8-164d-4528-ad36-c0b53c73df19 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Lock "cinder-quobyte-92c736cc-7160-48f0-b763-19afc3d07080" released by "delete_volume" :: held 1.079s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:40:48 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-e5b0a589-d51e-4aca-a355-6f6ae27a030a tempest-VolumeDependencyTests-326923044 None] Lock "cinder-quobyte-bb8f3fc7-a73c-4aea-abff-bdafe21b7b32-d87c1db1-cf52-4da0-a840-6fc53223e94f" released by "_create_volume_from_snapshot" :: held 7.954s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:40:48 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-e5b0a589-d51e-4aca-a355-6f6ae27a030a tempest-VolumeDependencyTests-326923044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.991s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:40:48 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e5b0a589-d51e-4aca-a355-6f6ae27a030a tempest-VolumeDependencyTests-326923044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a53d0227-05ac-4b33-b666-c7d9ad755019) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d87c1db1-cf52-4da0-a840-6fc53223e94f', 'volume_size': 1, 'snapshot_id': 'bb8f3fc7-a73c-4aea-abff-bdafe21b7b32'}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:48 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e5b0a589-d51e-4aca-a355-6f6ae27a030a tempest-VolumeDependencyTests-326923044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46c8f5c8-5f66-4ceb-b887-25afd88bb0ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:48 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-94e813b8-164d-4528-ad36-c0b53c73df19 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Created reservations ['26edaa93-cc0e-407d-974e-e9a54a285183', '2f8f5daa-3b83-4c7b-9735-02d1b21f0aa0', '6a8e3cba-efbf-413f-be0f-0db527bb87df', 'b817f6f4-9144-4d4c-b0e9-085bb8d353a0'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:40:48 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-e5b0a589-d51e-4aca-a355-6f6ae27a030a tempest-VolumeDependencyTests-326923044 None] Volume volume-d87c1db1-cf52-4da0-a840-6fc53223e94f (d87c1db1-cf52-4da0-a840-6fc53223e94f): created successfully
Jul 30 20:40:48 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e5b0a589-d51e-4aca-a355-6f6ae27a030a tempest-VolumeDependencyTests-326923044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46c8f5c8-5f66-4ceb-b887-25afd88bb0ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:48 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-e5b0a589-d51e-4aca-a355-6f6ae27a030a tempest-VolumeDependencyTests-326923044 None] Flow 'volume_create_manager' (0594219b-42b9-4d13-9437-fc28ed7f9918) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:40:48 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-e5b0a589-d51e-4aca-a355-6f6ae27a030a tempest-VolumeDependencyTests-326923044 None] Created volume successfully.
Jul 30 20:40:48 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-94e813b8-164d-4528-ad36-c0b53c73df19 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:40:48 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-94e813b8-164d-4528-ad36-c0b53c73df19 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:40:48 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-94e813b8-164d-4528-ad36-c0b53c73df19 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:40:48 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-94e813b8-164d-4528-ad36-c0b53c73df19 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:40:48 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-94e813b8-164d-4528-ad36-c0b53c73df19 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:40:48 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-94e813b8-164d-4528-ad36-c0b53c73df19 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:48 devstack sudo[107479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:40:48 devstack sudo[107479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:48 devstack sudo[107479]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:48 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-94e813b8-164d-4528-ad36-c0b53c73df19 tempest-CreateVolumesFromSnapshotTest-1096389075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.253s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:49 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-94e813b8-164d-4528-ad36-c0b53c73df19 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:40:49 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-94e813b8-164d-4528-ad36-c0b53c73df19 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Deleted volume successfully.
Jul 30 20:40:49 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-94e813b8-164d-4528-ad36-c0b53c73df19 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Lock "cinder-92c736cc-7160-48f0-b763-19afc3d07080-delete_volume" released by "delete_volume" :: held 1.800s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:40:49 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-50c8dd77-3887-49ed-808f-616d8efc4864 tempest-VolumeDependencyTests-326923044 None] Acquiring lock "cinder-bb8f3fc7-a73c-4aea-abff-bdafe21b7b32-delete_snapshot" by "delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:40:49 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-50c8dd77-3887-49ed-808f-616d8efc4864 tempest-VolumeDependencyTests-326923044 None] Lock "cinder-bb8f3fc7-a73c-4aea-abff-bdafe21b7b32-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:40:49 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-50c8dd77-3887-49ed-808f-616d8efc4864 tempest-VolumeDependencyTests-326923044 None] Acquiring lock "cinder-quobyte-dc1416a2-99d8-447c-aa4f-7fe69fe04b59" by "delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:40:49 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-50c8dd77-3887-49ed-808f-616d8efc4864 tempest-VolumeDependencyTests-326923044 None] Lock "cinder-quobyte-dc1416a2-99d8-447c-aa4f-7fe69fe04b59" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:40:49 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-50c8dd77-3887-49ed-808f-616d8efc4864 tempest-VolumeDependencyTests-326923044 None] Acquiring lock "cinder-quobyte-bb8f3fc7-a73c-4aea-abff-bdafe21b7b32" by "_delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:40:49 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-50c8dd77-3887-49ed-808f-616d8efc4864 tempest-VolumeDependencyTests-326923044 None] Lock "cinder-quobyte-bb8f3fc7-a73c-4aea-abff-bdafe21b7b32" acquired by "_delete_snapshot" :: waited 0.047s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:40:49 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-50c8dd77-3887-49ed-808f-616d8efc4864 tempest-VolumeDependencyTests-326923044 None] Deleting offline snapshot bb8f3fc7-a73c-4aea-abff-bdafe21b7b32 of volume dc1416a2-99d8-447c-aa4f-7fe69fe04b59 {{(pid=88719) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 30 20:40:49 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-50c8dd77-3887-49ed-808f-616d8efc4864 tempest-VolumeDependencyTests-326923044 None] snapshot_file for this snap is: volume-dc1416a2-99d8-447c-aa4f-7fe69fe04b59.bb8f3fc7-a73c-4aea-abff-bdafe21b7b32 {{(pid=88719) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 30 20:40:49 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcb94f04-e2cc-43cc-8b98-7e039770d658]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:40:49 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-50c8dd77-3887-49ed-808f-616d8efc4864 tempest-VolumeDependencyTests-326923044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-dc1416a2-99d8-447c-aa4f-7fe69fe04b59.bb8f3fc7-a73c-4aea-abff-bdafe21b7b32 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:49 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-24ae8dcc-2ca2-429f-988d-0a845a2bec19 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Acquiring lock "cinder-328de093-2a7f-4055-9014-3a590e46d99c-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:40:49 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-24ae8dcc-2ca2-429f-988d-0a845a2bec19 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Lock "cinder-328de093-2a7f-4055-9014-3a590e46d99c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:40:49 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-24ae8dcc-2ca2-429f-988d-0a845a2bec19 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Acquiring lock "cinder-quobyte-328de093-2a7f-4055-9014-3a590e46d99c" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:40:49 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-98fa543b-1718-48fa-9d39-5a1d1d7b4bff tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:40:49 devstack sudo[107482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-dc1416a2-99d8-447c-aa4f-7fe69fe04b59.bb8f3fc7-a73c-4aea-abff-bdafe21b7b32
Jul 30 20:40:49 devstack sudo[107482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:49 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-98fa543b-1718-48fa-9d39-5a1d1d7b4bff tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Flow 'volume_create_manager' (dc8262d5-bda8-4ead-837d-e015a96c88ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:40:49 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-98fa543b-1718-48fa-9d39-5a1d1d7b4bff tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61dd8480-3569-4c69-a09e-d831c96665bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:49 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-24ae8dcc-2ca2-429f-988d-0a845a2bec19 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Lock "cinder-quobyte-328de093-2a7f-4055-9014-3a590e46d99c" acquired by "delete_volume" :: waited 0.052s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:40:49 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-98fa543b-1718-48fa-9d39-5a1d1d7b4bff tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61dd8480-3569-4c69-a09e-d831c96665bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:40:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1953923850',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b451d4d-e53d-44fb-8b40-fedee323cc45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6983d31603464c379b9c6e73f72ce88d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:40:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:40:50Z,use_quota=True,user_id='f170331164ef48f7b11711c81bc1a887',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:49 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-98fa543b-1718-48fa-9d39-5a1d1d7b4bff tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb7b4734-ee1a-4811-8b25-93103892c794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:49 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-98fa543b-1718-48fa-9d39-5a1d1d7b4bff tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb7b4734-ee1a-4811-8b25-93103892c794) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:49 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-98fa543b-1718-48fa-9d39-5a1d1d7b4bff tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d610aaa-d119-440d-8719-e3ec715a006e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:49 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-98fa543b-1718-48fa-9d39-5a1d1d7b4bff tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d610aaa-d119-440d-8719-e3ec715a006e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b451d4d-e53d-44fb-8b40-fedee323cc45', 'volume_name': 'volume-1b451d4d-e53d-44fb-8b40-fedee323cc45', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:49 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-98fa543b-1718-48fa-9d39-5a1d1d7b4bff tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fdd4128-f3a0-4f9c-b730-bae87d644cae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:49 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-98fa543b-1718-48fa-9d39-5a1d1d7b4bff tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fdd4128-f3a0-4f9c-b730-bae87d644cae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:49 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-98fa543b-1718-48fa-9d39-5a1d1d7b4bff tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4af2e7ef-ab82-4388-a66d-1c760bf5c11d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:49 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-98fa543b-1718-48fa-9d39-5a1d1d7b4bff tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Volume 1b451d4d-e53d-44fb-8b40-fedee323cc45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b451d4d-e53d-44fb-8b40-fedee323cc45', 'volume_size': 1}
Jul 30 20:40:49 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-98fa543b-1718-48fa-9d39-5a1d1d7b4bff tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:40:49 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-98fa543b-1718-48fa-9d39-5a1d1d7b4bff tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:40:49 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-98fa543b-1718-48fa-9d39-5a1d1d7b4bff tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:40:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1953923850',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b451d4d-e53d-44fb-8b40-fedee323cc45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6983d31603464c379b9c6e73f72ce88d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:40:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:40:50Z,use_quota=True,user_id='f170331164ef48f7b11711c81bc1a887',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:40:49 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-98fa543b-1718-48fa-9d39-5a1d1d7b4bff tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Creating volume 1b451d4d-e53d-44fb-8b40-fedee323cc45 {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:40:49 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-98fa543b-1718-48fa-9d39-5a1d1d7b4bff tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:40:49 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-98fa543b-1718-48fa-9d39-5a1d1d7b4bff tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:40:49 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-98fa543b-1718-48fa-9d39-5a1d1d7b4bff tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:40:49 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-98fa543b-1718-48fa-9d39-5a1d1d7b4bff tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:40:49 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-98fa543b-1718-48fa-9d39-5a1d1d7b4bff tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:40:49 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-98fa543b-1718-48fa-9d39-5a1d1d7b4bff tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:40:49 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-98fa543b-1718-48fa-9d39-5a1d1d7b4bff tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:40:49 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-98fa543b-1718-48fa-9d39-5a1d1d7b4bff tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1b451d4d-e53d-44fb-8b40-fedee323cc45 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:49 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aa4340e-65a0-4b4b-8e8c-b4b42ee58aa0]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:40:49 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-24ae8dcc-2ca2-429f-988d-0a845a2bec19 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-328de093-2a7f-4055-9014-3a590e46d99c {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:49 devstack sudo[107484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1b451d4d-e53d-44fb-8b40-fedee323cc45 1073741824
Jul 30 20:40:49 devstack sudo[107484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:50 devstack sudo[107485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-328de093-2a7f-4055-9014-3a590e46d99c
Jul 30 20:40:50 devstack sudo[107482]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:50 devstack sudo[107485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:50 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-50c8dd77-3887-49ed-808f-616d8efc4864 tempest-VolumeDependencyTests-326923044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-dc1416a2-99d8-447c-aa4f-7fe69fe04b59.bb8f3fc7-a73c-4aea-abff-bdafe21b7b32" returned: 0 in 0.426s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:50 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-50c8dd77-3887-49ed-808f-616d8efc4864 tempest-VolumeDependencyTests-326923044 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dc1416a2-99d8-447c-aa4f-7fe69fe04b59(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88719) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 30 20:40:50 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa9bf79a-ffe9-4461-847a-660f05ba461b]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:40:50 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-50c8dd77-3887-49ed-808f-616d8efc4864 tempest-VolumeDependencyTests-326923044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-dc1416a2-99d8-447c-aa4f-7fe69fe04b59 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:50 devstack sudo[107491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-dc1416a2-99d8-447c-aa4f-7fe69fe04b59
Jul 30 20:40:50 devstack sudo[107491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:50 devstack sudo[107485]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:50 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-24ae8dcc-2ca2-429f-988d-0a845a2bec19 tempest-CreateVolumesFromSnapshotTest-1096389075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-328de093-2a7f-4055-9014-3a590e46d99c" returned: 0 in 0.451s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:50 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-24ae8dcc-2ca2-429f-988d-0a845a2bec19 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-328de093-2a7f-4055-9014-3a590e46d99c {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:50 devstack sudo[107501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-328de093-2a7f-4055-9014-3a590e46d99c
Jul 30 20:40:50 devstack sudo[107501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:50 devstack sudo[107484]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:50 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-98fa543b-1718-48fa-9d39-5a1d1d7b4bff tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1b451d4d-e53d-44fb-8b40-fedee323cc45 1073741824" returned: 0 in 0.569s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:50 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-98fa543b-1718-48fa-9d39-5a1d1d7b4bff tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1b451d4d-e53d-44fb-8b40-fedee323cc45 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:50 devstack sudo[107505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1b451d4d-e53d-44fb-8b40-fedee323cc45
Jul 30 20:40:50 devstack sudo[107505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:50 devstack sudo[107501]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:50 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-24ae8dcc-2ca2-429f-988d-0a845a2bec19 tempest-CreateVolumesFromSnapshotTest-1096389075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-328de093-2a7f-4055-9014-3a590e46d99c" returned: 0 in 0.298s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:50 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-24ae8dcc-2ca2-429f-988d-0a845a2bec19 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Lock "cinder-quobyte-328de093-2a7f-4055-9014-3a590e46d99c" released by "delete_volume" :: held 0.872s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:40:50 devstack sudo[107491]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:50 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-50c8dd77-3887-49ed-808f-616d8efc4864 tempest-VolumeDependencyTests-326923044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-dc1416a2-99d8-447c-aa4f-7fe69fe04b59" returned: 0 in 0.647s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:50 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-50c8dd77-3887-49ed-808f-616d8efc4864 tempest-VolumeDependencyTests-326923044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-dc1416a2-99d8-447c-aa4f-7fe69fe04b59.bb8f3fc7-a73c-4aea-abff-bdafe21b7b32 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:50 devstack sudo[107511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-dc1416a2-99d8-447c-aa4f-7fe69fe04b59.bb8f3fc7-a73c-4aea-abff-bdafe21b7b32
Jul 30 20:40:50 devstack sudo[107511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:50 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-24ae8dcc-2ca2-429f-988d-0a845a2bec19 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Created reservations ['0529f5ff-4493-446b-bc7c-977d13195e8b', '6727443b-c849-440d-bc39-2c18bdebcd1b', '4b6a7254-f1cf-46e6-8f28-017f0ec2731b', 'fb7b4084-05aa-4920-a4c1-6ac2b14f3287'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:40:50 devstack sudo[107505]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:50 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-98fa543b-1718-48fa-9d39-5a1d1d7b4bff tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1b451d4d-e53d-44fb-8b40-fedee323cc45" returned: 0 in 0.337s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:50 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-98fa543b-1718-48fa-9d39-5a1d1d7b4bff tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] <== create_volume: return (957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:40:50 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-98fa543b-1718-48fa-9d39-5a1d1d7b4bff tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:40:50 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-98fa543b-1718-48fa-9d39-5a1d1d7b4bff tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4af2e7ef-ab82-4388-a66d-1c760bf5c11d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b451d4d-e53d-44fb-8b40-fedee323cc45', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:50 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-98fa543b-1718-48fa-9d39-5a1d1d7b4bff tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (397214ac-6cc6-48ea-b288-514ee402a741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:50 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-98fa543b-1718-48fa-9d39-5a1d1d7b4bff tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Volume volume-1b451d4d-e53d-44fb-8b40-fedee323cc45 (1b451d4d-e53d-44fb-8b40-fedee323cc45): created successfully
Jul 30 20:40:50 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-98fa543b-1718-48fa-9d39-5a1d1d7b4bff tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (397214ac-6cc6-48ea-b288-514ee402a741) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:50 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-98fa543b-1718-48fa-9d39-5a1d1d7b4bff tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Flow 'volume_create_manager' (dc8262d5-bda8-4ead-837d-e015a96c88ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:40:50 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-98fa543b-1718-48fa-9d39-5a1d1d7b4bff tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Created volume successfully.
Jul 30 20:40:50 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-24ae8dcc-2ca2-429f-988d-0a845a2bec19 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:40:50 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-24ae8dcc-2ca2-429f-988d-0a845a2bec19 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:40:50 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-24ae8dcc-2ca2-429f-988d-0a845a2bec19 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:40:50 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-24ae8dcc-2ca2-429f-988d-0a845a2bec19 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:40:50 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-24ae8dcc-2ca2-429f-988d-0a845a2bec19 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:40:50 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-24ae8dcc-2ca2-429f-988d-0a845a2bec19 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:50 devstack sudo[107513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:40:50 devstack sudo[107513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:51 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a9fb8ad-689d-413c-ab18-4bc915ab5afc tempest-ProjectMemberTests-47051868 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:40:51 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-0a9fb8ad-689d-413c-ab18-4bc915ab5afc tempest-ProjectMemberTests-47051868 None] Flow 'volume_create_manager' (2653af8d-9fcb-41a1-8ac1-37e47fb80e91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:40:51 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-0a9fb8ad-689d-413c-ab18-4bc915ab5afc tempest-ProjectMemberTests-47051868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb9de549-76f4-43d6-b3b9-5ab31271fd9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:51 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-0a9fb8ad-689d-413c-ab18-4bc915ab5afc tempest-ProjectMemberTests-47051868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb9de549-76f4-43d6-b3b9-5ab31271fd9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:40:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2021549125',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5c1f6b5-206c-4682-b364-83dcbe9f3bd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c483f66aa6ec477e9cb0547f0f04f6d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:40:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:40:51Z,use_quota=True,user_id='59a41c24b76545b79b09f90cd8c36728',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:51 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-0a9fb8ad-689d-413c-ab18-4bc915ab5afc tempest-ProjectMemberTests-47051868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9be0bb50-9ef4-4961-b769-6428249a271f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:51 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-0a9fb8ad-689d-413c-ab18-4bc915ab5afc tempest-ProjectMemberTests-47051868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9be0bb50-9ef4-4961-b769-6428249a271f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:51 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-0a9fb8ad-689d-413c-ab18-4bc915ab5afc tempest-ProjectMemberTests-47051868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9997831c-5682-4bb3-871c-3348bdd058bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:51 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-0a9fb8ad-689d-413c-ab18-4bc915ab5afc tempest-ProjectMemberTests-47051868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9997831c-5682-4bb3-871c-3348bdd058bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5c1f6b5-206c-4682-b364-83dcbe9f3bd4', 'volume_name': 'volume-d5c1f6b5-206c-4682-b364-83dcbe9f3bd4', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:51 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-0a9fb8ad-689d-413c-ab18-4bc915ab5afc tempest-ProjectMemberTests-47051868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e56a8d9b-96d1-4822-b2f0-21d37cdf7aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:51 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-0a9fb8ad-689d-413c-ab18-4bc915ab5afc tempest-ProjectMemberTests-47051868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e56a8d9b-96d1-4822-b2f0-21d37cdf7aea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:51 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-0a9fb8ad-689d-413c-ab18-4bc915ab5afc tempest-ProjectMemberTests-47051868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a91ad64a-7a97-49e0-8473-e2618fc46a74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:51 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-0a9fb8ad-689d-413c-ab18-4bc915ab5afc tempest-ProjectMemberTests-47051868 None] Volume d5c1f6b5-206c-4682-b364-83dcbe9f3bd4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5c1f6b5-206c-4682-b364-83dcbe9f3bd4', 'volume_size': 1}
Jul 30 20:40:51 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-0a9fb8ad-689d-413c-ab18-4bc915ab5afc tempest-ProjectMemberTests-47051868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:40:51 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-0a9fb8ad-689d-413c-ab18-4bc915ab5afc tempest-ProjectMemberTests-47051868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:40:51 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-0a9fb8ad-689d-413c-ab18-4bc915ab5afc tempest-ProjectMemberTests-47051868 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:40:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2021549125',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5c1f6b5-206c-4682-b364-83dcbe9f3bd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c483f66aa6ec477e9cb0547f0f04f6d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:40:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:40:51Z,use_quota=True,user_id='59a41c24b76545b79b09f90cd8c36728',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:40:51 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-0a9fb8ad-689d-413c-ab18-4bc915ab5afc tempest-ProjectMemberTests-47051868 None] Creating volume d5c1f6b5-206c-4682-b364-83dcbe9f3bd4 {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:40:51 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-0a9fb8ad-689d-413c-ab18-4bc915ab5afc tempest-ProjectMemberTests-47051868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:40:51 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-0a9fb8ad-689d-413c-ab18-4bc915ab5afc tempest-ProjectMemberTests-47051868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:40:51 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-0a9fb8ad-689d-413c-ab18-4bc915ab5afc tempest-ProjectMemberTests-47051868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:40:51 devstack sudo[107511]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:51 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-0a9fb8ad-689d-413c-ab18-4bc915ab5afc tempest-ProjectMemberTests-47051868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:40:51 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-0a9fb8ad-689d-413c-ab18-4bc915ab5afc tempest-ProjectMemberTests-47051868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:40:51 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-0a9fb8ad-689d-413c-ab18-4bc915ab5afc tempest-ProjectMemberTests-47051868 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:40:51 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-0a9fb8ad-689d-413c-ab18-4bc915ab5afc tempest-ProjectMemberTests-47051868 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:40:51 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-0a9fb8ad-689d-413c-ab18-4bc915ab5afc tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d5c1f6b5-206c-4682-b364-83dcbe9f3bd4 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:51 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-50c8dd77-3887-49ed-808f-616d8efc4864 tempest-VolumeDependencyTests-326923044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-dc1416a2-99d8-447c-aa4f-7fe69fe04b59.bb8f3fc7-a73c-4aea-abff-bdafe21b7b32" returned: 0 in 0.422s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:51 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-50c8dd77-3887-49ed-808f-616d8efc4864 tempest-VolumeDependencyTests-326923044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-dc1416a2-99d8-447c-aa4f-7fe69fe04b59.bb8f3fc7-a73c-4aea-abff-bdafe21b7b32 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:51 devstack sudo[107518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d5c1f6b5-206c-4682-b364-83dcbe9f3bd4 1073741824
Jul 30 20:40:51 devstack sudo[107518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:51 devstack sudo[107519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-dc1416a2-99d8-447c-aa4f-7fe69fe04b59.bb8f3fc7-a73c-4aea-abff-bdafe21b7b32
Jul 30 20:40:51 devstack sudo[107519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:51 devstack sudo[107513]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:51 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-24ae8dcc-2ca2-429f-988d-0a845a2bec19 tempest-CreateVolumesFromSnapshotTest-1096389075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.286s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:51 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-24ae8dcc-2ca2-429f-988d-0a845a2bec19 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:40:51 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-24ae8dcc-2ca2-429f-988d-0a845a2bec19 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Deleted volume successfully.
Jul 30 20:40:51 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-24ae8dcc-2ca2-429f-988d-0a845a2bec19 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Lock "cinder-328de093-2a7f-4055-9014-3a590e46d99c-delete_volume" released by "delete_volume" :: held 1.575s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:40:51 devstack sudo[107519]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:51 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-50c8dd77-3887-49ed-808f-616d8efc4864 tempest-VolumeDependencyTests-326923044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-dc1416a2-99d8-447c-aa4f-7fe69fe04b59.bb8f3fc7-a73c-4aea-abff-bdafe21b7b32" returned: 0 in 0.276s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:51 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-50c8dd77-3887-49ed-808f-616d8efc4864 tempest-VolumeDependencyTests-326923044 None] Lock "cinder-quobyte-bb8f3fc7-a73c-4aea-abff-bdafe21b7b32" released by "_delete_snapshot" :: held 1.927s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:40:51 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-50c8dd77-3887-49ed-808f-616d8efc4864 tempest-VolumeDependencyTests-326923044 None] Lock "cinder-quobyte-dc1416a2-99d8-447c-aa4f-7fe69fe04b59" released by "delete_snapshot" :: held 1.984s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:40:51 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-50c8dd77-3887-49ed-808f-616d8efc4864 tempest-VolumeDependencyTests-326923044 None] Created reservations ['145d427c-f86b-41f1-893a-a90f1f7e18e6', '4d3978c3-2bb8-4b3d-b729-8e2f156e87c6', '46866ba1-d960-4ab3-9b24-1cc2269a2a88', '987cf790-8c0d-4fa4-88f5-f9da4d4cc3e2'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:40:51 devstack sudo[107518]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:51 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-0a9fb8ad-689d-413c-ab18-4bc915ab5afc tempest-ProjectMemberTests-47051868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d5c1f6b5-206c-4682-b364-83dcbe9f3bd4 1073741824" returned: 0 in 0.458s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:51 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-50c8dd77-3887-49ed-808f-616d8efc4864 tempest-VolumeDependencyTests-326923044 None] Delete snapshot completed successfully.
Jul 30 20:40:51 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-50c8dd77-3887-49ed-808f-616d8efc4864 tempest-VolumeDependencyTests-326923044 None] Lock "cinder-bb8f3fc7-a73c-4aea-abff-bdafe21b7b32-delete_snapshot" released by "delete_snapshot" :: held 2.139s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:40:51 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-0a9fb8ad-689d-413c-ab18-4bc915ab5afc tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d5c1f6b5-206c-4682-b364-83dcbe9f3bd4 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:51 devstack sudo[107528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d5c1f6b5-206c-4682-b364-83dcbe9f3bd4
Jul 30 20:40:51 devstack sudo[107528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:51 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-3b266426-761f-47b0-a123-485aa9f7ae4b tempest-VolumeDependencyTests-326923044 None] Acquiring lock "cinder-dc1416a2-99d8-447c-aa4f-7fe69fe04b59-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:40:51 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-3b266426-761f-47b0-a123-485aa9f7ae4b tempest-VolumeDependencyTests-326923044 None] Lock "cinder-dc1416a2-99d8-447c-aa4f-7fe69fe04b59-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:40:51 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-3b266426-761f-47b0-a123-485aa9f7ae4b tempest-VolumeDependencyTests-326923044 None] Acquiring lock "cinder-quobyte-dc1416a2-99d8-447c-aa4f-7fe69fe04b59" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:40:51 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-3b266426-761f-47b0-a123-485aa9f7ae4b tempest-VolumeDependencyTests-326923044 None] Lock "cinder-quobyte-dc1416a2-99d8-447c-aa4f-7fe69fe04b59" acquired by "delete_volume" :: waited 0.019s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:40:51 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[b53fe770-3073-48e4-92b8-ccabe173a8c4]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:40:51 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3b266426-761f-47b0-a123-485aa9f7ae4b tempest-VolumeDependencyTests-326923044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-dc1416a2-99d8-447c-aa4f-7fe69fe04b59 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:51 devstack sudo[107528]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:51 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-0a9fb8ad-689d-413c-ab18-4bc915ab5afc tempest-ProjectMemberTests-47051868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d5c1f6b5-206c-4682-b364-83dcbe9f3bd4" returned: 0 in 0.264s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:51 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-0a9fb8ad-689d-413c-ab18-4bc915ab5afc tempest-ProjectMemberTests-47051868 None] <== create_volume: return (770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:40:51 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-0a9fb8ad-689d-413c-ab18-4bc915ab5afc tempest-ProjectMemberTests-47051868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.772s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:40:51 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-0a9fb8ad-689d-413c-ab18-4bc915ab5afc tempest-ProjectMemberTests-47051868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a91ad64a-7a97-49e0-8473-e2618fc46a74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5c1f6b5-206c-4682-b364-83dcbe9f3bd4', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:51 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-0a9fb8ad-689d-413c-ab18-4bc915ab5afc tempest-ProjectMemberTests-47051868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (264e5419-cabf-4733-bfeb-83586c861403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:51 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-0a9fb8ad-689d-413c-ab18-4bc915ab5afc tempest-ProjectMemberTests-47051868 None] Volume volume-d5c1f6b5-206c-4682-b364-83dcbe9f3bd4 (d5c1f6b5-206c-4682-b364-83dcbe9f3bd4): created successfully
Jul 30 20:40:51 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-0a9fb8ad-689d-413c-ab18-4bc915ab5afc tempest-ProjectMemberTests-47051868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (264e5419-cabf-4733-bfeb-83586c861403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:51 devstack sudo[107530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-dc1416a2-99d8-447c-aa4f-7fe69fe04b59
Jul 30 20:40:51 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-0a9fb8ad-689d-413c-ab18-4bc915ab5afc tempest-ProjectMemberTests-47051868 None] Flow 'volume_create_manager' (2653af8d-9fcb-41a1-8ac1-37e47fb80e91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:40:51 devstack sudo[107530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:51 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-0a9fb8ad-689d-413c-ab18-4bc915ab5afc tempest-ProjectMemberTests-47051868 None] Created volume successfully.
Jul 30 20:40:51 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-bb01fdf5-9b0a-4602-a3a3-99fe094d5a02 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Acquiring lock "cinder-5732cb39-eeb5-4f52-9e64-c698a128b605-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:40:52 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-bb01fdf5-9b0a-4602-a3a3-99fe094d5a02 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Lock "cinder-5732cb39-eeb5-4f52-9e64-c698a128b605-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:40:52 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-bb01fdf5-9b0a-4602-a3a3-99fe094d5a02 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Acquiring lock "cinder-quobyte-5732cb39-eeb5-4f52-9e64-c698a128b605" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:40:52 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-bb01fdf5-9b0a-4602-a3a3-99fe094d5a02 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Lock "cinder-quobyte-5732cb39-eeb5-4f52-9e64-c698a128b605" acquired by "delete_volume" :: waited 0.031s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:40:52 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9478e52-24a0-4735-9ede-a2b7b1d08a17]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:40:52 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-bb01fdf5-9b0a-4602-a3a3-99fe094d5a02 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5732cb39-eeb5-4f52-9e64-c698a128b605 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:52 devstack sudo[107530]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:52 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3b266426-761f-47b0-a123-485aa9f7ae4b tempest-VolumeDependencyTests-326923044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-dc1416a2-99d8-447c-aa4f-7fe69fe04b59" returned: 0 in 0.461s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:52 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3b266426-761f-47b0-a123-485aa9f7ae4b tempest-VolumeDependencyTests-326923044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-dc1416a2-99d8-447c-aa4f-7fe69fe04b59 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:52 devstack sudo[107533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5732cb39-eeb5-4f52-9e64-c698a128b605
Jul 30 20:40:52 devstack sudo[107533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:52 devstack sudo[107538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-dc1416a2-99d8-447c-aa4f-7fe69fe04b59
Jul 30 20:40:52 devstack sudo[107538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:52 devstack sudo[107533]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:52 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-bb01fdf5-9b0a-4602-a3a3-99fe094d5a02 tempest-CreateVolumesFromSnapshotTest-1096389075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5732cb39-eeb5-4f52-9e64-c698a128b605" returned: 0 in 0.514s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:52 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-bb01fdf5-9b0a-4602-a3a3-99fe094d5a02 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5732cb39-eeb5-4f52-9e64-c698a128b605 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:52 devstack sudo[107538]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:52 devstack sudo[107545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5732cb39-eeb5-4f52-9e64-c698a128b605
Jul 30 20:40:52 devstack sudo[107545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:52 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3b266426-761f-47b0-a123-485aa9f7ae4b tempest-VolumeDependencyTests-326923044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-dc1416a2-99d8-447c-aa4f-7fe69fe04b59" returned: 0 in 0.428s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:52 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-8893bd9e-2274-4577-9268-b70c0d0c1223 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:40:52 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-8893bd9e-2274-4577-9268-b70c0d0c1223 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Flow 'volume_create_manager' (fa712a3d-3226-4005-be63-1e92ec158029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:40:52 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-8893bd9e-2274-4577-9268-b70c0d0c1223 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed4159f9-9a99-47b3-aa8f-9f6279dcab47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:52 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-3b266426-761f-47b0-a123-485aa9f7ae4b tempest-VolumeDependencyTests-326923044 None] Lock "cinder-quobyte-dc1416a2-99d8-447c-aa4f-7fe69fe04b59" released by "delete_volume" :: held 1.013s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:40:52 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-8893bd9e-2274-4577-9268-b70c0d0c1223 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed4159f9-9a99-47b3-aa8f-9f6279dcab47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:40:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-597747635',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73a88ac6-96f1-4f01-a46a-81ddedb545de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6983d31603464c379b9c6e73f72ce88d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:40:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:40:53Z,use_quota=True,user_id='f170331164ef48f7b11711c81bc1a887',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:52 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-8893bd9e-2274-4577-9268-b70c0d0c1223 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0da8ca52-9841-4310-b080-25c84cbb1d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:52 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-8893bd9e-2274-4577-9268-b70c0d0c1223 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0da8ca52-9841-4310-b080-25c84cbb1d76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:52 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-8893bd9e-2274-4577-9268-b70c0d0c1223 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8a28946-5efc-4ab5-87c8-de025b6f92ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:52 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-8893bd9e-2274-4577-9268-b70c0d0c1223 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8a28946-5efc-4ab5-87c8-de025b6f92ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73a88ac6-96f1-4f01-a46a-81ddedb545de', 'volume_name': 'volume-73a88ac6-96f1-4f01-a46a-81ddedb545de', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:52 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-8893bd9e-2274-4577-9268-b70c0d0c1223 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59deddb8-045f-463a-aa81-cb7e940211b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:52 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-8893bd9e-2274-4577-9268-b70c0d0c1223 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59deddb8-045f-463a-aa81-cb7e940211b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:52 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-8893bd9e-2274-4577-9268-b70c0d0c1223 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c40c238-1929-436a-9511-da247316216d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:52 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-8893bd9e-2274-4577-9268-b70c0d0c1223 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Volume 73a88ac6-96f1-4f01-a46a-81ddedb545de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73a88ac6-96f1-4f01-a46a-81ddedb545de', 'volume_size': 1}
Jul 30 20:40:52 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-8893bd9e-2274-4577-9268-b70c0d0c1223 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:40:52 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-8893bd9e-2274-4577-9268-b70c0d0c1223 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:40:52 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-8893bd9e-2274-4577-9268-b70c0d0c1223 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:40:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-597747635',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73a88ac6-96f1-4f01-a46a-81ddedb545de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6983d31603464c379b9c6e73f72ce88d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:40:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:40:53Z,use_quota=True,user_id='f170331164ef48f7b11711c81bc1a887',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:40:52 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-8893bd9e-2274-4577-9268-b70c0d0c1223 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Creating volume 73a88ac6-96f1-4f01-a46a-81ddedb545de {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:40:52 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-8893bd9e-2274-4577-9268-b70c0d0c1223 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:40:52 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-8893bd9e-2274-4577-9268-b70c0d0c1223 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:40:52 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-8893bd9e-2274-4577-9268-b70c0d0c1223 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:40:52 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-8893bd9e-2274-4577-9268-b70c0d0c1223 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:40:52 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-8893bd9e-2274-4577-9268-b70c0d0c1223 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:40:52 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-8893bd9e-2274-4577-9268-b70c0d0c1223 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:40:52 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-8893bd9e-2274-4577-9268-b70c0d0c1223 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:40:52 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8893bd9e-2274-4577-9268-b70c0d0c1223 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-73a88ac6-96f1-4f01-a46a-81ddedb545de 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:52 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-e1f9a96c-2e04-4005-9e0d-e2592a81a7cb tempest-ProjectMemberTests-47051868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:40:52 devstack sudo[107547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-73a88ac6-96f1-4f01-a46a-81ddedb545de 1073741824
Jul 30 20:40:52 devstack sudo[107547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:52 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-3b266426-761f-47b0-a123-485aa9f7ae4b tempest-VolumeDependencyTests-326923044 None] Created reservations ['b6c476b2-769d-49fc-b53b-b96b8ae54f0b', 'c206dd42-dd28-496a-a63f-8f92cbad5f6e', 'cde88403-1930-4a7b-af54-286d0cfa9986', '63f3b5a8-2722-4f50-b5e0-1a3628912a39'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:40:53 devstack sudo[107545]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:53 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-bb01fdf5-9b0a-4602-a3a3-99fe094d5a02 tempest-CreateVolumesFromSnapshotTest-1096389075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-5732cb39-eeb5-4f52-9e64-c698a128b605" returned: 0 in 0.382s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:53 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-3b266426-761f-47b0-a123-485aa9f7ae4b tempest-VolumeDependencyTests-326923044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:40:53 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-3b266426-761f-47b0-a123-485aa9f7ae4b tempest-VolumeDependencyTests-326923044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:40:53 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-3b266426-761f-47b0-a123-485aa9f7ae4b tempest-VolumeDependencyTests-326923044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:40:53 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-3b266426-761f-47b0-a123-485aa9f7ae4b tempest-VolumeDependencyTests-326923044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:40:53 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-3b266426-761f-47b0-a123-485aa9f7ae4b tempest-VolumeDependencyTests-326923044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:40:53 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3b266426-761f-47b0-a123-485aa9f7ae4b tempest-VolumeDependencyTests-326923044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:53 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-bb01fdf5-9b0a-4602-a3a3-99fe094d5a02 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Lock "cinder-quobyte-5732cb39-eeb5-4f52-9e64-c698a128b605" released by "delete_volume" :: held 1.010s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:40:53 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-47a7f88e-5192-4b58-a5ef-333465264b62 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:40:53 devstack sudo[107550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:40:53 devstack sudo[107550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:53 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-47a7f88e-5192-4b58-a5ef-333465264b62 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Flow 'volume_create_manager' (214ff0a2-9591-4437-b3cb-2124297a2a9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:40:53 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-47a7f88e-5192-4b58-a5ef-333465264b62 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8800cb93-30d4-46f5-a734-bb538a3b6d0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:53 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-47a7f88e-5192-4b58-a5ef-333465264b62 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8800cb93-30d4-46f5-a734-bb538a3b6d0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:40:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2039151371',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f49244d7-8653-4a55-b690-c257921a5250,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6983d31603464c379b9c6e73f72ce88d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:40:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:40:53Z,use_quota=True,user_id='f170331164ef48f7b11711c81bc1a887',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:53 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-47a7f88e-5192-4b58-a5ef-333465264b62 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb5dee7d-bedc-4ece-a7b6-43de5c66e31a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:53 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-47a7f88e-5192-4b58-a5ef-333465264b62 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb5dee7d-bedc-4ece-a7b6-43de5c66e31a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:53 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-47a7f88e-5192-4b58-a5ef-333465264b62 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aee0d8ea-5aee-46ee-b10d-4174d99369bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:53 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-47a7f88e-5192-4b58-a5ef-333465264b62 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aee0d8ea-5aee-46ee-b10d-4174d99369bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f49244d7-8653-4a55-b690-c257921a5250', 'volume_name': 'volume-f49244d7-8653-4a55-b690-c257921a5250', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:53 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-47a7f88e-5192-4b58-a5ef-333465264b62 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c60994a4-1d11-4075-a7df-942d93883da5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:53 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-47a7f88e-5192-4b58-a5ef-333465264b62 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c60994a4-1d11-4075-a7df-942d93883da5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:53 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-47a7f88e-5192-4b58-a5ef-333465264b62 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7372b205-9be4-48b2-8dbf-96fb755a9372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:53 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-47a7f88e-5192-4b58-a5ef-333465264b62 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Volume f49244d7-8653-4a55-b690-c257921a5250: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f49244d7-8653-4a55-b690-c257921a5250', 'volume_size': 1}
Jul 30 20:40:53 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-47a7f88e-5192-4b58-a5ef-333465264b62 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:40:53 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-bb01fdf5-9b0a-4602-a3a3-99fe094d5a02 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Created reservations ['67774210-25c1-4c91-b4fc-23915d07365e', '6151bfb1-4bf5-48fd-98a6-716d94d80095', '78e3af9f-592d-4d89-84f0-7469b7c04632', 'b7407db7-f13a-443e-8495-065b0d7a721b'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:40:53 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-bb01fdf5-9b0a-4602-a3a3-99fe094d5a02 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:40:53 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-bb01fdf5-9b0a-4602-a3a3-99fe094d5a02 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:40:53 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-bb01fdf5-9b0a-4602-a3a3-99fe094d5a02 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:40:53 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-bb01fdf5-9b0a-4602-a3a3-99fe094d5a02 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:40:53 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-bb01fdf5-9b0a-4602-a3a3-99fe094d5a02 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:40:53 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-bb01fdf5-9b0a-4602-a3a3-99fe094d5a02 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:53 devstack sudo[107555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:40:53 devstack sudo[107555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:53 devstack sudo[107550]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:53 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3b266426-761f-47b0-a123-485aa9f7ae4b tempest-VolumeDependencyTests-326923044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.376s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:53 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-3b266426-761f-47b0-a123-485aa9f7ae4b tempest-VolumeDependencyTests-326923044 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:40:53 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-3b266426-761f-47b0-a123-485aa9f7ae4b tempest-VolumeDependencyTests-326923044 None] Deleted volume successfully.
Jul 30 20:40:53 devstack sudo[107547]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:53 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-3b266426-761f-47b0-a123-485aa9f7ae4b tempest-VolumeDependencyTests-326923044 None] Lock "cinder-dc1416a2-99d8-447c-aa4f-7fe69fe04b59-delete_volume" released by "delete_volume" :: held 1.803s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:40:53 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8893bd9e-2274-4577-9268-b70c0d0c1223 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-73a88ac6-96f1-4f01-a46a-81ddedb545de 1073741824" returned: 0 in 0.638s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:53 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8893bd9e-2274-4577-9268-b70c0d0c1223 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-73a88ac6-96f1-4f01-a46a-81ddedb545de {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:53 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-b08d92ef-dda2-43a6-88f2-b83109205507 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:40:53 devstack sudo[107558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-73a88ac6-96f1-4f01-a46a-81ddedb545de
Jul 30 20:40:53 devstack sudo[107558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:53 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-b08d92ef-dda2-43a6-88f2-b83109205507 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Flow 'volume_create_manager' (0b87a606-5826-4ebc-97be-9ff4bdfe47d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:40:53 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-b08d92ef-dda2-43a6-88f2-b83109205507 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56a64df8-6d0b-492b-a923-19802bbe6a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:53 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-b08d92ef-dda2-43a6-88f2-b83109205507 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56a64df8-6d0b-492b-a923-19802bbe6a08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:40:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1310504257',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ea40941-2e6b-4a35-ab50-207d97cb9e74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6983d31603464c379b9c6e73f72ce88d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:40:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:40:54Z,use_quota=True,user_id='f170331164ef48f7b11711c81bc1a887',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:53 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-b08d92ef-dda2-43a6-88f2-b83109205507 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eee87dc4-be7d-4e1e-a1a6-58f0ff686929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:53 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-b08d92ef-dda2-43a6-88f2-b83109205507 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eee87dc4-be7d-4e1e-a1a6-58f0ff686929) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:53 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-b08d92ef-dda2-43a6-88f2-b83109205507 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (858f719d-0cdd-4075-ac9d-9e7e1a97a716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:53 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-b08d92ef-dda2-43a6-88f2-b83109205507 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (858f719d-0cdd-4075-ac9d-9e7e1a97a716) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ea40941-2e6b-4a35-ab50-207d97cb9e74', 'volume_name': 'volume-8ea40941-2e6b-4a35-ab50-207d97cb9e74', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:53 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-b08d92ef-dda2-43a6-88f2-b83109205507 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f371b4f8-21ba-4708-9ad7-f03575f28b16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:53 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-b08d92ef-dda2-43a6-88f2-b83109205507 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f371b4f8-21ba-4708-9ad7-f03575f28b16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:53 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-b08d92ef-dda2-43a6-88f2-b83109205507 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1459feac-2bef-4d1f-8ce8-83eec2e2b404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:53 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-b08d92ef-dda2-43a6-88f2-b83109205507 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Volume 8ea40941-2e6b-4a35-ab50-207d97cb9e74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ea40941-2e6b-4a35-ab50-207d97cb9e74', 'volume_size': 1}
Jul 30 20:40:53 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-b08d92ef-dda2-43a6-88f2-b83109205507 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:40:53 devstack sudo[107555]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:53 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-bb01fdf5-9b0a-4602-a3a3-99fe094d5a02 tempest-CreateVolumesFromSnapshotTest-1096389075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.353s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:53 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-bb01fdf5-9b0a-4602-a3a3-99fe094d5a02 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:40:53 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-bb01fdf5-9b0a-4602-a3a3-99fe094d5a02 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Deleted volume successfully.
Jul 30 20:40:53 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-bb01fdf5-9b0a-4602-a3a3-99fe094d5a02 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Lock "cinder-5732cb39-eeb5-4f52-9e64-c698a128b605-delete_volume" released by "delete_volume" :: held 1.749s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:40:53 devstack sudo[107558]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:53 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8893bd9e-2274-4577-9268-b70c0d0c1223 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-73a88ac6-96f1-4f01-a46a-81ddedb545de" returned: 0 in 0.345s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:53 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-8893bd9e-2274-4577-9268-b70c0d0c1223 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] <== create_volume: return (1053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:40:53 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-8893bd9e-2274-4577-9268-b70c0d0c1223 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.057s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:40:53 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-e1f9a96c-2e04-4005-9e0d-e2592a81a7cb tempest-ProjectMemberTests-47051868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.030s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:40:53 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-e1f9a96c-2e04-4005-9e0d-e2592a81a7cb tempest-ProjectMemberTests-47051868 None] Creating offline snapshot b42ee755-df81-4cac-85b1-3be99a52c88f of volume d5c1f6b5-206c-4682-b364-83dcbe9f3bd4 {{(pid=88719) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 30 20:40:53 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-8893bd9e-2274-4577-9268-b70c0d0c1223 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c40c238-1929-436a-9511-da247316216d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73a88ac6-96f1-4f01-a46a-81ddedb545de', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:53 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-8893bd9e-2274-4577-9268-b70c0d0c1223 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3512cf10-970c-4751-b64e-61eb89aa941d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:53 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c9ddfd4-5cf9-470d-b325-4a50dcfbda8f]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:40:53 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-e1f9a96c-2e04-4005-9e0d-e2592a81a7cb tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d5c1f6b5-206c-4682-b364-83dcbe9f3bd4 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:54 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-48a10504-ceae-473c-9545-2faa737df61d tempest-VolumeDependencyTests-326923044 None] Acquiring lock "cinder-d87c1db1-cf52-4da0-a840-6fc53223e94f-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:40:54 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-5300427b-9ba5-46d2-8950-69ada17c8c6d tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:40:54 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5300427b-9ba5-46d2-8950-69ada17c8c6d tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Flow 'volume_create_manager' (b1e9d4e1-9eee-4424-9e44-99276e41179e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:40:54 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5300427b-9ba5-46d2-8950-69ada17c8c6d tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f7b5aa5-fbc8-4d4b-932f-f7dba57072bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:54 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-8893bd9e-2274-4577-9268-b70c0d0c1223 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Volume volume-73a88ac6-96f1-4f01-a46a-81ddedb545de (73a88ac6-96f1-4f01-a46a-81ddedb545de): created successfully
Jul 30 20:40:54 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-8893bd9e-2274-4577-9268-b70c0d0c1223 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3512cf10-970c-4751-b64e-61eb89aa941d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:54 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-8893bd9e-2274-4577-9268-b70c0d0c1223 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Flow 'volume_create_manager' (fa712a3d-3226-4005-be63-1e92ec158029) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:40:54 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-48a10504-ceae-473c-9545-2faa737df61d tempest-VolumeDependencyTests-326923044 None] Lock "cinder-d87c1db1-cf52-4da0-a840-6fc53223e94f-delete_volume" acquired by "delete_volume" :: waited 0.091s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:40:54 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5300427b-9ba5-46d2-8950-69ada17c8c6d tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f7b5aa5-fbc8-4d4b-932f-f7dba57072bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:40:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-359756437',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50c56d0e-fd32-4ff8-84a7-f5cb3499780e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6983d31603464c379b9c6e73f72ce88d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:40:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:40:54Z,use_quota=True,user_id='f170331164ef48f7b11711c81bc1a887',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:54 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5300427b-9ba5-46d2-8950-69ada17c8c6d tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae5125eb-d4ca-49df-ba6a-11f254d3e230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:54 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5300427b-9ba5-46d2-8950-69ada17c8c6d tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae5125eb-d4ca-49df-ba6a-11f254d3e230) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:54 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5300427b-9ba5-46d2-8950-69ada17c8c6d tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (966ccf99-7c93-41e8-a999-f12c620389b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:54 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5300427b-9ba5-46d2-8950-69ada17c8c6d tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (966ccf99-7c93-41e8-a999-f12c620389b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50c56d0e-fd32-4ff8-84a7-f5cb3499780e', 'volume_name': 'volume-50c56d0e-fd32-4ff8-84a7-f5cb3499780e', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:54 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5300427b-9ba5-46d2-8950-69ada17c8c6d tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bd0b7c6-5001-4b1c-8b63-03284b888d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:54 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5300427b-9ba5-46d2-8950-69ada17c8c6d tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bd0b7c6-5001-4b1c-8b63-03284b888d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:54 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5300427b-9ba5-46d2-8950-69ada17c8c6d tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82207e4e-0b75-426e-8a3a-fff0d84c79f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:54 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-5300427b-9ba5-46d2-8950-69ada17c8c6d tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Volume 50c56d0e-fd32-4ff8-84a7-f5cb3499780e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50c56d0e-fd32-4ff8-84a7-f5cb3499780e', 'volume_size': 1}
Jul 30 20:40:54 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-5300427b-9ba5-46d2-8950-69ada17c8c6d tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:40:54 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-8893bd9e-2274-4577-9268-b70c0d0c1223 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Created volume successfully.
Jul 30 20:40:54 devstack sudo[107562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d5c1f6b5-206c-4682-b364-83dcbe9f3bd4
Jul 30 20:40:54 devstack sudo[107562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:54 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-48a10504-ceae-473c-9545-2faa737df61d tempest-VolumeDependencyTests-326923044 None] Acquiring lock "cinder-quobyte-d87c1db1-cf52-4da0-a840-6fc53223e94f" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:40:54 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-48a10504-ceae-473c-9545-2faa737df61d tempest-VolumeDependencyTests-326923044 None] Lock "cinder-quobyte-d87c1db1-cf52-4da0-a840-6fc53223e94f" acquired by "delete_volume" :: waited 0.028s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:40:54 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fbb4d35-65f0-46ca-96ba-3d18c99d7a25]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:40:54 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-48a10504-ceae-473c-9545-2faa737df61d tempest-VolumeDependencyTests-326923044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d87c1db1-cf52-4da0-a840-6fc53223e94f {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:54 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-8e183ee8-769f-4578-9f36-66d5f4e5909b tempest-CreateVolumesFromSnapshotTest-1096389075 None] Acquiring lock "cinder-72345298-cbcd-4d6e-ad88-78f62729b6f1-delete_snapshot" by "delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:40:54 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-8e183ee8-769f-4578-9f36-66d5f4e5909b tempest-CreateVolumesFromSnapshotTest-1096389075 None] Lock "cinder-72345298-cbcd-4d6e-ad88-78f62729b6f1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:40:54 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-8e183ee8-769f-4578-9f36-66d5f4e5909b tempest-CreateVolumesFromSnapshotTest-1096389075 None] Acquiring lock "cinder-quobyte-efae64d4-0356-42c0-8d82-bf512cf6c201" by "delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:40:54 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f493e1d-c7bd-4f3f-bf18-51168bd46f14 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:40:54 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5f493e1d-c7bd-4f3f-bf18-51168bd46f14 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Flow 'volume_create_manager' (df055331-b68c-400d-ae42-82248cc76c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:40:54 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5f493e1d-c7bd-4f3f-bf18-51168bd46f14 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5122d725-1520-4f8f-84d5-9d3e69304568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:54 devstack sudo[107564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d87c1db1-cf52-4da0-a840-6fc53223e94f
Jul 30 20:40:54 devstack sudo[107564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:54 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-8e183ee8-769f-4578-9f36-66d5f4e5909b tempest-CreateVolumesFromSnapshotTest-1096389075 None] Lock "cinder-quobyte-efae64d4-0356-42c0-8d82-bf512cf6c201" acquired by "delete_snapshot" :: waited 0.066s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:40:54 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-8e183ee8-769f-4578-9f36-66d5f4e5909b tempest-CreateVolumesFromSnapshotTest-1096389075 None] Acquiring lock "cinder-quobyte-72345298-cbcd-4d6e-ad88-78f62729b6f1" by "_delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:40:54 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5f493e1d-c7bd-4f3f-bf18-51168bd46f14 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5122d725-1520-4f8f-84d5-9d3e69304568) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:40:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-883608851',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af1912cc-c88d-4dc0-ba56-9a59f9568468,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6983d31603464c379b9c6e73f72ce88d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:40:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:40:54Z,use_quota=True,user_id='f170331164ef48f7b11711c81bc1a887',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:54 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5f493e1d-c7bd-4f3f-bf18-51168bd46f14 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (868d9362-4c02-4f1a-ae31-3813b06c8881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:54 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5f493e1d-c7bd-4f3f-bf18-51168bd46f14 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (868d9362-4c02-4f1a-ae31-3813b06c8881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:54 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5f493e1d-c7bd-4f3f-bf18-51168bd46f14 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef4ac901-8fe6-4a92-9066-fe021d383fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:54 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5f493e1d-c7bd-4f3f-bf18-51168bd46f14 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef4ac901-8fe6-4a92-9066-fe021d383fe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af1912cc-c88d-4dc0-ba56-9a59f9568468', 'volume_name': 'volume-af1912cc-c88d-4dc0-ba56-9a59f9568468', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:54 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5f493e1d-c7bd-4f3f-bf18-51168bd46f14 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1100409-655d-4ffb-9641-746ee89b8d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:54 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5f493e1d-c7bd-4f3f-bf18-51168bd46f14 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1100409-655d-4ffb-9641-746ee89b8d24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:54 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5f493e1d-c7bd-4f3f-bf18-51168bd46f14 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86686e68-1274-4d73-aa6a-1aa9a803558d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:54 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-5f493e1d-c7bd-4f3f-bf18-51168bd46f14 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Volume af1912cc-c88d-4dc0-ba56-9a59f9568468: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af1912cc-c88d-4dc0-ba56-9a59f9568468', 'volume_size': 1}
Jul 30 20:40:54 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-5f493e1d-c7bd-4f3f-bf18-51168bd46f14 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:40:54 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-8e183ee8-769f-4578-9f36-66d5f4e5909b tempest-CreateVolumesFromSnapshotTest-1096389075 None] Lock "cinder-quobyte-72345298-cbcd-4d6e-ad88-78f62729b6f1" acquired by "_delete_snapshot" :: waited 0.063s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:40:54 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-8e183ee8-769f-4578-9f36-66d5f4e5909b tempest-CreateVolumesFromSnapshotTest-1096389075 None] Deleting offline snapshot 72345298-cbcd-4d6e-ad88-78f62729b6f1 of volume efae64d4-0356-42c0-8d82-bf512cf6c201 {{(pid=88719) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 30 20:40:54 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-8e183ee8-769f-4578-9f36-66d5f4e5909b tempest-CreateVolumesFromSnapshotTest-1096389075 None] snapshot_file for this snap is: volume-efae64d4-0356-42c0-8d82-bf512cf6c201.72345298-cbcd-4d6e-ad88-78f62729b6f1 {{(pid=88719) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 30 20:40:54 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[aea7e072-07d7-4707-94bb-4450b79726dd]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:40:54 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8e183ee8-769f-4578-9f36-66d5f4e5909b tempest-CreateVolumesFromSnapshotTest-1096389075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-efae64d4-0356-42c0-8d82-bf512cf6c201.72345298-cbcd-4d6e-ad88-78f62729b6f1 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:54 devstack sudo[107562]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:54 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-e1f9a96c-2e04-4005-9e0d-e2592a81a7cb tempest-ProjectMemberTests-47051868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d5c1f6b5-206c-4682-b364-83dcbe9f3bd4" returned: 0 in 0.566s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:54 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-e1f9a96c-2e04-4005-9e0d-e2592a81a7cb tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d5c1f6b5-206c-4682-b364-83dcbe9f3bd4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d5c1f6b5-206c-4682-b364-83dcbe9f3bd4.b42ee755-df81-4cac-85b1-3be99a52c88f 1G {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:54 devstack sudo[107570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d5c1f6b5-206c-4682-b364-83dcbe9f3bd4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d5c1f6b5-206c-4682-b364-83dcbe9f3bd4.b42ee755-df81-4cac-85b1-3be99a52c88f 1G
Jul 30 20:40:54 devstack sudo[107570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:54 devstack sudo[107569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-efae64d4-0356-42c0-8d82-bf512cf6c201.72345298-cbcd-4d6e-ad88-78f62729b6f1
Jul 30 20:40:54 devstack sudo[107569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:54 devstack sudo[107564]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:54 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-48a10504-ceae-473c-9545-2faa737df61d tempest-VolumeDependencyTests-326923044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d87c1db1-cf52-4da0-a840-6fc53223e94f" returned: 0 in 0.428s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:54 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-48a10504-ceae-473c-9545-2faa737df61d tempest-VolumeDependencyTests-326923044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d87c1db1-cf52-4da0-a840-6fc53223e94f {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:54 devstack sudo[107576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d87c1db1-cf52-4da0-a840-6fc53223e94f
Jul 30 20:40:54 devstack sudo[107576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:54 devstack sudo[107569]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:54 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8e183ee8-769f-4578-9f36-66d5f4e5909b tempest-CreateVolumesFromSnapshotTest-1096389075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-efae64d4-0356-42c0-8d82-bf512cf6c201.72345298-cbcd-4d6e-ad88-78f62729b6f1" returned: 0 in 0.371s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:54 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-8e183ee8-769f-4578-9f36-66d5f4e5909b tempest-CreateVolumesFromSnapshotTest-1096389075 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-efae64d4-0356-42c0-8d82-bf512cf6c201(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88719) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 30 20:40:54 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[5690345f-5b9b-4ae4-befe-9f60eef9ded9]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:40:54 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8e183ee8-769f-4578-9f36-66d5f4e5909b tempest-CreateVolumesFromSnapshotTest-1096389075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-efae64d4-0356-42c0-8d82-bf512cf6c201 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:54 devstack sudo[107576]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:54 devstack sudo[107570]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:54 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-48a10504-ceae-473c-9545-2faa737df61d tempest-VolumeDependencyTests-326923044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d87c1db1-cf52-4da0-a840-6fc53223e94f" returned: 0 in 0.272s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:55 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-e1f9a96c-2e04-4005-9e0d-e2592a81a7cb tempest-ProjectMemberTests-47051868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d5c1f6b5-206c-4682-b364-83dcbe9f3bd4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d5c1f6b5-206c-4682-b364-83dcbe9f3bd4.b42ee755-df81-4cac-85b1-3be99a52c88f 1G" returned: 0 in 0.440s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:55 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-e1f9a96c-2e04-4005-9e0d-e2592a81a7cb tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d5c1f6b5-206c-4682-b364-83dcbe9f3bd4 -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d5c1f6b5-206c-4682-b364-83dcbe9f3bd4.b42ee755-df81-4cac-85b1-3be99a52c88f {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:55 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-48a10504-ceae-473c-9545-2faa737df61d tempest-VolumeDependencyTests-326923044 None] Lock "cinder-quobyte-d87c1db1-cf52-4da0-a840-6fc53223e94f" released by "delete_volume" :: held 0.785s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:40:55 devstack sudo[107587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d5c1f6b5-206c-4682-b364-83dcbe9f3bd4 -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d5c1f6b5-206c-4682-b364-83dcbe9f3bd4.b42ee755-df81-4cac-85b1-3be99a52c88f
Jul 30 20:40:55 devstack sudo[107587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:55 devstack sudo[107585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-efae64d4-0356-42c0-8d82-bf512cf6c201
Jul 30 20:40:55 devstack sudo[107585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:55 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-48a10504-ceae-473c-9545-2faa737df61d tempest-VolumeDependencyTests-326923044 None] Created reservations ['9509c921-5b41-44cf-9c63-edd217748015', '213ae2aa-e2a7-4b2e-ba30-40f32614bf8a', 'cf7576d1-fae2-4dff-ac60-3fc60d894425', 'ac43e113-f9ff-4a2a-9ae7-5d08d8a5d1a2'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:40:55 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-48a10504-ceae-473c-9545-2faa737df61d tempest-VolumeDependencyTests-326923044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:40:55 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-48a10504-ceae-473c-9545-2faa737df61d tempest-VolumeDependencyTests-326923044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:40:55 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-48a10504-ceae-473c-9545-2faa737df61d tempest-VolumeDependencyTests-326923044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:40:55 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-48a10504-ceae-473c-9545-2faa737df61d tempest-VolumeDependencyTests-326923044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:40:55 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-48a10504-ceae-473c-9545-2faa737df61d tempest-VolumeDependencyTests-326923044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:40:55 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-48a10504-ceae-473c-9545-2faa737df61d tempest-VolumeDependencyTests-326923044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:55 devstack sudo[107591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:40:55 devstack sudo[107591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:55 devstack sudo[107587]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:55 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-e1f9a96c-2e04-4005-9e0d-e2592a81a7cb tempest-ProjectMemberTests-47051868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d5c1f6b5-206c-4682-b364-83dcbe9f3bd4 -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d5c1f6b5-206c-4682-b364-83dcbe9f3bd4.b42ee755-df81-4cac-85b1-3be99a52c88f" returned: 0 in 0.340s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:55 devstack cinder-volume[88719]: WARNING cinder.volume.drivers.remotefs [None req-e1f9a96c-2e04-4005-9e0d-e2592a81a7cb tempest-ProjectMemberTests-47051868 None] /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d5c1f6b5-206c-4682-b364-83dcbe9f3bd4.b42ee755-df81-4cac-85b1-3be99a52c88f is being set with open permissions: ugo+rw
Jul 30 20:40:55 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-e1f9a96c-2e04-4005-9e0d-e2592a81a7cb tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d5c1f6b5-206c-4682-b364-83dcbe9f3bd4.b42ee755-df81-4cac-85b1-3be99a52c88f {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:55 devstack sudo[107585]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:55 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8e183ee8-769f-4578-9f36-66d5f4e5909b tempest-CreateVolumesFromSnapshotTest-1096389075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-efae64d4-0356-42c0-8d82-bf512cf6c201" returned: 0 in 0.425s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:55 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8e183ee8-769f-4578-9f36-66d5f4e5909b tempest-CreateVolumesFromSnapshotTest-1096389075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-efae64d4-0356-42c0-8d82-bf512cf6c201.72345298-cbcd-4d6e-ad88-78f62729b6f1 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:55 devstack sudo[107599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d5c1f6b5-206c-4682-b364-83dcbe9f3bd4.b42ee755-df81-4cac-85b1-3be99a52c88f
Jul 30 20:40:55 devstack sudo[107599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:55 devstack sudo[107601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-efae64d4-0356-42c0-8d82-bf512cf6c201.72345298-cbcd-4d6e-ad88-78f62729b6f1
Jul 30 20:40:55 devstack sudo[107601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:55 devstack sudo[107591]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:55 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-48a10504-ceae-473c-9545-2faa737df61d tempest-VolumeDependencyTests-326923044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.285s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:55 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-48a10504-ceae-473c-9545-2faa737df61d tempest-VolumeDependencyTests-326923044 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:40:55 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-48a10504-ceae-473c-9545-2faa737df61d tempest-VolumeDependencyTests-326923044 None] Deleted volume successfully.
Jul 30 20:40:55 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-48a10504-ceae-473c-9545-2faa737df61d tempest-VolumeDependencyTests-326923044 None] Lock "cinder-d87c1db1-cf52-4da0-a840-6fc53223e94f-delete_volume" released by "delete_volume" :: held 1.381s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:40:55 devstack sudo[107599]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:55 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-e1f9a96c-2e04-4005-9e0d-e2592a81a7cb tempest-ProjectMemberTests-47051868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d5c1f6b5-206c-4682-b364-83dcbe9f3bd4.b42ee755-df81-4cac-85b1-3be99a52c88f" returned: 0 in 0.254s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:55 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-e1f9a96c-2e04-4005-9e0d-e2592a81a7cb tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d5c1f6b5-206c-4682-b364-83dcbe9f3bd4.info {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:55 devstack sudo[107608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d5c1f6b5-206c-4682-b364-83dcbe9f3bd4.info
Jul 30 20:40:55 devstack sudo[107608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:55 devstack sudo[107601]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:55 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8e183ee8-769f-4578-9f36-66d5f4e5909b tempest-CreateVolumesFromSnapshotTest-1096389075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-efae64d4-0356-42c0-8d82-bf512cf6c201.72345298-cbcd-4d6e-ad88-78f62729b6f1" returned: 0 in 0.391s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:55 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8e183ee8-769f-4578-9f36-66d5f4e5909b tempest-CreateVolumesFromSnapshotTest-1096389075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-efae64d4-0356-42c0-8d82-bf512cf6c201.72345298-cbcd-4d6e-ad88-78f62729b6f1 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:55 devstack sudo[107610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-efae64d4-0356-42c0-8d82-bf512cf6c201.72345298-cbcd-4d6e-ad88-78f62729b6f1
Jul 30 20:40:55 devstack sudo[107610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:55 devstack sudo[107608]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:55 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-e1f9a96c-2e04-4005-9e0d-e2592a81a7cb tempest-ProjectMemberTests-47051868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d5c1f6b5-206c-4682-b364-83dcbe9f3bd4.info" returned: 0 in 0.266s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:55 devstack cinder-volume[88719]: WARNING cinder.volume.drivers.remotefs [None req-e1f9a96c-2e04-4005-9e0d-e2592a81a7cb tempest-ProjectMemberTests-47051868 None] /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d5c1f6b5-206c-4682-b364-83dcbe9f3bd4.info is being set with open permissions: ugo+rw
Jul 30 20:40:55 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-e1f9a96c-2e04-4005-9e0d-e2592a81a7cb tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d5c1f6b5-206c-4682-b364-83dcbe9f3bd4.info {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:55 devstack sudo[107613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d5c1f6b5-206c-4682-b364-83dcbe9f3bd4.info
Jul 30 20:40:55 devstack sudo[107613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:56 devstack sudo[107610]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:56 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8e183ee8-769f-4578-9f36-66d5f4e5909b tempest-CreateVolumesFromSnapshotTest-1096389075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-efae64d4-0356-42c0-8d82-bf512cf6c201.72345298-cbcd-4d6e-ad88-78f62729b6f1" returned: 0 in 0.253s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:56 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-8e183ee8-769f-4578-9f36-66d5f4e5909b tempest-CreateVolumesFromSnapshotTest-1096389075 None] Lock "cinder-quobyte-72345298-cbcd-4d6e-ad88-78f62729b6f1" released by "_delete_snapshot" :: held 1.543s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:40:56 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-8e183ee8-769f-4578-9f36-66d5f4e5909b tempest-CreateVolumesFromSnapshotTest-1096389075 None] Lock "cinder-quobyte-efae64d4-0356-42c0-8d82-bf512cf6c201" released by "delete_snapshot" :: held 1.614s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:40:56 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-8e183ee8-769f-4578-9f36-66d5f4e5909b tempest-CreateVolumesFromSnapshotTest-1096389075 None] Created reservations ['c197cf8c-dc80-47ef-aaed-232fb165b6c1', 'b930abce-3bfa-47ed-bdc7-e4740ca5a5d4', '010c1906-93cc-4d62-ad6e-00311b82d4dc', '7d6d6cec-d10d-411c-a5af-4b1f77016506'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:40:56 devstack sudo[107613]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:56 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-e1f9a96c-2e04-4005-9e0d-e2592a81a7cb tempest-ProjectMemberTests-47051868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d5c1f6b5-206c-4682-b364-83dcbe9f3bd4.info" returned: 0 in 0.269s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:56 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-e1f9a96c-2e04-4005-9e0d-e2592a81a7cb tempest-ProjectMemberTests-47051868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.272s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:40:56 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-47a7f88e-5192-4b58-a5ef-333465264b62 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.972s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:40:56 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-47a7f88e-5192-4b58-a5ef-333465264b62 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:40:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2039151371',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f49244d7-8653-4a55-b690-c257921a5250,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6983d31603464c379b9c6e73f72ce88d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:40:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:40:53Z,use_quota=True,user_id='f170331164ef48f7b11711c81bc1a887',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:40:56 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-47a7f88e-5192-4b58-a5ef-333465264b62 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Creating volume f49244d7-8653-4a55-b690-c257921a5250 {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:40:56 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-47a7f88e-5192-4b58-a5ef-333465264b62 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:40:56 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-47a7f88e-5192-4b58-a5ef-333465264b62 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:40:56 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-47a7f88e-5192-4b58-a5ef-333465264b62 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:40:56 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-47a7f88e-5192-4b58-a5ef-333465264b62 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:40:56 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-47a7f88e-5192-4b58-a5ef-333465264b62 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:40:56 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-47a7f88e-5192-4b58-a5ef-333465264b62 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:40:56 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-47a7f88e-5192-4b58-a5ef-333465264b62 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:40:56 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-47a7f88e-5192-4b58-a5ef-333465264b62 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f49244d7-8653-4a55-b690-c257921a5250 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:56 devstack sudo[107617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f49244d7-8653-4a55-b690-c257921a5250 1073741824
Jul 30 20:40:56 devstack sudo[107617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:56 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-e1f9a96c-2e04-4005-9e0d-e2592a81a7cb tempest-ProjectMemberTests-47051868 None] Create snapshot completed successfully
Jul 30 20:40:56 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-8e183ee8-769f-4578-9f36-66d5f4e5909b tempest-CreateVolumesFromSnapshotTest-1096389075 None] Delete snapshot completed successfully.
Jul 30 20:40:56 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-8e183ee8-769f-4578-9f36-66d5f4e5909b tempest-CreateVolumesFromSnapshotTest-1096389075 None] Lock "cinder-72345298-cbcd-4d6e-ad88-78f62729b6f1-delete_snapshot" released by "delete_snapshot" :: held 1.892s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:40:56 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-087a490a-183e-437c-8f36-727cf0a08bb3 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Acquiring lock "cinder-efae64d4-0356-42c0-8d82-bf512cf6c201-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:40:56 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-087a490a-183e-437c-8f36-727cf0a08bb3 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Lock "cinder-efae64d4-0356-42c0-8d82-bf512cf6c201-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:40:56 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-087a490a-183e-437c-8f36-727cf0a08bb3 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Acquiring lock "cinder-quobyte-efae64d4-0356-42c0-8d82-bf512cf6c201" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:40:56 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-087a490a-183e-437c-8f36-727cf0a08bb3 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Lock "cinder-quobyte-efae64d4-0356-42c0-8d82-bf512cf6c201" acquired by "delete_volume" :: waited 0.018s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:40:56 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb21e442-4365-4c89-8076-0192d85eb406]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:40:56 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-087a490a-183e-437c-8f36-727cf0a08bb3 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-efae64d4-0356-42c0-8d82-bf512cf6c201 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:56 devstack sudo[107617]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:56 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-47a7f88e-5192-4b58-a5ef-333465264b62 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f49244d7-8653-4a55-b690-c257921a5250 1073741824" returned: 0 in 0.597s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:56 devstack sudo[107622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-efae64d4-0356-42c0-8d82-bf512cf6c201
Jul 30 20:40:56 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-6dad8b3f-bbba-4c1f-9e55-2efa4b888d26 tempest-ProjectMemberTests-47051868 None] Acquiring lock "cinder-b42ee755-df81-4cac-85b1-3be99a52c88f-delete_snapshot" by "delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:40:56 devstack sudo[107622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:56 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-6dad8b3f-bbba-4c1f-9e55-2efa4b888d26 tempest-ProjectMemberTests-47051868 None] Lock "cinder-b42ee755-df81-4cac-85b1-3be99a52c88f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:40:56 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-6dad8b3f-bbba-4c1f-9e55-2efa4b888d26 tempest-ProjectMemberTests-47051868 None] Acquiring lock "cinder-quobyte-d5c1f6b5-206c-4682-b364-83dcbe9f3bd4" by "delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:40:56 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-47a7f88e-5192-4b58-a5ef-333465264b62 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f49244d7-8653-4a55-b690-c257921a5250 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:56 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-6dad8b3f-bbba-4c1f-9e55-2efa4b888d26 tempest-ProjectMemberTests-47051868 None] Lock "cinder-quobyte-d5c1f6b5-206c-4682-b364-83dcbe9f3bd4" acquired by "delete_snapshot" :: waited 0.037s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:40:56 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-6dad8b3f-bbba-4c1f-9e55-2efa4b888d26 tempest-ProjectMemberTests-47051868 None] Acquiring lock "cinder-quobyte-b42ee755-df81-4cac-85b1-3be99a52c88f" by "_delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:40:56 devstack sudo[107625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f49244d7-8653-4a55-b690-c257921a5250
Jul 30 20:40:56 devstack sudo[107625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:56 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-6dad8b3f-bbba-4c1f-9e55-2efa4b888d26 tempest-ProjectMemberTests-47051868 None] Lock "cinder-quobyte-b42ee755-df81-4cac-85b1-3be99a52c88f" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:40:56 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-6dad8b3f-bbba-4c1f-9e55-2efa4b888d26 tempest-ProjectMemberTests-47051868 None] Deleting offline snapshot b42ee755-df81-4cac-85b1-3be99a52c88f of volume d5c1f6b5-206c-4682-b364-83dcbe9f3bd4 {{(pid=88719) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 30 20:40:56 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-6dad8b3f-bbba-4c1f-9e55-2efa4b888d26 tempest-ProjectMemberTests-47051868 None] snapshot_file for this snap is: volume-d5c1f6b5-206c-4682-b364-83dcbe9f3bd4.b42ee755-df81-4cac-85b1-3be99a52c88f {{(pid=88719) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 30 20:40:56 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbc76cf8-f1d7-426e-ab88-6fa94e7dde42]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:40:56 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-6dad8b3f-bbba-4c1f-9e55-2efa4b888d26 tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d5c1f6b5-206c-4682-b364-83dcbe9f3bd4.b42ee755-df81-4cac-85b1-3be99a52c88f {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:57 devstack sudo[107627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d5c1f6b5-206c-4682-b364-83dcbe9f3bd4.b42ee755-df81-4cac-85b1-3be99a52c88f
Jul 30 20:40:57 devstack sudo[107627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:57 devstack sudo[107622]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:57 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-087a490a-183e-437c-8f36-727cf0a08bb3 tempest-CreateVolumesFromSnapshotTest-1096389075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-efae64d4-0356-42c0-8d82-bf512cf6c201" returned: 0 in 0.443s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:57 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-087a490a-183e-437c-8f36-727cf0a08bb3 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-efae64d4-0356-42c0-8d82-bf512cf6c201 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:57 devstack sudo[107634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-efae64d4-0356-42c0-8d82-bf512cf6c201
Jul 30 20:40:57 devstack sudo[107634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:57 devstack sudo[107625]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:57 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-47a7f88e-5192-4b58-a5ef-333465264b62 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f49244d7-8653-4a55-b690-c257921a5250" returned: 0 in 0.307s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:57 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-47a7f88e-5192-4b58-a5ef-333465264b62 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] <== create_volume: return (975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:40:57 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-47a7f88e-5192-4b58-a5ef-333465264b62 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:40:57 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-b08d92ef-dda2-43a6-88f2-b83109205507 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.492s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:40:57 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-b08d92ef-dda2-43a6-88f2-b83109205507 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:40:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1310504257',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ea40941-2e6b-4a35-ab50-207d97cb9e74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6983d31603464c379b9c6e73f72ce88d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:40:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:40:54Z,use_quota=True,user_id='f170331164ef48f7b11711c81bc1a887',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:40:57 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-b08d92ef-dda2-43a6-88f2-b83109205507 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Creating volume 8ea40941-2e6b-4a35-ab50-207d97cb9e74 {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:40:57 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-b08d92ef-dda2-43a6-88f2-b83109205507 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:40:57 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-b08d92ef-dda2-43a6-88f2-b83109205507 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:40:57 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-b08d92ef-dda2-43a6-88f2-b83109205507 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:40:57 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-b08d92ef-dda2-43a6-88f2-b83109205507 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:40:57 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-b08d92ef-dda2-43a6-88f2-b83109205507 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:40:57 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-b08d92ef-dda2-43a6-88f2-b83109205507 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:40:57 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-b08d92ef-dda2-43a6-88f2-b83109205507 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:40:57 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-b08d92ef-dda2-43a6-88f2-b83109205507 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-8ea40941-2e6b-4a35-ab50-207d97cb9e74 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:57 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-47a7f88e-5192-4b58-a5ef-333465264b62 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7372b205-9be4-48b2-8dbf-96fb755a9372) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f49244d7-8653-4a55-b690-c257921a5250', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:57 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-47a7f88e-5192-4b58-a5ef-333465264b62 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f3c5541-02ac-4d30-836e-962c04925f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:57 devstack sudo[107636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-8ea40941-2e6b-4a35-ab50-207d97cb9e74 1073741824
Jul 30 20:40:57 devstack sudo[107636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:57 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-47a7f88e-5192-4b58-a5ef-333465264b62 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Volume volume-f49244d7-8653-4a55-b690-c257921a5250 (f49244d7-8653-4a55-b690-c257921a5250): created successfully
Jul 30 20:40:57 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-47a7f88e-5192-4b58-a5ef-333465264b62 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f3c5541-02ac-4d30-836e-962c04925f88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:57 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-47a7f88e-5192-4b58-a5ef-333465264b62 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Flow 'volume_create_manager' (214ff0a2-9591-4437-b3cb-2124297a2a9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:40:57 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-47a7f88e-5192-4b58-a5ef-333465264b62 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Created volume successfully.
Jul 30 20:40:57 devstack sudo[107634]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:57 devstack sudo[107627]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:57 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-087a490a-183e-437c-8f36-727cf0a08bb3 tempest-CreateVolumesFromSnapshotTest-1096389075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-efae64d4-0356-42c0-8d82-bf512cf6c201" returned: 0 in 0.382s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:57 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-6dad8b3f-bbba-4c1f-9e55-2efa4b888d26 tempest-ProjectMemberTests-47051868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d5c1f6b5-206c-4682-b364-83dcbe9f3bd4.b42ee755-df81-4cac-85b1-3be99a52c88f" returned: 0 in 0.568s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:57 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-6dad8b3f-bbba-4c1f-9e55-2efa4b888d26 tempest-ProjectMemberTests-47051868 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d5c1f6b5-206c-4682-b364-83dcbe9f3bd4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88719) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 30 20:40:57 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-087a490a-183e-437c-8f36-727cf0a08bb3 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Lock "cinder-quobyte-efae64d4-0356-42c0-8d82-bf512cf6c201" released by "delete_volume" :: held 0.927s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:40:57 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[33559a46-c0d7-4f36-9b7f-6f14bd44e789]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:40:57 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-6dad8b3f-bbba-4c1f-9e55-2efa4b888d26 tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d5c1f6b5-206c-4682-b364-83dcbe9f3bd4 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:57 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-087a490a-183e-437c-8f36-727cf0a08bb3 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Created reservations ['1ca364fc-f08f-4d96-a327-e15acbbcd4df', 'be87ced8-0f8d-4b12-8cde-4123b11819df', 'e42d40e1-f56a-4110-a999-aba872512b74', '5507d795-c5ae-430a-b2e0-79341a3cbb29'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:40:57 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-087a490a-183e-437c-8f36-727cf0a08bb3 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:40:57 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-087a490a-183e-437c-8f36-727cf0a08bb3 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:40:57 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-087a490a-183e-437c-8f36-727cf0a08bb3 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:40:57 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-087a490a-183e-437c-8f36-727cf0a08bb3 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:40:57 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-087a490a-183e-437c-8f36-727cf0a08bb3 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:40:57 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-087a490a-183e-437c-8f36-727cf0a08bb3 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:57 devstack sudo[107647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:40:57 devstack sudo[107647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:57 devstack sudo[107644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d5c1f6b5-206c-4682-b364-83dcbe9f3bd4
Jul 30 20:40:57 devstack sudo[107644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:57 devstack sudo[107636]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:57 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-b08d92ef-dda2-43a6-88f2-b83109205507 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-8ea40941-2e6b-4a35-ab50-207d97cb9e74 1073741824" returned: 0 in 0.698s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:57 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-b08d92ef-dda2-43a6-88f2-b83109205507 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-8ea40941-2e6b-4a35-ab50-207d97cb9e74 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:58 devstack sudo[107650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-8ea40941-2e6b-4a35-ab50-207d97cb9e74
Jul 30 20:40:58 devstack sudo[107650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:58 devstack sudo[107647]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-087a490a-183e-437c-8f36-727cf0a08bb3 tempest-CreateVolumesFromSnapshotTest-1096389075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.386s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:58 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-087a490a-183e-437c-8f36-727cf0a08bb3 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:40:58 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-087a490a-183e-437c-8f36-727cf0a08bb3 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Deleted volume successfully.
Jul 30 20:40:58 devstack sudo[107644]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-6dad8b3f-bbba-4c1f-9e55-2efa4b888d26 tempest-ProjectMemberTests-47051868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d5c1f6b5-206c-4682-b364-83dcbe9f3bd4" returned: 0 in 0.591s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-6dad8b3f-bbba-4c1f-9e55-2efa4b888d26 tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d5c1f6b5-206c-4682-b364-83dcbe9f3bd4.b42ee755-df81-4cac-85b1-3be99a52c88f {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:58 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-087a490a-183e-437c-8f36-727cf0a08bb3 tempest-CreateVolumesFromSnapshotTest-1096389075 None] Lock "cinder-efae64d4-0356-42c0-8d82-bf512cf6c201-delete_volume" released by "delete_volume" :: held 1.641s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:40:58 devstack sudo[107656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d5c1f6b5-206c-4682-b364-83dcbe9f3bd4.b42ee755-df81-4cac-85b1-3be99a52c88f
Jul 30 20:40:58 devstack sudo[107656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:58 devstack sudo[107650]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-b08d92ef-dda2-43a6-88f2-b83109205507 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-8ea40941-2e6b-4a35-ab50-207d97cb9e74" returned: 0 in 0.359s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:58 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-b08d92ef-dda2-43a6-88f2-b83109205507 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] <== create_volume: return (1137ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:40:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-b08d92ef-dda2-43a6-88f2-b83109205507 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.142s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:40:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-5300427b-9ba5-46d2-8950-69ada17c8c6d tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.169s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:40:58 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-5300427b-9ba5-46d2-8950-69ada17c8c6d tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:40:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-359756437',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50c56d0e-fd32-4ff8-84a7-f5cb3499780e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6983d31603464c379b9c6e73f72ce88d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:40:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:40:54Z,use_quota=True,user_id='f170331164ef48f7b11711c81bc1a887',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:40:58 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-5300427b-9ba5-46d2-8950-69ada17c8c6d tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Creating volume 50c56d0e-fd32-4ff8-84a7-f5cb3499780e {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:40:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-5300427b-9ba5-46d2-8950-69ada17c8c6d tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:40:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-5300427b-9ba5-46d2-8950-69ada17c8c6d tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:40:58 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-5300427b-9ba5-46d2-8950-69ada17c8c6d tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:40:58 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-5300427b-9ba5-46d2-8950-69ada17c8c6d tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:40:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-5300427b-9ba5-46d2-8950-69ada17c8c6d tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:40:58 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-5300427b-9ba5-46d2-8950-69ada17c8c6d tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:40:58 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-5300427b-9ba5-46d2-8950-69ada17c8c6d tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:40:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-5300427b-9ba5-46d2-8950-69ada17c8c6d tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-50c56d0e-fd32-4ff8-84a7-f5cb3499780e 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:58 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-b08d92ef-dda2-43a6-88f2-b83109205507 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1459feac-2bef-4d1f-8ce8-83eec2e2b404) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ea40941-2e6b-4a35-ab50-207d97cb9e74', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:58 devstack sudo[107659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-50c56d0e-fd32-4ff8-84a7-f5cb3499780e 1073741824
Jul 30 20:40:58 devstack sudo[107659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:58 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-b08d92ef-dda2-43a6-88f2-b83109205507 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (083a1158-bc89-4b7e-bb02-6706016090b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:58 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-b08d92ef-dda2-43a6-88f2-b83109205507 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Volume volume-8ea40941-2e6b-4a35-ab50-207d97cb9e74 (8ea40941-2e6b-4a35-ab50-207d97cb9e74): created successfully
Jul 30 20:40:58 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-b08d92ef-dda2-43a6-88f2-b83109205507 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (083a1158-bc89-4b7e-bb02-6706016090b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:58 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-b08d92ef-dda2-43a6-88f2-b83109205507 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Flow 'volume_create_manager' (0b87a606-5826-4ebc-97be-9ff4bdfe47d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:40:58 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-b08d92ef-dda2-43a6-88f2-b83109205507 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Created volume successfully.
Jul 30 20:40:58 devstack sudo[107656]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-6dad8b3f-bbba-4c1f-9e55-2efa4b888d26 tempest-ProjectMemberTests-47051868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d5c1f6b5-206c-4682-b364-83dcbe9f3bd4.b42ee755-df81-4cac-85b1-3be99a52c88f" returned: 0 in 0.460s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-6dad8b3f-bbba-4c1f-9e55-2efa4b888d26 tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d5c1f6b5-206c-4682-b364-83dcbe9f3bd4.b42ee755-df81-4cac-85b1-3be99a52c88f {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:58 devstack sudo[107666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d5c1f6b5-206c-4682-b364-83dcbe9f3bd4.b42ee755-df81-4cac-85b1-3be99a52c88f
Jul 30 20:40:58 devstack sudo[107666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:58 devstack sudo[107659]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-5300427b-9ba5-46d2-8950-69ada17c8c6d tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-50c56d0e-fd32-4ff8-84a7-f5cb3499780e 1073741824" returned: 0 in 0.637s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:58 devstack sudo[107666]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:59 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-6dad8b3f-bbba-4c1f-9e55-2efa4b888d26 tempest-ProjectMemberTests-47051868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d5c1f6b5-206c-4682-b364-83dcbe9f3bd4.b42ee755-df81-4cac-85b1-3be99a52c88f" returned: 0 in 0.376s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:59 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-6dad8b3f-bbba-4c1f-9e55-2efa4b888d26 tempest-ProjectMemberTests-47051868 None] Lock "cinder-quobyte-b42ee755-df81-4cac-85b1-3be99a52c88f" released by "_delete_snapshot" :: held 2.143s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:40:59 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-5300427b-9ba5-46d2-8950-69ada17c8c6d tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-50c56d0e-fd32-4ff8-84a7-f5cb3499780e {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:59 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-6dad8b3f-bbba-4c1f-9e55-2efa4b888d26 tempest-ProjectMemberTests-47051868 None] Lock "cinder-quobyte-d5c1f6b5-206c-4682-b364-83dcbe9f3bd4" released by "delete_snapshot" :: held 2.200s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:40:59 devstack sudo[107672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-50c56d0e-fd32-4ff8-84a7-f5cb3499780e
Jul 30 20:40:59 devstack sudo[107672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:59 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-6dad8b3f-bbba-4c1f-9e55-2efa4b888d26 tempest-ProjectMemberTests-47051868 None] Created reservations ['ec21a1af-a920-44d4-8239-a1efede73507', 'c88e8578-a48e-40e3-94d9-9ab6d712fc6d', '69e47c09-efd6-41ee-9162-f6dc885cf627', '54d34822-d182-4d8d-9adc-90cb7a69254c'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:40:59 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-6dad8b3f-bbba-4c1f-9e55-2efa4b888d26 tempest-ProjectMemberTests-47051868 None] Delete snapshot completed successfully.
Jul 30 20:40:59 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-6dad8b3f-bbba-4c1f-9e55-2efa4b888d26 tempest-ProjectMemberTests-47051868 None] Lock "cinder-b42ee755-df81-4cac-85b1-3be99a52c88f-delete_snapshot" released by "delete_snapshot" :: held 2.479s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:40:59 devstack sudo[107672]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:59 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-5300427b-9ba5-46d2-8950-69ada17c8c6d tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-50c56d0e-fd32-4ff8-84a7-f5cb3499780e" returned: 0 in 0.401s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:40:59 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-5300427b-9ba5-46d2-8950-69ada17c8c6d tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] <== create_volume: return (1136ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:40:59 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-5300427b-9ba5-46d2-8950-69ada17c8c6d tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.142s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:40:59 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-5f493e1d-c7bd-4f3f-bf18-51168bd46f14 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.976s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:40:59 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-5f493e1d-c7bd-4f3f-bf18-51168bd46f14 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:40:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-883608851',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af1912cc-c88d-4dc0-ba56-9a59f9568468,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6983d31603464c379b9c6e73f72ce88d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:40:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:40:54Z,use_quota=True,user_id='f170331164ef48f7b11711c81bc1a887',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:40:59 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-5f493e1d-c7bd-4f3f-bf18-51168bd46f14 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Creating volume af1912cc-c88d-4dc0-ba56-9a59f9568468 {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:40:59 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-5f493e1d-c7bd-4f3f-bf18-51168bd46f14 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:40:59 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-5f493e1d-c7bd-4f3f-bf18-51168bd46f14 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:40:59 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-5f493e1d-c7bd-4f3f-bf18-51168bd46f14 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:40:59 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-5f493e1d-c7bd-4f3f-bf18-51168bd46f14 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:40:59 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-5f493e1d-c7bd-4f3f-bf18-51168bd46f14 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:40:59 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-5f493e1d-c7bd-4f3f-bf18-51168bd46f14 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:40:59 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-5f493e1d-c7bd-4f3f-bf18-51168bd46f14 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:40:59 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-5f493e1d-c7bd-4f3f-bf18-51168bd46f14 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-af1912cc-c88d-4dc0-ba56-9a59f9568468 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:40:59 devstack sudo[107675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-af1912cc-c88d-4dc0-ba56-9a59f9568468 1073741824
Jul 30 20:40:59 devstack sudo[107675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:40:59 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5300427b-9ba5-46d2-8950-69ada17c8c6d tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82207e4e-0b75-426e-8a3a-fff0d84c79f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50c56d0e-fd32-4ff8-84a7-f5cb3499780e', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:59 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5300427b-9ba5-46d2-8950-69ada17c8c6d tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58b36b62-9dbf-4055-b727-6c3361099055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:40:59 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-5300427b-9ba5-46d2-8950-69ada17c8c6d tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Volume volume-50c56d0e-fd32-4ff8-84a7-f5cb3499780e (50c56d0e-fd32-4ff8-84a7-f5cb3499780e): created successfully
Jul 30 20:40:59 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5300427b-9ba5-46d2-8950-69ada17c8c6d tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58b36b62-9dbf-4055-b727-6c3361099055) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:40:59 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5300427b-9ba5-46d2-8950-69ada17c8c6d tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Flow 'volume_create_manager' (b1e9d4e1-9eee-4424-9e44-99276e41179e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:40:59 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-5300427b-9ba5-46d2-8950-69ada17c8c6d tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Created volume successfully.
Jul 30 20:40:59 devstack sudo[107675]: pam_unix(sudo:session): session closed for user root
Jul 30 20:40:59 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-5f493e1d-c7bd-4f3f-bf18-51168bd46f14 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-af1912cc-c88d-4dc0-ba56-9a59f9568468 1073741824" returned: 0 in 0.493s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:00 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-5f493e1d-c7bd-4f3f-bf18-51168bd46f14 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-af1912cc-c88d-4dc0-ba56-9a59f9568468 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:00 devstack sudo[107681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-af1912cc-c88d-4dc0-ba56-9a59f9568468
Jul 30 20:41:00 devstack sudo[107681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:00 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-16685157-3161-437f-9a3a-91f8d7b52b17 tempest-ProjectMemberTests-47051868 None] Acquiring lock "cinder-d5c1f6b5-206c-4682-b364-83dcbe9f3bd4-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:41:00 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-16685157-3161-437f-9a3a-91f8d7b52b17 tempest-ProjectMemberTests-47051868 None] Lock "cinder-d5c1f6b5-206c-4682-b364-83dcbe9f3bd4-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:41:00 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-16685157-3161-437f-9a3a-91f8d7b52b17 tempest-ProjectMemberTests-47051868 None] Acquiring lock "cinder-quobyte-d5c1f6b5-206c-4682-b364-83dcbe9f3bd4" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:41:00 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-16685157-3161-437f-9a3a-91f8d7b52b17 tempest-ProjectMemberTests-47051868 None] Lock "cinder-quobyte-d5c1f6b5-206c-4682-b364-83dcbe9f3bd4" acquired by "delete_volume" :: waited 0.027s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:41:00 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[c73c1816-0255-47ed-bac2-9aa9ce92f599]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:41:00 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-16685157-3161-437f-9a3a-91f8d7b52b17 tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d5c1f6b5-206c-4682-b364-83dcbe9f3bd4 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:00 devstack sudo[107681]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:00 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-5f493e1d-c7bd-4f3f-bf18-51168bd46f14 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-af1912cc-c88d-4dc0-ba56-9a59f9568468" returned: 0 in 0.334s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:00 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-5f493e1d-c7bd-4f3f-bf18-51168bd46f14 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:41:00 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-5f493e1d-c7bd-4f3f-bf18-51168bd46f14 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:41:00 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5f493e1d-c7bd-4f3f-bf18-51168bd46f14 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86686e68-1274-4d73-aa6a-1aa9a803558d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af1912cc-c88d-4dc0-ba56-9a59f9568468', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:41:00 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5f493e1d-c7bd-4f3f-bf18-51168bd46f14 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (482fdeb4-ed08-448b-ad91-6d67280af54d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:41:00 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-5f493e1d-c7bd-4f3f-bf18-51168bd46f14 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Volume volume-af1912cc-c88d-4dc0-ba56-9a59f9568468 (af1912cc-c88d-4dc0-ba56-9a59f9568468): created successfully
Jul 30 20:41:00 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5f493e1d-c7bd-4f3f-bf18-51168bd46f14 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (482fdeb4-ed08-448b-ad91-6d67280af54d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:41:00 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5f493e1d-c7bd-4f3f-bf18-51168bd46f14 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Flow 'volume_create_manager' (df055331-b68c-400d-ae42-82248cc76c75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:41:00 devstack sudo[107684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d5c1f6b5-206c-4682-b364-83dcbe9f3bd4
Jul 30 20:41:00 devstack sudo[107684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:00 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-5f493e1d-c7bd-4f3f-bf18-51168bd46f14 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Created volume successfully.
Jul 30 20:41:00 devstack sudo[107684]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:00 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-16685157-3161-437f-9a3a-91f8d7b52b17 tempest-ProjectMemberTests-47051868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d5c1f6b5-206c-4682-b364-83dcbe9f3bd4" returned: 0 in 0.417s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:00 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-16685157-3161-437f-9a3a-91f8d7b52b17 tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d5c1f6b5-206c-4682-b364-83dcbe9f3bd4 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:00 devstack sudo[107689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d5c1f6b5-206c-4682-b364-83dcbe9f3bd4
Jul 30 20:41:00 devstack sudo[107689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:01 devstack sudo[107689]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:01 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-16685157-3161-437f-9a3a-91f8d7b52b17 tempest-ProjectMemberTests-47051868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-d5c1f6b5-206c-4682-b364-83dcbe9f3bd4" returned: 0 in 0.304s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:01 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-16685157-3161-437f-9a3a-91f8d7b52b17 tempest-ProjectMemberTests-47051868 None] Lock "cinder-quobyte-d5c1f6b5-206c-4682-b364-83dcbe9f3bd4" released by "delete_volume" :: held 0.795s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:41:01 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-564e7c9d-b72a-4736-8077-201ef6ac7494 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Acquiring lock "cinder-af1912cc-c88d-4dc0-ba56-9a59f9568468-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:41:01 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-16685157-3161-437f-9a3a-91f8d7b52b17 tempest-ProjectMemberTests-47051868 None] Created reservations ['dc65335b-6ee4-4a41-87e2-fdca7d781148', 'f1873862-9c98-4121-93c4-191aa42e2ef2', 'c79e4f1a-a257-4b30-935b-38998f4b58e2', 'b569c197-01f1-4498-bd81-33fd0bdc1097'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:41:01 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-564e7c9d-b72a-4736-8077-201ef6ac7494 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Lock "cinder-af1912cc-c88d-4dc0-ba56-9a59f9568468-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:41:01 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-564e7c9d-b72a-4736-8077-201ef6ac7494 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Acquiring lock "cinder-quobyte-af1912cc-c88d-4dc0-ba56-9a59f9568468" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:41:01 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-564e7c9d-b72a-4736-8077-201ef6ac7494 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Lock "cinder-quobyte-af1912cc-c88d-4dc0-ba56-9a59f9568468" acquired by "delete_volume" :: waited 0.032s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:41:01 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[01b41087-fbe8-4629-8343-749c2bd5d1b1]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:41:01 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-564e7c9d-b72a-4736-8077-201ef6ac7494 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-af1912cc-c88d-4dc0-ba56-9a59f9568468 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:01 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-16685157-3161-437f-9a3a-91f8d7b52b17 tempest-ProjectMemberTests-47051868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:41:01 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-16685157-3161-437f-9a3a-91f8d7b52b17 tempest-ProjectMemberTests-47051868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:41:01 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-16685157-3161-437f-9a3a-91f8d7b52b17 tempest-ProjectMemberTests-47051868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:41:01 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-16685157-3161-437f-9a3a-91f8d7b52b17 tempest-ProjectMemberTests-47051868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:41:01 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-16685157-3161-437f-9a3a-91f8d7b52b17 tempest-ProjectMemberTests-47051868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:41:01 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-16685157-3161-437f-9a3a-91f8d7b52b17 tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:01 devstack sudo[107693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:41:01 devstack sudo[107693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:01 devstack sudo[107692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-af1912cc-c88d-4dc0-ba56-9a59f9568468
Jul 30 20:41:01 devstack sudo[107692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:01 devstack sudo[107693]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:01 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-16685157-3161-437f-9a3a-91f8d7b52b17 tempest-ProjectMemberTests-47051868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.351s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:01 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-16685157-3161-437f-9a3a-91f8d7b52b17 tempest-ProjectMemberTests-47051868 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:41:01 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-16685157-3161-437f-9a3a-91f8d7b52b17 tempest-ProjectMemberTests-47051868 None] Deleted volume successfully.
Jul 30 20:41:01 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-16685157-3161-437f-9a3a-91f8d7b52b17 tempest-ProjectMemberTests-47051868 None] Lock "cinder-d5c1f6b5-206c-4682-b364-83dcbe9f3bd4-delete_volume" released by "delete_volume" :: held 1.576s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:41:01 devstack sudo[107692]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:01 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-564e7c9d-b72a-4736-8077-201ef6ac7494 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-af1912cc-c88d-4dc0-ba56-9a59f9568468" returned: 0 in 0.521s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:01 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-564e7c9d-b72a-4736-8077-201ef6ac7494 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-af1912cc-c88d-4dc0-ba56-9a59f9568468 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:01 devstack sudo[107700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-af1912cc-c88d-4dc0-ba56-9a59f9568468
Jul 30 20:41:01 devstack sudo[107700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:02 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-de151a5d-0b58-4f32-8618-026d8d4c92cc tempest-ProjectMemberTests-47051868 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:41:02 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-de151a5d-0b58-4f32-8618-026d8d4c92cc tempest-ProjectMemberTests-47051868 None] Flow 'volume_create_manager' (83f082bf-d7fd-4a8a-b48c-82ed2f64b236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:41:02 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-de151a5d-0b58-4f32-8618-026d8d4c92cc tempest-ProjectMemberTests-47051868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a0929b6-4818-4f59-899a-925c6641d259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:41:02 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-de151a5d-0b58-4f32-8618-026d8d4c92cc tempest-ProjectMemberTests-47051868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a0929b6-4818-4f59-899a-925c6641d259) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:41:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1991400299',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d92a0d0-76bf-4965-b6b5-d0522bb44f01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c483f66aa6ec477e9cb0547f0f04f6d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:41:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:41:02Z,use_quota=True,user_id='59a41c24b76545b79b09f90cd8c36728',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:41:02 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-de151a5d-0b58-4f32-8618-026d8d4c92cc tempest-ProjectMemberTests-47051868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a15f40fc-0062-4e3a-93df-29c840e2d397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:41:02 devstack sudo[107700]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:02 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-de151a5d-0b58-4f32-8618-026d8d4c92cc tempest-ProjectMemberTests-47051868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a15f40fc-0062-4e3a-93df-29c840e2d397) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:41:02 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-de151a5d-0b58-4f32-8618-026d8d4c92cc tempest-ProjectMemberTests-47051868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e481c126-db11-46b8-a54a-0dd51a4ed33d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:41:02 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-de151a5d-0b58-4f32-8618-026d8d4c92cc tempest-ProjectMemberTests-47051868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e481c126-db11-46b8-a54a-0dd51a4ed33d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d92a0d0-76bf-4965-b6b5-d0522bb44f01', 'volume_name': 'volume-2d92a0d0-76bf-4965-b6b5-d0522bb44f01', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:41:02 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-de151a5d-0b58-4f32-8618-026d8d4c92cc tempest-ProjectMemberTests-47051868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7660ff95-8338-4734-b247-53144f349a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:41:02 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-de151a5d-0b58-4f32-8618-026d8d4c92cc tempest-ProjectMemberTests-47051868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7660ff95-8338-4734-b247-53144f349a93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:41:02 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-de151a5d-0b58-4f32-8618-026d8d4c92cc tempest-ProjectMemberTests-47051868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5c05c9c-0e1b-4405-b171-91a100d4f59e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:41:02 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-de151a5d-0b58-4f32-8618-026d8d4c92cc tempest-ProjectMemberTests-47051868 None] Volume 2d92a0d0-76bf-4965-b6b5-d0522bb44f01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d92a0d0-76bf-4965-b6b5-d0522bb44f01', 'volume_size': 1}
Jul 30 20:41:02 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-de151a5d-0b58-4f32-8618-026d8d4c92cc tempest-ProjectMemberTests-47051868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:41:02 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-de151a5d-0b58-4f32-8618-026d8d4c92cc tempest-ProjectMemberTests-47051868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:41:02 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-de151a5d-0b58-4f32-8618-026d8d4c92cc tempest-ProjectMemberTests-47051868 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:41:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1991400299',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d92a0d0-76bf-4965-b6b5-d0522bb44f01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c483f66aa6ec477e9cb0547f0f04f6d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:41:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:41:02Z,use_quota=True,user_id='59a41c24b76545b79b09f90cd8c36728',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:41:02 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-de151a5d-0b58-4f32-8618-026d8d4c92cc tempest-ProjectMemberTests-47051868 None] Creating volume 2d92a0d0-76bf-4965-b6b5-d0522bb44f01 {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:41:02 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-de151a5d-0b58-4f32-8618-026d8d4c92cc tempest-ProjectMemberTests-47051868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:41:02 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-de151a5d-0b58-4f32-8618-026d8d4c92cc tempest-ProjectMemberTests-47051868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:41:02 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-de151a5d-0b58-4f32-8618-026d8d4c92cc tempest-ProjectMemberTests-47051868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:41:02 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-de151a5d-0b58-4f32-8618-026d8d4c92cc tempest-ProjectMemberTests-47051868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:41:02 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-de151a5d-0b58-4f32-8618-026d8d4c92cc tempest-ProjectMemberTests-47051868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:41:02 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-de151a5d-0b58-4f32-8618-026d8d4c92cc tempest-ProjectMemberTests-47051868 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:41:02 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-de151a5d-0b58-4f32-8618-026d8d4c92cc tempest-ProjectMemberTests-47051868 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:41:02 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-de151a5d-0b58-4f32-8618-026d8d4c92cc tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2d92a0d0-76bf-4965-b6b5-d0522bb44f01 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:02 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-564e7c9d-b72a-4736-8077-201ef6ac7494 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-af1912cc-c88d-4dc0-ba56-9a59f9568468" returned: 0 in 0.378s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:02 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-564e7c9d-b72a-4736-8077-201ef6ac7494 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Lock "cinder-quobyte-af1912cc-c88d-4dc0-ba56-9a59f9568468" released by "delete_volume" :: held 0.970s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:41:02 devstack sudo[107703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2d92a0d0-76bf-4965-b6b5-d0522bb44f01 1073741824
Jul 30 20:41:02 devstack sudo[107703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:02 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-564e7c9d-b72a-4736-8077-201ef6ac7494 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Created reservations ['19dc3fbb-0f81-4262-be17-2d73dd0cadcd', 'd484f270-cf6e-41cc-90d7-10c5c9b3cfe0', '3d2ee2e0-bb57-4219-b962-e79d0b13750a', '7d6c5e46-3b60-4b2a-8c2b-bfc7d47b4bbb'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:41:02 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-564e7c9d-b72a-4736-8077-201ef6ac7494 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:41:02 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-564e7c9d-b72a-4736-8077-201ef6ac7494 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:41:02 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-564e7c9d-b72a-4736-8077-201ef6ac7494 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:41:02 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-564e7c9d-b72a-4736-8077-201ef6ac7494 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:41:02 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-564e7c9d-b72a-4736-8077-201ef6ac7494 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:41:02 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-564e7c9d-b72a-4736-8077-201ef6ac7494 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:02 devstack sudo[107705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:41:02 devstack sudo[107705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:02 devstack sudo[107705]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:02 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-564e7c9d-b72a-4736-8077-201ef6ac7494 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.343s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:02 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-564e7c9d-b72a-4736-8077-201ef6ac7494 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:41:02 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-564e7c9d-b72a-4736-8077-201ef6ac7494 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Deleted volume successfully.
Jul 30 20:41:02 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-564e7c9d-b72a-4736-8077-201ef6ac7494 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Lock "cinder-af1912cc-c88d-4dc0-ba56-9a59f9568468-delete_volume" released by "delete_volume" :: held 1.582s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:41:02 devstack sudo[107703]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:02 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-de151a5d-0b58-4f32-8618-026d8d4c92cc tempest-ProjectMemberTests-47051868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2d92a0d0-76bf-4965-b6b5-d0522bb44f01 1073741824" returned: 0 in 0.654s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:02 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-de151a5d-0b58-4f32-8618-026d8d4c92cc tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2d92a0d0-76bf-4965-b6b5-d0522bb44f01 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:02 devstack sudo[107712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2d92a0d0-76bf-4965-b6b5-d0522bb44f01
Jul 30 20:41:02 devstack sudo[107712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:03 devstack sudo[107712]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:03 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-de151a5d-0b58-4f32-8618-026d8d4c92cc tempest-ProjectMemberTests-47051868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2d92a0d0-76bf-4965-b6b5-d0522bb44f01" returned: 0 in 0.314s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:03 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-de151a5d-0b58-4f32-8618-026d8d4c92cc tempest-ProjectMemberTests-47051868 None] <== create_volume: return (1027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:41:03 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-de151a5d-0b58-4f32-8618-026d8d4c92cc tempest-ProjectMemberTests-47051868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.029s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:41:03 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-de151a5d-0b58-4f32-8618-026d8d4c92cc tempest-ProjectMemberTests-47051868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5c05c9c-0e1b-4405-b171-91a100d4f59e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d92a0d0-76bf-4965-b6b5-d0522bb44f01', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:41:03 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-de151a5d-0b58-4f32-8618-026d8d4c92cc tempest-ProjectMemberTests-47051868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54472b27-c6fd-4643-8664-35e6d3d9cf60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:41:03 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-de151a5d-0b58-4f32-8618-026d8d4c92cc tempest-ProjectMemberTests-47051868 None] Volume volume-2d92a0d0-76bf-4965-b6b5-d0522bb44f01 (2d92a0d0-76bf-4965-b6b5-d0522bb44f01): created successfully
Jul 30 20:41:03 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-de151a5d-0b58-4f32-8618-026d8d4c92cc tempest-ProjectMemberTests-47051868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54472b27-c6fd-4643-8664-35e6d3d9cf60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:41:03 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-de151a5d-0b58-4f32-8618-026d8d4c92cc tempest-ProjectMemberTests-47051868 None] Flow 'volume_create_manager' (83f082bf-d7fd-4a8a-b48c-82ed2f64b236) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:41:03 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-de151a5d-0b58-4f32-8618-026d8d4c92cc tempest-ProjectMemberTests-47051868 None] Created volume successfully.
Jul 30 20:41:03 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcc65e01-a159-4f0c-8fbc-0e4957592400 tempest-VolumeImageDependencyTests-428084070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:41:03 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-dcc65e01-a159-4f0c-8fbc-0e4957592400 tempest-VolumeImageDependencyTests-428084070 None] Flow 'volume_create_manager' (a1f8f489-7e1d-4cf2-ae7a-9692a8bb1d7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:41:03 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-dcc65e01-a159-4f0c-8fbc-0e4957592400 tempest-VolumeImageDependencyTests-428084070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91ae2085-1493-4e89-be7b-f422d7c9d4ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:41:03 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-2657c2ec-e58a-4d33-9646-12c0c4861da1 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Acquiring lock "cinder-50c56d0e-fd32-4ff8-84a7-f5cb3499780e-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:41:03 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-dcc65e01-a159-4f0c-8fbc-0e4957592400 tempest-VolumeImageDependencyTests-428084070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91ae2085-1493-4e89-be7b-f422d7c9d4ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:41:03Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54f7bc6a-e4db-461a-8ddc-6f52190a3003,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf71d7a900d54744875e537d04fe15df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:41:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:41:03Z,use_quota=True,user_id='844f404d10d542da9720615783683ebe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:41:03 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-dcc65e01-a159-4f0c-8fbc-0e4957592400 tempest-VolumeImageDependencyTests-428084070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5720fa39-84cd-473b-b306-28df3391f2e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:41:03 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-dcc65e01-a159-4f0c-8fbc-0e4957592400 tempest-VolumeImageDependencyTests-428084070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5720fa39-84cd-473b-b306-28df3391f2e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:41:03 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-dcc65e01-a159-4f0c-8fbc-0e4957592400 tempest-VolumeImageDependencyTests-428084070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (926a970d-a78a-4134-b21b-ac8e04908e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:41:03 devstack cinder-volume[88719]: DEBUG cinder.image.glance [None req-dcc65e01-a159-4f0c-8fbc-0e4957592400 tempest-VolumeImageDependencyTests-428084070 None] Creating Keystone auth plugin from conf {{(pid=88719) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 30 20:41:03 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-2657c2ec-e58a-4d33-9646-12c0c4861da1 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Lock "cinder-50c56d0e-fd32-4ff8-84a7-f5cb3499780e-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:41:03 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-2657c2ec-e58a-4d33-9646-12c0c4861da1 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Acquiring lock "cinder-quobyte-50c56d0e-fd32-4ff8-84a7-f5cb3499780e" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:41:03 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-2657c2ec-e58a-4d33-9646-12c0c4861da1 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Lock "cinder-quobyte-50c56d0e-fd32-4ff8-84a7-f5cb3499780e" acquired by "delete_volume" :: waited 0.018s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:41:03 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[79227297-0a06-4f31-b572-4213ae65f5a8]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:41:03 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2657c2ec-e58a-4d33-9646-12c0c4861da1 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-50c56d0e-fd32-4ff8-84a7-f5cb3499780e {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:03 devstack sudo[107715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-50c56d0e-fd32-4ff8-84a7-f5cb3499780e
Jul 30 20:41:03 devstack sudo[107715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:03 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-dcc65e01-a159-4f0c-8fbc-0e4957592400 tempest-VolumeImageDependencyTests-428084070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (926a970d-a78a-4134-b21b-ac8e04908e87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '54f7bc6a-e4db-461a-8ddc-6f52190a3003', 'volume_name': 'volume-54f7bc6a-e4db-461a-8ddc-6f52190a3003', 'volume_size': 1, 'image_id': '09098a86-00d2-4b44-b9f8-980dc2ca280e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/09098a86-00d2-4b44-b9f8-980dc2ca280e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'dc6a3fe7be28bbdac22d66e725287b2e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cf71d7a900d54744875e537d04fe15df', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6d0aac245c2f37bfcebd3f62927abe455ce9c40f7903d7d9caec4553edec3e41a941c74801619bfaa1564d237163357d9ca32b116a56d093d5a262fbb2d79d56', 'id': '09098a86-00d2-4b44-b9f8-980dc2ca280e', 'created_at': datetime.datetime(2026, 7, 30, 18, 41, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 18, 41, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/09098a86-00d2-4b44-b9f8-980dc2ca280e/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7868848b35f0>}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:41:03 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-dcc65e01-a159-4f0c-8fbc-0e4957592400 tempest-VolumeImageDependencyTests-428084070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9bb26bf-4af4-4634-8122-ae837f963440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:41:03 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-dcc65e01-a159-4f0c-8fbc-0e4957592400 tempest-VolumeImageDependencyTests-428084070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9bb26bf-4af4-4634-8122-ae837f963440) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:41:03 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-dcc65e01-a159-4f0c-8fbc-0e4957592400 tempest-VolumeImageDependencyTests-428084070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6c66141-28c7-4785-a9b9-960d25624aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:41:03 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-dcc65e01-a159-4f0c-8fbc-0e4957592400 tempest-VolumeImageDependencyTests-428084070 None] Volume 54f7bc6a-e4db-461a-8ddc-6f52190a3003: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-54f7bc6a-e4db-461a-8ddc-6f52190a3003', 'volume_size': 1, 'image_id': '09098a86-00d2-4b44-b9f8-980dc2ca280e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/09098a86-00d2-4b44-b9f8-980dc2ca280e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'dc6a3fe7be28bbdac22d66e725287b2e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cf71d7a900d54744875e537d04fe15df', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6d0aac245c2f37bfcebd3f62927abe455ce9c40f7903d7d9caec4553edec3e41a941c74801619bfaa1564d237163357d9ca32b116a56d093d5a262fbb2d79d56', 'id': '09098a86-00d2-4b44-b9f8-980dc2ca280e', 'created_at': datetime.datetime(2026, 7, 30, 18, 41, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 18, 41, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/09098a86-00d2-4b44-b9f8-980dc2ca280e/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7868848b35f0>}
Jul 30 20:41:03 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcc65e01-a159-4f0c-8fbc-0e4957592400 tempest-VolumeImageDependencyTests-428084070 None] Trying to clone 54f7bc6a-e4db-461a-8ddc-6f52190a3003 from image 09098a86-00d2-4b44-b9f8-980dc2ca280e at location (None, [{'url': 'file:///opt/stack/data/glance/images/09098a86-00d2-4b44-b9f8-980dc2ca280e', 'metadata': {}}]). {{(pid=88719) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 30 20:41:04 devstack sudo[107715]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:04 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2657c2ec-e58a-4d33-9646-12c0c4861da1 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-50c56d0e-fd32-4ff8-84a7-f5cb3499780e" returned: 0 in 0.420s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:04 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2657c2ec-e58a-4d33-9646-12c0c4861da1 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-50c56d0e-fd32-4ff8-84a7-f5cb3499780e {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:04 devstack sudo[107720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-50c56d0e-fd32-4ff8-84a7-f5cb3499780e
Jul 30 20:41:04 devstack sudo[107720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:04 devstack cinder-volume[88719]: DEBUG cinder.image.image_utils [None req-dcc65e01-a159-4f0c-8fbc-0e4957592400 tempest-VolumeImageDependencyTests-428084070 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_09098a86-00d2-4b44-b9f8-980dc2ca280e_5s6ps85rdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88719) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 30 20:41:04 devstack cinder-volume[88719]: INFO cinder.image.image_utils [None req-dcc65e01-a159-4f0c-8fbc-0e4957592400 tempest-VolumeImageDependencyTests-428084070 None] Image download 0.00 MB at 0.00 MB/s
Jul 30 20:41:04 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fe8daba-1378-4c79-8b38-710c5fcc2eec]: (4, 'raw') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:41:04 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-dcc65e01-a159-4f0c-8fbc-0e4957592400 tempest-VolumeImageDependencyTests-428084070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_09098a86-00d2-4b44-b9f8-980dc2ca280e_5s6ps85rdevstack@QuobyteHD {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:04 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-c131cfb4-20a1-4a79-bba9-430d5a697e8f tempest-ProjectMemberTests-47051868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:41:04 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-c131cfb4-20a1-4a79-bba9-430d5a697e8f tempest-ProjectMemberTests-47051868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:41:04 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-c131cfb4-20a1-4a79-bba9-430d5a697e8f tempest-ProjectMemberTests-47051868 None] Creating offline snapshot f9cfe9df-279d-4e5d-a5e4-89398504fb69 of volume 2d92a0d0-76bf-4965-b6b5-d0522bb44f01 {{(pid=88719) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 30 20:41:04 devstack sudo[107720]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:04 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2657c2ec-e58a-4d33-9646-12c0c4861da1 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-50c56d0e-fd32-4ff8-84a7-f5cb3499780e" returned: 0 in 0.370s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:04 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f99adc2-f04b-4bf9-8325-84b7b434a436]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:41:04 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-c131cfb4-20a1-4a79-bba9-430d5a697e8f tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2d92a0d0-76bf-4965-b6b5-d0522bb44f01 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:04 devstack sudo[107722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_09098a86-00d2-4b44-b9f8-980dc2ca280e_5s6ps85rdevstack@QuobyteHD
Jul 30 20:41:04 devstack sudo[107722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:04 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-2657c2ec-e58a-4d33-9646-12c0c4861da1 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Lock "cinder-quobyte-50c56d0e-fd32-4ff8-84a7-f5cb3499780e" released by "delete_volume" :: held 0.876s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:41:04 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-2657c2ec-e58a-4d33-9646-12c0c4861da1 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Created reservations ['52bc926d-b1fa-4af0-b7c5-92c7c947e44a', '67c35ac3-4f3e-4895-8c13-a4fe4ef8fe1d', '1a466b3c-1503-4233-b4eb-6c934b894204', '8bd249ae-e8ff-4941-b765-e7c892a7bb6d'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:41:04 devstack sudo[107724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2d92a0d0-76bf-4965-b6b5-d0522bb44f01
Jul 30 20:41:04 devstack sudo[107724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:04 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-2657c2ec-e58a-4d33-9646-12c0c4861da1 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:41:04 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-2657c2ec-e58a-4d33-9646-12c0c4861da1 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:41:04 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-2657c2ec-e58a-4d33-9646-12c0c4861da1 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:41:04 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-2657c2ec-e58a-4d33-9646-12c0c4861da1 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:41:04 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-2657c2ec-e58a-4d33-9646-12c0c4861da1 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:41:04 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2657c2ec-e58a-4d33-9646-12c0c4861da1 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:04 devstack sudo[107729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:41:04 devstack sudo[107729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:04 devstack sudo[107722]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:04 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-dcc65e01-a159-4f0c-8fbc-0e4957592400 tempest-VolumeImageDependencyTests-428084070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_09098a86-00d2-4b44-b9f8-980dc2ca280e_5s6ps85rdevstack@QuobyteHD" returned: 0 in 0.507s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:04 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-dcc65e01-a159-4f0c-8fbc-0e4957592400 tempest-VolumeImageDependencyTests-428084070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_09098a86-00d2-4b44-b9f8-980dc2ca280e_5s6ps85rdevstack@QuobyteHD {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:04 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-4a0a1b8b-1c3e-4b20-a2a6-9a70d51e1b50 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Acquiring lock "cinder-8ea40941-2e6b-4a35-ab50-207d97cb9e74-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:41:04 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-4a0a1b8b-1c3e-4b20-a2a6-9a70d51e1b50 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Lock "cinder-8ea40941-2e6b-4a35-ab50-207d97cb9e74-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:41:04 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-4a0a1b8b-1c3e-4b20-a2a6-9a70d51e1b50 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Acquiring lock "cinder-quobyte-8ea40941-2e6b-4a35-ab50-207d97cb9e74" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:41:04 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-4a0a1b8b-1c3e-4b20-a2a6-9a70d51e1b50 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Lock "cinder-quobyte-8ea40941-2e6b-4a35-ab50-207d97cb9e74" acquired by "delete_volume" :: waited 0.023s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:41:04 devstack sudo[107745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_09098a86-00d2-4b44-b9f8-980dc2ca280e_5s6ps85rdevstack@QuobyteHD
Jul 30 20:41:04 devstack sudo[107745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:04 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[4994f5eb-beb9-4846-a88c-e3c9ef775ed0]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:41:04 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-4a0a1b8b-1c3e-4b20-a2a6-9a70d51e1b50 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-8ea40941-2e6b-4a35-ab50-207d97cb9e74 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:04 devstack sudo[107724]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:04 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-c131cfb4-20a1-4a79-bba9-430d5a697e8f tempest-ProjectMemberTests-47051868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2d92a0d0-76bf-4965-b6b5-d0522bb44f01" returned: 0 in 0.569s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:04 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-c131cfb4-20a1-4a79-bba9-430d5a697e8f tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2d92a0d0-76bf-4965-b6b5-d0522bb44f01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2d92a0d0-76bf-4965-b6b5-d0522bb44f01.f9cfe9df-279d-4e5d-a5e4-89398504fb69 1G {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:05 devstack sudo[107772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2d92a0d0-76bf-4965-b6b5-d0522bb44f01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2d92a0d0-76bf-4965-b6b5-d0522bb44f01.f9cfe9df-279d-4e5d-a5e4-89398504fb69 1G
Jul 30 20:41:05 devstack sudo[107772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:05 devstack sudo[107729]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:05 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2657c2ec-e58a-4d33-9646-12c0c4861da1 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.425s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:05 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-2657c2ec-e58a-4d33-9646-12c0c4861da1 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:41:05 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-2657c2ec-e58a-4d33-9646-12c0c4861da1 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Deleted volume successfully.
Jul 30 20:41:05 devstack sudo[107770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-8ea40941-2e6b-4a35-ab50-207d97cb9e74
Jul 30 20:41:05 devstack sudo[107770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:05 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-2657c2ec-e58a-4d33-9646-12c0c4861da1 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Lock "cinder-50c56d0e-fd32-4ff8-84a7-f5cb3499780e-delete_volume" released by "delete_volume" :: held 1.625s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:41:05 devstack sudo[107745]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:05 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-dcc65e01-a159-4f0c-8fbc-0e4957592400 tempest-VolumeImageDependencyTests-428084070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_09098a86-00d2-4b44-b9f8-980dc2ca280e_5s6ps85rdevstack@QuobyteHD" returned: 1 in 0.570s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:05 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-dcc65e01-a159-4f0c-8fbc-0e4957592400 tempest-VolumeImageDependencyTests-428084070 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_09098a86-00d2-4b44-b9f8-980dc2ca280e_5s6ps85rdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 30 20:41:05 devstack cinder-volume[88719]: DEBUG cinder.image.image_utils [None req-dcc65e01-a159-4f0c-8fbc-0e4957592400 tempest-VolumeImageDependencyTests-428084070 None] Temporary image 09098a86-00d2-4b44-b9f8-980dc2ca280e is fetched for user 844f404d10d542da9720615783683ebe. {{(pid=88719) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 30 20:41:05 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[04c609d7-13a3-4721-a8ff-f8102bb962c3]: (4, 'raw') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:41:05 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-dcc65e01-a159-4f0c-8fbc-0e4957592400 tempest-VolumeImageDependencyTests-428084070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_09098a86-00d2-4b44-b9f8-980dc2ca280e_5s6ps85rdevstack@QuobyteHD {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:05 devstack sudo[107770]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:05 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-4a0a1b8b-1c3e-4b20-a2a6-9a70d51e1b50 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-8ea40941-2e6b-4a35-ab50-207d97cb9e74" returned: 0 in 0.548s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:05 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-4a0a1b8b-1c3e-4b20-a2a6-9a70d51e1b50 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-8ea40941-2e6b-4a35-ab50-207d97cb9e74 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:05 devstack sudo[107788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-8ea40941-2e6b-4a35-ab50-207d97cb9e74
Jul 30 20:41:05 devstack sudo[107788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:05 devstack sudo[107787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_09098a86-00d2-4b44-b9f8-980dc2ca280e_5s6ps85rdevstack@QuobyteHD
Jul 30 20:41:05 devstack sudo[107787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:05 devstack sudo[107772]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:05 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-c131cfb4-20a1-4a79-bba9-430d5a697e8f tempest-ProjectMemberTests-47051868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2d92a0d0-76bf-4965-b6b5-d0522bb44f01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2d92a0d0-76bf-4965-b6b5-d0522bb44f01.f9cfe9df-279d-4e5d-a5e4-89398504fb69 1G" returned: 0 in 0.681s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:05 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-c131cfb4-20a1-4a79-bba9-430d5a697e8f tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d92a0d0-76bf-4965-b6b5-d0522bb44f01 -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2d92a0d0-76bf-4965-b6b5-d0522bb44f01.f9cfe9df-279d-4e5d-a5e4-89398504fb69 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:05 devstack sudo[107791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d92a0d0-76bf-4965-b6b5-d0522bb44f01 -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2d92a0d0-76bf-4965-b6b5-d0522bb44f01.f9cfe9df-279d-4e5d-a5e4-89398504fb69
Jul 30 20:41:05 devstack sudo[107791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:05 devstack sudo[107788]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:05 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-4a0a1b8b-1c3e-4b20-a2a6-9a70d51e1b50 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-8ea40941-2e6b-4a35-ab50-207d97cb9e74" returned: 0 in 0.347s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:05 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-4a0a1b8b-1c3e-4b20-a2a6-9a70d51e1b50 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Lock "cinder-quobyte-8ea40941-2e6b-4a35-ab50-207d97cb9e74" released by "delete_volume" :: held 0.978s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:41:05 devstack sudo[107787]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:05 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-dcc65e01-a159-4f0c-8fbc-0e4957592400 tempest-VolumeImageDependencyTests-428084070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_09098a86-00d2-4b44-b9f8-980dc2ca280e_5s6ps85rdevstack@QuobyteHD" returned: 0 in 0.458s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:05 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-dcc65e01-a159-4f0c-8fbc-0e4957592400 tempest-VolumeImageDependencyTests-428084070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_09098a86-00d2-4b44-b9f8-980dc2ca280e_5s6ps85rdevstack@QuobyteHD {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:05 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-4a0a1b8b-1c3e-4b20-a2a6-9a70d51e1b50 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Created reservations ['1ed6ede0-1cf0-4d85-90cf-02984bca118d', '3d21166f-82fc-423e-8f1d-7613b38715a4', '90c5f4b5-8a3a-49aa-8694-ff7c3ca50621', '50c31128-d681-414f-a1a9-492964702eca'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:41:06 devstack sudo[107791]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:06 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-c131cfb4-20a1-4a79-bba9-430d5a697e8f tempest-ProjectMemberTests-47051868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d92a0d0-76bf-4965-b6b5-d0522bb44f01 -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2d92a0d0-76bf-4965-b6b5-d0522bb44f01.f9cfe9df-279d-4e5d-a5e4-89398504fb69" returned: 0 in 0.415s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:06 devstack cinder-volume[88719]: WARNING cinder.volume.drivers.remotefs [None req-c131cfb4-20a1-4a79-bba9-430d5a697e8f tempest-ProjectMemberTests-47051868 None] /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2d92a0d0-76bf-4965-b6b5-d0522bb44f01.f9cfe9df-279d-4e5d-a5e4-89398504fb69 is being set with open permissions: ugo+rw
Jul 30 20:41:06 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-c131cfb4-20a1-4a79-bba9-430d5a697e8f tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2d92a0d0-76bf-4965-b6b5-d0522bb44f01.f9cfe9df-279d-4e5d-a5e4-89398504fb69 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:06 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-4a0a1b8b-1c3e-4b20-a2a6-9a70d51e1b50 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:41:06 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-4a0a1b8b-1c3e-4b20-a2a6-9a70d51e1b50 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:41:06 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-4a0a1b8b-1c3e-4b20-a2a6-9a70d51e1b50 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:41:06 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-4a0a1b8b-1c3e-4b20-a2a6-9a70d51e1b50 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:41:06 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-4a0a1b8b-1c3e-4b20-a2a6-9a70d51e1b50 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:41:06 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-4a0a1b8b-1c3e-4b20-a2a6-9a70d51e1b50 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:06 devstack sudo[107801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2d92a0d0-76bf-4965-b6b5-d0522bb44f01.f9cfe9df-279d-4e5d-a5e4-89398504fb69
Jul 30 20:41:06 devstack sudo[107801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:06 devstack sudo[107797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_09098a86-00d2-4b44-b9f8-980dc2ca280e_5s6ps85rdevstack@QuobyteHD
Jul 30 20:41:06 devstack sudo[107797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:06 devstack sudo[107802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:41:06 devstack sudo[107802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:06 devstack sudo[107801]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:06 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-c131cfb4-20a1-4a79-bba9-430d5a697e8f tempest-ProjectMemberTests-47051868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2d92a0d0-76bf-4965-b6b5-d0522bb44f01.f9cfe9df-279d-4e5d-a5e4-89398504fb69" returned: 0 in 0.362s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:06 devstack sudo[107802]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:06 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-4a0a1b8b-1c3e-4b20-a2a6-9a70d51e1b50 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.343s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:06 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-4a0a1b8b-1c3e-4b20-a2a6-9a70d51e1b50 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:41:06 devstack sudo[107797]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:06 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-4a0a1b8b-1c3e-4b20-a2a6-9a70d51e1b50 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Deleted volume successfully.
Jul 30 20:41:06 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-dcc65e01-a159-4f0c-8fbc-0e4957592400 tempest-VolumeImageDependencyTests-428084070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_09098a86-00d2-4b44-b9f8-980dc2ca280e_5s6ps85rdevstack@QuobyteHD" returned: 1 in 0.563s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:06 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-dcc65e01-a159-4f0c-8fbc-0e4957592400 tempest-VolumeImageDependencyTests-428084070 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_09098a86-00d2-4b44-b9f8-980dc2ca280e_5s6ps85rdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 30 20:41:06 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-dcc65e01-a159-4f0c-8fbc-0e4957592400 tempest-VolumeImageDependencyTests-428084070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:41:06 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-c131cfb4-20a1-4a79-bba9-430d5a697e8f tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2d92a0d0-76bf-4965-b6b5-d0522bb44f01.info {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:06 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-4a0a1b8b-1c3e-4b20-a2a6-9a70d51e1b50 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Lock "cinder-8ea40941-2e6b-4a35-ab50-207d97cb9e74-delete_volume" released by "delete_volume" :: held 1.747s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:41:06 devstack sudo[107811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2d92a0d0-76bf-4965-b6b5-d0522bb44f01.info
Jul 30 20:41:06 devstack sudo[107811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:06 devstack sudo[107811]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:06 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-c131cfb4-20a1-4a79-bba9-430d5a697e8f tempest-ProjectMemberTests-47051868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2d92a0d0-76bf-4965-b6b5-d0522bb44f01.info" returned: 0 in 0.268s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:06 devstack cinder-volume[88719]: WARNING cinder.volume.drivers.remotefs [None req-c131cfb4-20a1-4a79-bba9-430d5a697e8f tempest-ProjectMemberTests-47051868 None] /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2d92a0d0-76bf-4965-b6b5-d0522bb44f01.info is being set with open permissions: ugo+rw
Jul 30 20:41:06 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-c131cfb4-20a1-4a79-bba9-430d5a697e8f tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2d92a0d0-76bf-4965-b6b5-d0522bb44f01.info {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:06 devstack sudo[107814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2d92a0d0-76bf-4965-b6b5-d0522bb44f01.info
Jul 30 20:41:06 devstack sudo[107814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:07 devstack sudo[107814]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:07 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-955ef653-2382-495a-b465-2cad6238fb5e tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Acquiring lock "cinder-f49244d7-8653-4a55-b690-c257921a5250-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:41:07 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-c131cfb4-20a1-4a79-bba9-430d5a697e8f tempest-ProjectMemberTests-47051868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2d92a0d0-76bf-4965-b6b5-d0522bb44f01.info" returned: 0 in 0.271s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:07 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-c131cfb4-20a1-4a79-bba9-430d5a697e8f tempest-ProjectMemberTests-47051868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.725s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:41:07 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-dcc65e01-a159-4f0c-8fbc-0e4957592400 tempest-VolumeImageDependencyTests-428084070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.593s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:41:07 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-dcc65e01-a159-4f0c-8fbc-0e4957592400 tempest-VolumeImageDependencyTests-428084070 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:41:03Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54f7bc6a-e4db-461a-8ddc-6f52190a3003,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf71d7a900d54744875e537d04fe15df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:41:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:41:03Z,use_quota=True,user_id='844f404d10d542da9720615783683ebe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:41:07 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-dcc65e01-a159-4f0c-8fbc-0e4957592400 tempest-VolumeImageDependencyTests-428084070 None] Creating volume 54f7bc6a-e4db-461a-8ddc-6f52190a3003 {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:41:07 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-dcc65e01-a159-4f0c-8fbc-0e4957592400 tempest-VolumeImageDependencyTests-428084070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:41:07 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-dcc65e01-a159-4f0c-8fbc-0e4957592400 tempest-VolumeImageDependencyTests-428084070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:41:07 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-dcc65e01-a159-4f0c-8fbc-0e4957592400 tempest-VolumeImageDependencyTests-428084070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:41:07 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-dcc65e01-a159-4f0c-8fbc-0e4957592400 tempest-VolumeImageDependencyTests-428084070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:41:07 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-dcc65e01-a159-4f0c-8fbc-0e4957592400 tempest-VolumeImageDependencyTests-428084070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:41:07 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-dcc65e01-a159-4f0c-8fbc-0e4957592400 tempest-VolumeImageDependencyTests-428084070 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:41:07 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-dcc65e01-a159-4f0c-8fbc-0e4957592400 tempest-VolumeImageDependencyTests-428084070 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:41:07 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-dcc65e01-a159-4f0c-8fbc-0e4957592400 tempest-VolumeImageDependencyTests-428084070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-54f7bc6a-e4db-461a-8ddc-6f52190a3003 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:07 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-955ef653-2382-495a-b465-2cad6238fb5e tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Lock "cinder-f49244d7-8653-4a55-b690-c257921a5250-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:41:07 devstack sudo[107817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-54f7bc6a-e4db-461a-8ddc-6f52190a3003 1073741824
Jul 30 20:41:07 devstack sudo[107817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:07 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-c131cfb4-20a1-4a79-bba9-430d5a697e8f tempest-ProjectMemberTests-47051868 None] Create snapshot completed successfully
Jul 30 20:41:07 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-955ef653-2382-495a-b465-2cad6238fb5e tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Acquiring lock "cinder-quobyte-f49244d7-8653-4a55-b690-c257921a5250" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:41:07 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-955ef653-2382-495a-b465-2cad6238fb5e tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Lock "cinder-quobyte-f49244d7-8653-4a55-b690-c257921a5250" acquired by "delete_volume" :: waited 0.022s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:41:07 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec0b8156-0e74-42ff-bf93-76012eccc813]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:41:07 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-955ef653-2382-495a-b465-2cad6238fb5e tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f49244d7-8653-4a55-b690-c257921a5250 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:07 devstack sudo[107822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f49244d7-8653-4a55-b690-c257921a5250
Jul 30 20:41:07 devstack sudo[107822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:07 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-d5ec4a21-9d1d-4f2a-b502-597612594ecc tempest-ProjectMemberTests-47051868 None] Acquiring lock "cinder-f9cfe9df-279d-4e5d-a5e4-89398504fb69-delete_snapshot" by "delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:41:07 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-d5ec4a21-9d1d-4f2a-b502-597612594ecc tempest-ProjectMemberTests-47051868 None] Lock "cinder-f9cfe9df-279d-4e5d-a5e4-89398504fb69-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:41:07 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-d5ec4a21-9d1d-4f2a-b502-597612594ecc tempest-ProjectMemberTests-47051868 None] Acquiring lock "cinder-quobyte-2d92a0d0-76bf-4965-b6b5-d0522bb44f01" by "delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:41:07 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-d5ec4a21-9d1d-4f2a-b502-597612594ecc tempest-ProjectMemberTests-47051868 None] Lock "cinder-quobyte-2d92a0d0-76bf-4965-b6b5-d0522bb44f01" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:41:07 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-d5ec4a21-9d1d-4f2a-b502-597612594ecc tempest-ProjectMemberTests-47051868 None] Acquiring lock "cinder-quobyte-f9cfe9df-279d-4e5d-a5e4-89398504fb69" by "_delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:41:07 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-d5ec4a21-9d1d-4f2a-b502-597612594ecc tempest-ProjectMemberTests-47051868 None] Lock "cinder-quobyte-f9cfe9df-279d-4e5d-a5e4-89398504fb69" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:41:07 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-d5ec4a21-9d1d-4f2a-b502-597612594ecc tempest-ProjectMemberTests-47051868 None] Deleting offline snapshot f9cfe9df-279d-4e5d-a5e4-89398504fb69 of volume 2d92a0d0-76bf-4965-b6b5-d0522bb44f01 {{(pid=88719) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 30 20:41:07 devstack sudo[107817]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:07 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-d5ec4a21-9d1d-4f2a-b502-597612594ecc tempest-ProjectMemberTests-47051868 None] snapshot_file for this snap is: volume-2d92a0d0-76bf-4965-b6b5-d0522bb44f01.f9cfe9df-279d-4e5d-a5e4-89398504fb69 {{(pid=88719) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 30 20:41:07 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-dcc65e01-a159-4f0c-8fbc-0e4957592400 tempest-VolumeImageDependencyTests-428084070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-54f7bc6a-e4db-461a-8ddc-6f52190a3003 1073741824" returned: 0 in 0.617s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:07 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[647b4e77-97bb-4c39-b875-f95a7bebdcbf]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:41:07 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-d5ec4a21-9d1d-4f2a-b502-597612594ecc tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2d92a0d0-76bf-4965-b6b5-d0522bb44f01.f9cfe9df-279d-4e5d-a5e4-89398504fb69 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:07 devstack sudo[107822]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:07 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-955ef653-2382-495a-b465-2cad6238fb5e tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f49244d7-8653-4a55-b690-c257921a5250" returned: 0 in 0.517s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:07 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-955ef653-2382-495a-b465-2cad6238fb5e tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f49244d7-8653-4a55-b690-c257921a5250 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:07 devstack sudo[107835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f49244d7-8653-4a55-b690-c257921a5250
Jul 30 20:41:07 devstack sudo[107835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:07 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-dcc65e01-a159-4f0c-8fbc-0e4957592400 tempest-VolumeImageDependencyTests-428084070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-54f7bc6a-e4db-461a-8ddc-6f52190a3003 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:07 devstack sudo[107837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-54f7bc6a-e4db-461a-8ddc-6f52190a3003
Jul 30 20:41:07 devstack sudo[107837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:07 devstack sudo[107834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2d92a0d0-76bf-4965-b6b5-d0522bb44f01.f9cfe9df-279d-4e5d-a5e4-89398504fb69
Jul 30 20:41:07 devstack sudo[107834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:08 devstack sudo[107835]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:08 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-955ef653-2382-495a-b465-2cad6238fb5e tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f49244d7-8653-4a55-b690-c257921a5250" returned: 0 in 0.284s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:08 devstack sudo[107837]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:08 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-955ef653-2382-495a-b465-2cad6238fb5e tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Lock "cinder-quobyte-f49244d7-8653-4a55-b690-c257921a5250" released by "delete_volume" :: held 0.865s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:41:08 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-dcc65e01-a159-4f0c-8fbc-0e4957592400 tempest-VolumeImageDependencyTests-428084070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-54f7bc6a-e4db-461a-8ddc-6f52190a3003" returned: 0 in 0.274s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:08 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-dcc65e01-a159-4f0c-8fbc-0e4957592400 tempest-VolumeImageDependencyTests-428084070 None] <== create_volume: return (982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:41:08 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-dcc65e01-a159-4f0c-8fbc-0e4957592400 tempest-VolumeImageDependencyTests-428084070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:41:08 devstack cinder-volume[88719]: DEBUG cinder.volume.volume_utils [None req-dcc65e01-a159-4f0c-8fbc-0e4957592400 tempest-VolumeImageDependencyTests-428084070 None] Attempting download of 09098a86-00d2-4b44-b9f8-980dc2ca280e ((None, [{'url': 'file:///opt/stack/data/glance/images/09098a86-00d2-4b44-b9f8-980dc2ca280e', 'metadata': {}}])) to volume 54f7bc6a-e4db-461a-8ddc-6f52190a3003. {{(pid=88719) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 30 20:41:08 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-955ef653-2382-495a-b465-2cad6238fb5e tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Created reservations ['9ad29e24-3b0e-46df-a6aa-5463cbbc44dd', '2a3f9e8e-853c-4ab3-94d2-79b41343ea98', '28573114-287b-44fe-a593-9b9ac1717683', '2db17ff2-595e-48c3-847d-567299a01d2f'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:41:08 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[a776b661-0383-4293-9167-42610d58295a]: (4, 'raw') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:41:08 devstack sudo[107834]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:08 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-dcc65e01-a159-4f0c-8fbc-0e4957592400 tempest-VolumeImageDependencyTests-428084070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_09098a86-00d2-4b44-b9f8-980dc2ca280e_3rxenp9s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:08 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-d5ec4a21-9d1d-4f2a-b502-597612594ecc tempest-ProjectMemberTests-47051868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2d92a0d0-76bf-4965-b6b5-d0522bb44f01.f9cfe9df-279d-4e5d-a5e4-89398504fb69" returned: 0 in 0.480s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:08 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-d5ec4a21-9d1d-4f2a-b502-597612594ecc tempest-ProjectMemberTests-47051868 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2d92a0d0-76bf-4965-b6b5-d0522bb44f01(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88719) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 30 20:41:08 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[787e98ca-9ff9-4c25-9435-499c7369cc14]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:41:08 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-d5ec4a21-9d1d-4f2a-b502-597612594ecc tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2d92a0d0-76bf-4965-b6b5-d0522bb44f01 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:08 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-955ef653-2382-495a-b465-2cad6238fb5e tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:41:08 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-955ef653-2382-495a-b465-2cad6238fb5e tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:41:08 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-955ef653-2382-495a-b465-2cad6238fb5e tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:41:08 devstack sudo[107845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_09098a86-00d2-4b44-b9f8-980dc2ca280e_3rxenp9s
Jul 30 20:41:08 devstack sudo[107845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:08 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-955ef653-2382-495a-b465-2cad6238fb5e tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:41:08 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-955ef653-2382-495a-b465-2cad6238fb5e tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:41:08 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-955ef653-2382-495a-b465-2cad6238fb5e tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:08 devstack sudo[107848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:41:08 devstack sudo[107848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:08 devstack sudo[107846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2d92a0d0-76bf-4965-b6b5-d0522bb44f01
Jul 30 20:41:08 devstack sudo[107846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:08 devstack sudo[107845]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:08 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-dcc65e01-a159-4f0c-8fbc-0e4957592400 tempest-VolumeImageDependencyTests-428084070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_09098a86-00d2-4b44-b9f8-980dc2ca280e_3rxenp9s" returned: 0 in 0.377s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:08 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-dcc65e01-a159-4f0c-8fbc-0e4957592400 tempest-VolumeImageDependencyTests-428084070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_09098a86-00d2-4b44-b9f8-980dc2ca280e_3rxenp9s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:08 devstack sudo[107848]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:08 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-955ef653-2382-495a-b465-2cad6238fb5e tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.278s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:08 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-955ef653-2382-495a-b465-2cad6238fb5e tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:41:08 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-955ef653-2382-495a-b465-2cad6238fb5e tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Deleted volume successfully.
Jul 30 20:41:08 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-955ef653-2382-495a-b465-2cad6238fb5e tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Lock "cinder-f49244d7-8653-4a55-b690-c257921a5250-delete_volume" released by "delete_volume" :: held 1.530s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:41:08 devstack sudo[107846]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:08 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-d5ec4a21-9d1d-4f2a-b502-597612594ecc tempest-ProjectMemberTests-47051868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2d92a0d0-76bf-4965-b6b5-d0522bb44f01" returned: 0 in 0.451s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:08 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-d5ec4a21-9d1d-4f2a-b502-597612594ecc tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2d92a0d0-76bf-4965-b6b5-d0522bb44f01.f9cfe9df-279d-4e5d-a5e4-89398504fb69 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:08 devstack sudo[107854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_09098a86-00d2-4b44-b9f8-980dc2ca280e_3rxenp9s
Jul 30 20:41:08 devstack sudo[107854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:08 devstack sudo[107858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2d92a0d0-76bf-4965-b6b5-d0522bb44f01.f9cfe9df-279d-4e5d-a5e4-89398504fb69
Jul 30 20:41:08 devstack sudo[107858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:08 devstack sudo[107854]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:08 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-dcc65e01-a159-4f0c-8fbc-0e4957592400 tempest-VolumeImageDependencyTests-428084070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_09098a86-00d2-4b44-b9f8-980dc2ca280e_3rxenp9s" returned: 1 in 0.349s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:08 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-dcc65e01-a159-4f0c-8fbc-0e4957592400 tempest-VolumeImageDependencyTests-428084070 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_09098a86-00d2-4b44-b9f8-980dc2ca280e_3rxenp9s' failed. Not Retrying. {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 30 20:41:08 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[c16b59a9-8527-4ddf-aa42-f811ba6fbfe5]: (4, 'raw') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:41:08 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-dcc65e01-a159-4f0c-8fbc-0e4957592400 tempest-VolumeImageDependencyTests-428084070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_09098a86-00d2-4b44-b9f8-980dc2ca280e_5s6ps85rdevstack@QuobyteHD {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:09 devstack sudo[107858]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:09 devstack sudo[107865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_09098a86-00d2-4b44-b9f8-980dc2ca280e_5s6ps85rdevstack@QuobyteHD
Jul 30 20:41:09 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-d5ec4a21-9d1d-4f2a-b502-597612594ecc tempest-ProjectMemberTests-47051868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2d92a0d0-76bf-4965-b6b5-d0522bb44f01.f9cfe9df-279d-4e5d-a5e4-89398504fb69" returned: 0 in 0.347s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:09 devstack sudo[107865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:09 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-d5ec4a21-9d1d-4f2a-b502-597612594ecc tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2d92a0d0-76bf-4965-b6b5-d0522bb44f01.f9cfe9df-279d-4e5d-a5e4-89398504fb69 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:09 devstack sudo[107868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2d92a0d0-76bf-4965-b6b5-d0522bb44f01.f9cfe9df-279d-4e5d-a5e4-89398504fb69
Jul 30 20:41:09 devstack sudo[107868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:09 devstack sudo[107865]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:09 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-dcc65e01-a159-4f0c-8fbc-0e4957592400 tempest-VolumeImageDependencyTests-428084070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_09098a86-00d2-4b44-b9f8-980dc2ca280e_5s6ps85rdevstack@QuobyteHD" returned: 0 in 0.347s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:09 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-dcc65e01-a159-4f0c-8fbc-0e4957592400 tempest-VolumeImageDependencyTests-428084070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_09098a86-00d2-4b44-b9f8-980dc2ca280e_5s6ps85rdevstack@QuobyteHD {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:09 devstack sudo[107868]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:09 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-f59bada2-947c-4c94-9adb-bf29cd28055c tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Acquiring lock "cinder-73a88ac6-96f1-4f01-a46a-81ddedb545de-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:41:09 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-d5ec4a21-9d1d-4f2a-b502-597612594ecc tempest-ProjectMemberTests-47051868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2d92a0d0-76bf-4965-b6b5-d0522bb44f01.f9cfe9df-279d-4e5d-a5e4-89398504fb69" returned: 0 in 0.269s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:09 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-f59bada2-947c-4c94-9adb-bf29cd28055c tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Lock "cinder-73a88ac6-96f1-4f01-a46a-81ddedb545de-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:41:09 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-d5ec4a21-9d1d-4f2a-b502-597612594ecc tempest-ProjectMemberTests-47051868 None] Lock "cinder-quobyte-f9cfe9df-279d-4e5d-a5e4-89398504fb69" released by "_delete_snapshot" :: held 1.711s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:41:09 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-d5ec4a21-9d1d-4f2a-b502-597612594ecc tempest-ProjectMemberTests-47051868 None] Lock "cinder-quobyte-2d92a0d0-76bf-4965-b6b5-d0522bb44f01" released by "delete_snapshot" :: held 1.750s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:41:09 devstack sudo[107873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_09098a86-00d2-4b44-b9f8-980dc2ca280e_5s6ps85rdevstack@QuobyteHD
Jul 30 20:41:09 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-f59bada2-947c-4c94-9adb-bf29cd28055c tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Acquiring lock "cinder-quobyte-73a88ac6-96f1-4f01-a46a-81ddedb545de" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:41:09 devstack sudo[107873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:09 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-f59bada2-947c-4c94-9adb-bf29cd28055c tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Lock "cinder-quobyte-73a88ac6-96f1-4f01-a46a-81ddedb545de" acquired by "delete_volume" :: waited 0.022s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:41:09 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[57030322-9895-42c0-88ae-628171e856af]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:41:09 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f59bada2-947c-4c94-9adb-bf29cd28055c tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-73a88ac6-96f1-4f01-a46a-81ddedb545de {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:09 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-d5ec4a21-9d1d-4f2a-b502-597612594ecc tempest-ProjectMemberTests-47051868 None] Created reservations ['078312b7-3e74-4d47-9941-2ba244518b82', '5e2c027f-e1f2-44e9-a84e-a2c2ddb3dc0f', 'e7a3ca3d-2fee-47ba-b94a-eb7ad677aa4e', '141290fc-8697-4033-a98d-391d415b2541'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:41:09 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-d5ec4a21-9d1d-4f2a-b502-597612594ecc tempest-ProjectMemberTests-47051868 None] Delete snapshot completed successfully.
Jul 30 20:41:09 devstack sudo[107875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-73a88ac6-96f1-4f01-a46a-81ddedb545de
Jul 30 20:41:09 devstack sudo[107875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:09 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-d5ec4a21-9d1d-4f2a-b502-597612594ecc tempest-ProjectMemberTests-47051868 None] Lock "cinder-f9cfe9df-279d-4e5d-a5e4-89398504fb69-delete_snapshot" released by "delete_snapshot" :: held 1.985s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:41:09 devstack sudo[107873]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:09 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-dcc65e01-a159-4f0c-8fbc-0e4957592400 tempest-VolumeImageDependencyTests-428084070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_09098a86-00d2-4b44-b9f8-980dc2ca280e_5s6ps85rdevstack@QuobyteHD" returned: 1 in 0.385s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:09 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-dcc65e01-a159-4f0c-8fbc-0e4957592400 tempest-VolumeImageDependencyTests-428084070 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_09098a86-00d2-4b44-b9f8-980dc2ca280e_5s6ps85rdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 30 20:41:09 devstack cinder-volume[88719]: DEBUG cinder.image.image_utils [None req-dcc65e01-a159-4f0c-8fbc-0e4957592400 tempest-VolumeImageDependencyTests-428084070 None] 09098a86-00d2-4b44-b9f8-980dc2ca280e was raw, converting to qcow2 {{(pid=88719) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 30 20:41:09 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-dcc65e01-a159-4f0c-8fbc-0e4957592400 tempest-VolumeImageDependencyTests-428084070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_09098a86-00d2-4b44-b9f8-980dc2ca280e_5s6ps85rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-54f7bc6a-e4db-461a-8ddc-6f52190a3003 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:09 devstack sudo[107880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_09098a86-00d2-4b44-b9f8-980dc2ca280e_5s6ps85rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-54f7bc6a-e4db-461a-8ddc-6f52190a3003
Jul 30 20:41:09 devstack sudo[107880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:09 devstack sudo[107875]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:09 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f59bada2-947c-4c94-9adb-bf29cd28055c tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-73a88ac6-96f1-4f01-a46a-81ddedb545de" returned: 0 in 0.444s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:09 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f59bada2-947c-4c94-9adb-bf29cd28055c tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-73a88ac6-96f1-4f01-a46a-81ddedb545de {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:09 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-9a7b2e7c-66e2-4fbd-a36c-67ebebc6fbf2 tempest-ProjectMemberTests-47051868 None] Acquiring lock "cinder-2d92a0d0-76bf-4965-b6b5-d0522bb44f01-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:41:09 devstack sudo[107887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-73a88ac6-96f1-4f01-a46a-81ddedb545de
Jul 30 20:41:09 devstack sudo[107887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:09 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-9a7b2e7c-66e2-4fbd-a36c-67ebebc6fbf2 tempest-ProjectMemberTests-47051868 None] Lock "cinder-2d92a0d0-76bf-4965-b6b5-d0522bb44f01-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:41:10 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-9a7b2e7c-66e2-4fbd-a36c-67ebebc6fbf2 tempest-ProjectMemberTests-47051868 None] Acquiring lock "cinder-quobyte-2d92a0d0-76bf-4965-b6b5-d0522bb44f01" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:41:10 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-9a7b2e7c-66e2-4fbd-a36c-67ebebc6fbf2 tempest-ProjectMemberTests-47051868 None] Lock "cinder-quobyte-2d92a0d0-76bf-4965-b6b5-d0522bb44f01" acquired by "delete_volume" :: waited 0.019s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:41:10 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[51bd7e4f-1772-4c91-9125-cc9aefe5b1dd]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:41:10 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-9a7b2e7c-66e2-4fbd-a36c-67ebebc6fbf2 tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2d92a0d0-76bf-4965-b6b5-d0522bb44f01 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:10 devstack sudo[107890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2d92a0d0-76bf-4965-b6b5-d0522bb44f01
Jul 30 20:41:10 devstack sudo[107890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:10 devstack sudo[107887]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:10 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f59bada2-947c-4c94-9adb-bf29cd28055c tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-73a88ac6-96f1-4f01-a46a-81ddedb545de" returned: 0 in 0.322s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:10 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-f59bada2-947c-4c94-9adb-bf29cd28055c tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Lock "cinder-quobyte-73a88ac6-96f1-4f01-a46a-81ddedb545de" released by "delete_volume" :: held 0.839s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:41:10 devstack sudo[107880]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:10 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-dcc65e01-a159-4f0c-8fbc-0e4957592400 tempest-VolumeImageDependencyTests-428084070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_09098a86-00d2-4b44-b9f8-980dc2ca280e_5s6ps85rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-54f7bc6a-e4db-461a-8ddc-6f52190a3003" returned: 0 in 0.653s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:10 devstack cinder-volume[88719]: DEBUG cinder.image.image_utils [None req-dcc65e01-a159-4f0c-8fbc-0e4957592400 tempest-VolumeImageDependencyTests-428084070 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_09098a86-00d2-4b44-b9f8-980dc2ca280e_5s6ps85rdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-54f7bc6a-e4db-461a-8ddc-6f52190a3003 {{(pid=88719) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 30 20:41:10 devstack cinder-volume[88719]: INFO cinder.image.image_utils [None req-dcc65e01-a159-4f0c-8fbc-0e4957592400 tempest-VolumeImageDependencyTests-428084070 None] Converted 0.00 MB image at 0.00 MB/s
Jul 30 20:41:10 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-dcc65e01-a159-4f0c-8fbc-0e4957592400 tempest-VolumeImageDependencyTests-428084070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-54f7bc6a-e4db-461a-8ddc-6f52190a3003 1G {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:10 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-f59bada2-947c-4c94-9adb-bf29cd28055c tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Created reservations ['3fe18519-8ccd-4d1f-90d0-9a718f9039c5', '712b6a6d-7348-43e0-9365-2403ebf1a585', 'efe0181b-7520-4731-af79-98cc8f33ff2e', 'bc51ea4a-c9cf-4910-8e07-f0a270f46e12'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:41:10 devstack sudo[107893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-54f7bc6a-e4db-461a-8ddc-6f52190a3003 1G
Jul 30 20:41:10 devstack sudo[107893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:10 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-f59bada2-947c-4c94-9adb-bf29cd28055c tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:41:10 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-f59bada2-947c-4c94-9adb-bf29cd28055c tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:41:10 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-f59bada2-947c-4c94-9adb-bf29cd28055c tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:41:10 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-f59bada2-947c-4c94-9adb-bf29cd28055c tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:41:10 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-f59bada2-947c-4c94-9adb-bf29cd28055c tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:41:10 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f59bada2-947c-4c94-9adb-bf29cd28055c tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:10 devstack sudo[107897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:41:10 devstack sudo[107897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:10 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-9a05c8a3-22a7-44c7-abdf-aa3afc1bde21 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Acquiring lock "cinder-1b451d4d-e53d-44fb-8b40-fedee323cc45-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:41:10 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-9a05c8a3-22a7-44c7-abdf-aa3afc1bde21 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Lock "cinder-1b451d4d-e53d-44fb-8b40-fedee323cc45-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:41:10 devstack sudo[107890]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:10 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-9a7b2e7c-66e2-4fbd-a36c-67ebebc6fbf2 tempest-ProjectMemberTests-47051868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2d92a0d0-76bf-4965-b6b5-d0522bb44f01" returned: 0 in 0.494s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:10 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-9a7b2e7c-66e2-4fbd-a36c-67ebebc6fbf2 tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2d92a0d0-76bf-4965-b6b5-d0522bb44f01 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:10 devstack sudo[107901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2d92a0d0-76bf-4965-b6b5-d0522bb44f01
Jul 30 20:41:10 devstack sudo[107901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:10 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-9a05c8a3-22a7-44c7-abdf-aa3afc1bde21 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Acquiring lock "cinder-quobyte-1b451d4d-e53d-44fb-8b40-fedee323cc45" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:41:10 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-9a05c8a3-22a7-44c7-abdf-aa3afc1bde21 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Lock "cinder-quobyte-1b451d4d-e53d-44fb-8b40-fedee323cc45" acquired by "delete_volume" :: waited 0.036s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:41:10 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[322a7540-397e-4336-8b81-3e4784d0acef]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:41:10 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-9a05c8a3-22a7-44c7-abdf-aa3afc1bde21 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1b451d4d-e53d-44fb-8b40-fedee323cc45 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:10 devstack sudo[107893]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:10 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-dcc65e01-a159-4f0c-8fbc-0e4957592400 tempest-VolumeImageDependencyTests-428084070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-54f7bc6a-e4db-461a-8ddc-6f52190a3003 1G" returned: 0 in 0.515s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:10 devstack cinder-volume[88719]: DEBUG cinder.volume.volume_utils [None req-dcc65e01-a159-4f0c-8fbc-0e4957592400 tempest-VolumeImageDependencyTests-428084070 None] Downloaded image 09098a86-00d2-4b44-b9f8-980dc2ca280e ((None, [{'url': 'file:///opt/stack/data/glance/images/09098a86-00d2-4b44-b9f8-980dc2ca280e', 'metadata': {}}])) to volume 54f7bc6a-e4db-461a-8ddc-6f52190a3003 successfully. {{(pid=88719) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 30 20:41:10 devstack cinder-volume[88719]: DEBUG cinder.image.image_utils [None req-dcc65e01-a159-4f0c-8fbc-0e4957592400 tempest-VolumeImageDependencyTests-428084070 None] Temporary image 09098a86-00d2-4b44-b9f8-980dc2ca280e for user 844f404d10d542da9720615783683ebe is deleted. {{(pid=88719) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 30 20:41:10 devstack cinder-volume[88719]: DEBUG cinder.volume.volume_utils [None req-dcc65e01-a159-4f0c-8fbc-0e4957592400 tempest-VolumeImageDependencyTests-428084070 None] Marking volume 54f7bc6a-e4db-461a-8ddc-6f52190a3003 as bootable. {{(pid=88719) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 30 20:41:10 devstack sudo[107906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1b451d4d-e53d-44fb-8b40-fedee323cc45
Jul 30 20:41:10 devstack sudo[107906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:10 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcc65e01-a159-4f0c-8fbc-0e4957592400 tempest-VolumeImageDependencyTests-428084070 None] Copying metadata from image 09098a86-00d2-4b44-b9f8-980dc2ca280e to 54f7bc6a-e4db-461a-8ddc-6f52190a3003. {{(pid=88719) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 30 20:41:10 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcc65e01-a159-4f0c-8fbc-0e4957592400 tempest-VolumeImageDependencyTests-428084070 None] Creating volume glance metadata for volume 54f7bc6a-e4db-461a-8ddc-6f52190a3003 backed by image 09098a86-00d2-4b44-b9f8-980dc2ca280e with: {'image_id': '09098a86-00d2-4b44-b9f8-980dc2ca280e', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'dc6a3fe7be28bbdac22d66e725287b2e', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88719) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 30 20:41:10 devstack sudo[107897]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:10 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f59bada2-947c-4c94-9adb-bf29cd28055c tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.425s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:10 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-f59bada2-947c-4c94-9adb-bf29cd28055c tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:41:10 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-f59bada2-947c-4c94-9adb-bf29cd28055c tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Deleted volume successfully.
Jul 30 20:41:10 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-f59bada2-947c-4c94-9adb-bf29cd28055c tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Lock "cinder-73a88ac6-96f1-4f01-a46a-81ddedb545de-delete_volume" released by "delete_volume" :: held 1.603s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:41:10 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-dcc65e01-a159-4f0c-8fbc-0e4957592400 tempest-VolumeImageDependencyTests-428084070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6c66141-28c7-4785-a9b9-960d25624aec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54f7bc6a-e4db-461a-8ddc-6f52190a3003', 'volume_size': 1, 'image_id': '09098a86-00d2-4b44-b9f8-980dc2ca280e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/09098a86-00d2-4b44-b9f8-980dc2ca280e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'dc6a3fe7be28bbdac22d66e725287b2e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cf71d7a900d54744875e537d04fe15df', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6d0aac245c2f37bfcebd3f62927abe455ce9c40f7903d7d9caec4553edec3e41a941c74801619bfaa1564d237163357d9ca32b116a56d093d5a262fbb2d79d56', 'id': '09098a86-00d2-4b44-b9f8-980dc2ca280e', 'created_at': datetime.datetime(2026, 7, 30, 18, 41, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 18, 41, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/09098a86-00d2-4b44-b9f8-980dc2ca280e/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7868848b35f0>}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:41:10 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-dcc65e01-a159-4f0c-8fbc-0e4957592400 tempest-VolumeImageDependencyTests-428084070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f7e9371-9d85-4387-a512-c9138aff5a65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:41:10 devstack sudo[107901]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:10 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-9a7b2e7c-66e2-4fbd-a36c-67ebebc6fbf2 tempest-ProjectMemberTests-47051868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-2d92a0d0-76bf-4965-b6b5-d0522bb44f01" returned: 0 in 0.398s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:10 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-dcc65e01-a159-4f0c-8fbc-0e4957592400 tempest-VolumeImageDependencyTests-428084070 None] Volume volume-54f7bc6a-e4db-461a-8ddc-6f52190a3003 (54f7bc6a-e4db-461a-8ddc-6f52190a3003): created successfully
Jul 30 20:41:10 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-dcc65e01-a159-4f0c-8fbc-0e4957592400 tempest-VolumeImageDependencyTests-428084070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f7e9371-9d85-4387-a512-c9138aff5a65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:41:11 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-dcc65e01-a159-4f0c-8fbc-0e4957592400 tempest-VolumeImageDependencyTests-428084070 None] Flow 'volume_create_manager' (a1f8f489-7e1d-4cf2-ae7a-9692a8bb1d7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:41:11 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-9a7b2e7c-66e2-4fbd-a36c-67ebebc6fbf2 tempest-ProjectMemberTests-47051868 None] Lock "cinder-quobyte-2d92a0d0-76bf-4965-b6b5-d0522bb44f01" released by "delete_volume" :: held 0.972s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:41:11 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-dcc65e01-a159-4f0c-8fbc-0e4957592400 tempest-VolumeImageDependencyTests-428084070 None] Created volume successfully.
Jul 30 20:41:11 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-9a7b2e7c-66e2-4fbd-a36c-67ebebc6fbf2 tempest-ProjectMemberTests-47051868 None] Created reservations ['d9595635-50ed-49e7-8c1a-33d3a455662c', '7f7962ed-55e1-45e1-9bfc-e563407c4842', 'ddab973c-d0b0-45a6-bdb0-1ebdd344c8cf', '79017292-b317-4b86-8fea-8776e646af82'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:41:11 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-9a7b2e7c-66e2-4fbd-a36c-67ebebc6fbf2 tempest-ProjectMemberTests-47051868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:41:11 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-9a7b2e7c-66e2-4fbd-a36c-67ebebc6fbf2 tempest-ProjectMemberTests-47051868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:41:11 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-9a7b2e7c-66e2-4fbd-a36c-67ebebc6fbf2 tempest-ProjectMemberTests-47051868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:41:11 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-9a7b2e7c-66e2-4fbd-a36c-67ebebc6fbf2 tempest-ProjectMemberTests-47051868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:41:11 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-9a7b2e7c-66e2-4fbd-a36c-67ebebc6fbf2 tempest-ProjectMemberTests-47051868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:41:11 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-9a7b2e7c-66e2-4fbd-a36c-67ebebc6fbf2 tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:11 devstack sudo[107906]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:11 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-9a05c8a3-22a7-44c7-abdf-aa3afc1bde21 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1b451d4d-e53d-44fb-8b40-fedee323cc45" returned: 0 in 0.455s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:11 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-9a05c8a3-22a7-44c7-abdf-aa3afc1bde21 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1b451d4d-e53d-44fb-8b40-fedee323cc45 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:11 devstack sudo[107913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:41:11 devstack sudo[107913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:11 devstack sudo[107915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1b451d4d-e53d-44fb-8b40-fedee323cc45
Jul 30 20:41:11 devstack sudo[107915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:11 devstack sudo[107913]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:11 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-9a7b2e7c-66e2-4fbd-a36c-67ebebc6fbf2 tempest-ProjectMemberTests-47051868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.255s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:11 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-9a7b2e7c-66e2-4fbd-a36c-67ebebc6fbf2 tempest-ProjectMemberTests-47051868 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:41:11 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-9a7b2e7c-66e2-4fbd-a36c-67ebebc6fbf2 tempest-ProjectMemberTests-47051868 None] Deleted volume successfully.
Jul 30 20:41:11 devstack sudo[107915]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:11 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-9a7b2e7c-66e2-4fbd-a36c-67ebebc6fbf2 tempest-ProjectMemberTests-47051868 None] Lock "cinder-2d92a0d0-76bf-4965-b6b5-d0522bb44f01-delete_volume" released by "delete_volume" :: held 1.457s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:41:11 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-9a05c8a3-22a7-44c7-abdf-aa3afc1bde21 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1b451d4d-e53d-44fb-8b40-fedee323cc45" returned: 0 in 0.262s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:11 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-9a05c8a3-22a7-44c7-abdf-aa3afc1bde21 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Lock "cinder-quobyte-1b451d4d-e53d-44fb-8b40-fedee323cc45" released by "delete_volume" :: held 0.769s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:41:11 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-9a05c8a3-22a7-44c7-abdf-aa3afc1bde21 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Created reservations ['fa5f39e0-d89f-409b-9c04-1360dd163988', '6baecbb3-23e4-4d2a-976e-2effff3b5aa0', 'b6b5051c-8a77-48a7-8b9f-b247d73b6ba8', '4ed67530-d91a-46b7-85ac-a0269b6f4657'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:41:11 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-9a05c8a3-22a7-44c7-abdf-aa3afc1bde21 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:41:11 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-9a05c8a3-22a7-44c7-abdf-aa3afc1bde21 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:41:11 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-9a05c8a3-22a7-44c7-abdf-aa3afc1bde21 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:41:11 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-9a05c8a3-22a7-44c7-abdf-aa3afc1bde21 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:41:11 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-9a05c8a3-22a7-44c7-abdf-aa3afc1bde21 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:41:11 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-9a05c8a3-22a7-44c7-abdf-aa3afc1bde21 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:11 devstack sudo[107919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:41:11 devstack sudo[107919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:11 devstack sudo[107919]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:11 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-9a05c8a3-22a7-44c7-abdf-aa3afc1bde21 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.263s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:11 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-9a05c8a3-22a7-44c7-abdf-aa3afc1bde21 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:41:11 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-9a05c8a3-22a7-44c7-abdf-aa3afc1bde21 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Deleted volume successfully.
Jul 30 20:41:11 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-9a05c8a3-22a7-44c7-abdf-aa3afc1bde21 tempest-CreateVolumesFromSourceVolumeTest-1046434371 None] Lock "cinder-1b451d4d-e53d-44fb-8b40-fedee323cc45-delete_volume" released by "delete_volume" :: held 1.290s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:41:12 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-0bf7506a-59fc-44fe-a8ee-d0f67493ad3d tempest-VolumeImageDependencyTests-428084070 None] Acquiring lock "cinder-54f7bc6a-e4db-461a-8ddc-6f52190a3003-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:41:12 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-0bf7506a-59fc-44fe-a8ee-d0f67493ad3d tempest-VolumeImageDependencyTests-428084070 None] Lock "cinder-54f7bc6a-e4db-461a-8ddc-6f52190a3003-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:41:12 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-0bf7506a-59fc-44fe-a8ee-d0f67493ad3d tempest-VolumeImageDependencyTests-428084070 None] Acquiring lock "cinder-quobyte-54f7bc6a-e4db-461a-8ddc-6f52190a3003" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:41:12 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-0bf7506a-59fc-44fe-a8ee-d0f67493ad3d tempest-VolumeImageDependencyTests-428084070 None] Lock "cinder-quobyte-54f7bc6a-e4db-461a-8ddc-6f52190a3003" acquired by "delete_volume" :: waited 0.024s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:41:12 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8433675-d95f-4d6d-8115-0c82a6122cb2]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:41:12 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-0bf7506a-59fc-44fe-a8ee-d0f67493ad3d tempest-VolumeImageDependencyTests-428084070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-54f7bc6a-e4db-461a-8ddc-6f52190a3003 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:12 devstack sudo[107922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-54f7bc6a-e4db-461a-8ddc-6f52190a3003
Jul 30 20:41:12 devstack sudo[107922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:12 devstack sudo[107922]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:12 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-0bf7506a-59fc-44fe-a8ee-d0f67493ad3d tempest-VolumeImageDependencyTests-428084070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-54f7bc6a-e4db-461a-8ddc-6f52190a3003" returned: 0 in 0.487s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:12 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-0bf7506a-59fc-44fe-a8ee-d0f67493ad3d tempest-VolumeImageDependencyTests-428084070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-54f7bc6a-e4db-461a-8ddc-6f52190a3003 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:12 devstack sudo[107927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-54f7bc6a-e4db-461a-8ddc-6f52190a3003
Jul 30 20:41:12 devstack sudo[107927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:12 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-14e89ec3-5ba9-4edc-8d1d-9286ac0c74e7 tempest-ProjectMemberTests-47051868 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:41:12 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-14e89ec3-5ba9-4edc-8d1d-9286ac0c74e7 tempest-ProjectMemberTests-47051868 None] Flow 'volume_create_manager' (108ca937-86c2-4fbf-bf34-d03632f1e81a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:41:12 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-14e89ec3-5ba9-4edc-8d1d-9286ac0c74e7 tempest-ProjectMemberTests-47051868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eab50c80-8800-411f-9dc9-163b1280da5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:41:12 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-14e89ec3-5ba9-4edc-8d1d-9286ac0c74e7 tempest-ProjectMemberTests-47051868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eab50c80-8800-411f-9dc9-163b1280da5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:41:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-9864228',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c074ebd5-979d-4513-a546-a39212515d76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c483f66aa6ec477e9cb0547f0f04f6d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:41:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:41:13Z,use_quota=True,user_id='59a41c24b76545b79b09f90cd8c36728',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:41:12 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-14e89ec3-5ba9-4edc-8d1d-9286ac0c74e7 tempest-ProjectMemberTests-47051868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f5ba93a-cf9a-4a0d-86e1-a5ff010c2016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:41:12 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-14e89ec3-5ba9-4edc-8d1d-9286ac0c74e7 tempest-ProjectMemberTests-47051868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f5ba93a-cf9a-4a0d-86e1-a5ff010c2016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:41:12 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-14e89ec3-5ba9-4edc-8d1d-9286ac0c74e7 tempest-ProjectMemberTests-47051868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f6d2a73-12e1-432f-ae53-6640c597d52e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:41:12 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-14e89ec3-5ba9-4edc-8d1d-9286ac0c74e7 tempest-ProjectMemberTests-47051868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f6d2a73-12e1-432f-ae53-6640c597d52e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c074ebd5-979d-4513-a546-a39212515d76', 'volume_name': 'volume-c074ebd5-979d-4513-a546-a39212515d76', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:41:12 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-14e89ec3-5ba9-4edc-8d1d-9286ac0c74e7 tempest-ProjectMemberTests-47051868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec1df463-1a62-4ccd-90ec-02aac5901285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:41:12 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-14e89ec3-5ba9-4edc-8d1d-9286ac0c74e7 tempest-ProjectMemberTests-47051868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec1df463-1a62-4ccd-90ec-02aac5901285) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:41:12 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-14e89ec3-5ba9-4edc-8d1d-9286ac0c74e7 tempest-ProjectMemberTests-47051868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7e492ab-9fdd-494f-ba56-50f91db05bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:41:12 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-14e89ec3-5ba9-4edc-8d1d-9286ac0c74e7 tempest-ProjectMemberTests-47051868 None] Volume c074ebd5-979d-4513-a546-a39212515d76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c074ebd5-979d-4513-a546-a39212515d76', 'volume_size': 1}
Jul 30 20:41:12 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-14e89ec3-5ba9-4edc-8d1d-9286ac0c74e7 tempest-ProjectMemberTests-47051868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:41:12 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-14e89ec3-5ba9-4edc-8d1d-9286ac0c74e7 tempest-ProjectMemberTests-47051868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:41:12 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-14e89ec3-5ba9-4edc-8d1d-9286ac0c74e7 tempest-ProjectMemberTests-47051868 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:41:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-9864228',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c074ebd5-979d-4513-a546-a39212515d76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c483f66aa6ec477e9cb0547f0f04f6d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:41:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:41:13Z,use_quota=True,user_id='59a41c24b76545b79b09f90cd8c36728',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:41:12 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-14e89ec3-5ba9-4edc-8d1d-9286ac0c74e7 tempest-ProjectMemberTests-47051868 None] Creating volume c074ebd5-979d-4513-a546-a39212515d76 {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:41:12 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-14e89ec3-5ba9-4edc-8d1d-9286ac0c74e7 tempest-ProjectMemberTests-47051868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:41:12 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-14e89ec3-5ba9-4edc-8d1d-9286ac0c74e7 tempest-ProjectMemberTests-47051868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:41:12 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-14e89ec3-5ba9-4edc-8d1d-9286ac0c74e7 tempest-ProjectMemberTests-47051868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:41:12 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-14e89ec3-5ba9-4edc-8d1d-9286ac0c74e7 tempest-ProjectMemberTests-47051868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:41:12 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-14e89ec3-5ba9-4edc-8d1d-9286ac0c74e7 tempest-ProjectMemberTests-47051868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:41:12 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-14e89ec3-5ba9-4edc-8d1d-9286ac0c74e7 tempest-ProjectMemberTests-47051868 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:41:12 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-14e89ec3-5ba9-4edc-8d1d-9286ac0c74e7 tempest-ProjectMemberTests-47051868 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:41:12 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-14e89ec3-5ba9-4edc-8d1d-9286ac0c74e7 tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c074ebd5-979d-4513-a546-a39212515d76 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:13 devstack sudo[107929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c074ebd5-979d-4513-a546-a39212515d76 1073741824
Jul 30 20:41:13 devstack sudo[107929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:13 devstack sudo[107927]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:13 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-0bf7506a-59fc-44fe-a8ee-d0f67493ad3d tempest-VolumeImageDependencyTests-428084070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-54f7bc6a-e4db-461a-8ddc-6f52190a3003" returned: 0 in 0.328s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:13 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-0bf7506a-59fc-44fe-a8ee-d0f67493ad3d tempest-VolumeImageDependencyTests-428084070 None] Lock "cinder-quobyte-54f7bc6a-e4db-461a-8ddc-6f52190a3003" released by "delete_volume" :: held 0.890s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:41:13 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-0bf7506a-59fc-44fe-a8ee-d0f67493ad3d tempest-VolumeImageDependencyTests-428084070 None] Created reservations ['d8ec7ed8-d296-4030-a3c9-dd83724a90ff', '9f96043a-cd0b-4ae6-96dc-2543d4552612', '35b543cd-6af8-45e9-9262-3e114f33ed13', 'f70d6f4e-335a-45ff-9c67-4ab9c86bd4fb'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:41:13 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-0bf7506a-59fc-44fe-a8ee-d0f67493ad3d tempest-VolumeImageDependencyTests-428084070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:41:13 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-0bf7506a-59fc-44fe-a8ee-d0f67493ad3d tempest-VolumeImageDependencyTests-428084070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:41:13 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-0bf7506a-59fc-44fe-a8ee-d0f67493ad3d tempest-VolumeImageDependencyTests-428084070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:41:13 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-0bf7506a-59fc-44fe-a8ee-d0f67493ad3d tempest-VolumeImageDependencyTests-428084070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:41:13 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-0bf7506a-59fc-44fe-a8ee-d0f67493ad3d tempest-VolumeImageDependencyTests-428084070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:41:13 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-0bf7506a-59fc-44fe-a8ee-d0f67493ad3d tempest-VolumeImageDependencyTests-428084070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:13 devstack sudo[107935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:41:13 devstack sudo[107935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:13 devstack sudo[107929]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:13 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-14e89ec3-5ba9-4edc-8d1d-9286ac0c74e7 tempest-ProjectMemberTests-47051868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c074ebd5-979d-4513-a546-a39212515d76 1073741824" returned: 0 in 0.678s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:13 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-14e89ec3-5ba9-4edc-8d1d-9286ac0c74e7 tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c074ebd5-979d-4513-a546-a39212515d76 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:13 devstack sudo[107939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c074ebd5-979d-4513-a546-a39212515d76
Jul 30 20:41:13 devstack sudo[107939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:13 devstack sudo[107935]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:13 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-0bf7506a-59fc-44fe-a8ee-d0f67493ad3d tempest-VolumeImageDependencyTests-428084070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.506s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:13 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-0bf7506a-59fc-44fe-a8ee-d0f67493ad3d tempest-VolumeImageDependencyTests-428084070 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:41:13 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-0bf7506a-59fc-44fe-a8ee-d0f67493ad3d tempest-VolumeImageDependencyTests-428084070 None] Deleted volume successfully.
Jul 30 20:41:13 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-0bf7506a-59fc-44fe-a8ee-d0f67493ad3d tempest-VolumeImageDependencyTests-428084070 None] Lock "cinder-54f7bc6a-e4db-461a-8ddc-6f52190a3003-delete_volume" released by "delete_volume" :: held 1.774s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:41:14 devstack sudo[107939]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:14 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-14e89ec3-5ba9-4edc-8d1d-9286ac0c74e7 tempest-ProjectMemberTests-47051868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c074ebd5-979d-4513-a546-a39212515d76" returned: 0 in 0.314s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:14 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-14e89ec3-5ba9-4edc-8d1d-9286ac0c74e7 tempest-ProjectMemberTests-47051868 None] <== create_volume: return (1083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:41:14 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-14e89ec3-5ba9-4edc-8d1d-9286ac0c74e7 tempest-ProjectMemberTests-47051868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.086s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:41:14 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-14e89ec3-5ba9-4edc-8d1d-9286ac0c74e7 tempest-ProjectMemberTests-47051868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7e492ab-9fdd-494f-ba56-50f91db05bfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c074ebd5-979d-4513-a546-a39212515d76', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:41:14 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-14e89ec3-5ba9-4edc-8d1d-9286ac0c74e7 tempest-ProjectMemberTests-47051868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ceae33ed-2b15-46e2-8e66-37b2f920a653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:41:14 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-14e89ec3-5ba9-4edc-8d1d-9286ac0c74e7 tempest-ProjectMemberTests-47051868 None] Volume volume-c074ebd5-979d-4513-a546-a39212515d76 (c074ebd5-979d-4513-a546-a39212515d76): created successfully
Jul 30 20:41:14 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-14e89ec3-5ba9-4edc-8d1d-9286ac0c74e7 tempest-ProjectMemberTests-47051868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ceae33ed-2b15-46e2-8e66-37b2f920a653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:41:14 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-14e89ec3-5ba9-4edc-8d1d-9286ac0c74e7 tempest-ProjectMemberTests-47051868 None] Flow 'volume_create_manager' (108ca937-86c2-4fbf-bf34-d03632f1e81a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:41:14 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-14e89ec3-5ba9-4edc-8d1d-9286ac0c74e7 tempest-ProjectMemberTests-47051868 None] Created volume successfully.
Jul 30 20:41:15 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-85c9af13-5d53-4d78-ae84-1d2adb6ed99d tempest-ProjectMemberTests-47051868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:41:15 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-85c9af13-5d53-4d78-ae84-1d2adb6ed99d tempest-ProjectMemberTests-47051868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:41:15 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-85c9af13-5d53-4d78-ae84-1d2adb6ed99d tempest-ProjectMemberTests-47051868 None] Creating offline snapshot 884d7ba6-4869-454b-b49d-afa61cdad2a3 of volume c074ebd5-979d-4513-a546-a39212515d76 {{(pid=88719) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 30 20:41:15 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd449543-e463-4110-8ae3-05cc2ca2228f]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:41:15 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-85c9af13-5d53-4d78-ae84-1d2adb6ed99d tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c074ebd5-979d-4513-a546-a39212515d76 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:15 devstack sudo[107943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c074ebd5-979d-4513-a546-a39212515d76
Jul 30 20:41:15 devstack sudo[107943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:15 devstack sudo[107943]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:15 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-85c9af13-5d53-4d78-ae84-1d2adb6ed99d tempest-ProjectMemberTests-47051868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c074ebd5-979d-4513-a546-a39212515d76" returned: 0 in 0.419s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:15 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-85c9af13-5d53-4d78-ae84-1d2adb6ed99d tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c074ebd5-979d-4513-a546-a39212515d76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c074ebd5-979d-4513-a546-a39212515d76.884d7ba6-4869-454b-b49d-afa61cdad2a3 1G {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:15 devstack sudo[107949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c074ebd5-979d-4513-a546-a39212515d76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c074ebd5-979d-4513-a546-a39212515d76.884d7ba6-4869-454b-b49d-afa61cdad2a3 1G
Jul 30 20:41:15 devstack sudo[107949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:16 devstack sudo[107949]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-85c9af13-5d53-4d78-ae84-1d2adb6ed99d tempest-ProjectMemberTests-47051868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c074ebd5-979d-4513-a546-a39212515d76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c074ebd5-979d-4513-a546-a39212515d76.884d7ba6-4869-454b-b49d-afa61cdad2a3 1G" returned: 0 in 0.437s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-85c9af13-5d53-4d78-ae84-1d2adb6ed99d tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c074ebd5-979d-4513-a546-a39212515d76 -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c074ebd5-979d-4513-a546-a39212515d76.884d7ba6-4869-454b-b49d-afa61cdad2a3 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:16 devstack sudo[107954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c074ebd5-979d-4513-a546-a39212515d76 -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c074ebd5-979d-4513-a546-a39212515d76.884d7ba6-4869-454b-b49d-afa61cdad2a3
Jul 30 20:41:16 devstack sudo[107954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:16 devstack cinder-volume[88719]: DEBUG oslo_service.periodic_task [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88719) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 30 20:41:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:41:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:41:16 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:41:16 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:41:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:41:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:16 devstack sudo[107954]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-85c9af13-5d53-4d78-ae84-1d2adb6ed99d tempest-ProjectMemberTests-47051868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c074ebd5-979d-4513-a546-a39212515d76 -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c074ebd5-979d-4513-a546-a39212515d76.884d7ba6-4869-454b-b49d-afa61cdad2a3" returned: 0 in 0.356s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:16 devstack cinder-volume[88719]: WARNING cinder.volume.drivers.remotefs [None req-85c9af13-5d53-4d78-ae84-1d2adb6ed99d tempest-ProjectMemberTests-47051868 None] /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c074ebd5-979d-4513-a546-a39212515d76.884d7ba6-4869-454b-b49d-afa61cdad2a3 is being set with open permissions: ugo+rw
Jul 30 20:41:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-85c9af13-5d53-4d78-ae84-1d2adb6ed99d tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c074ebd5-979d-4513-a546-a39212515d76.884d7ba6-4869-454b-b49d-afa61cdad2a3 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:16 devstack sudo[107959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:41:16 devstack sudo[107959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:16 devstack sudo[107960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c074ebd5-979d-4513-a546-a39212515d76.884d7ba6-4869-454b-b49d-afa61cdad2a3
Jul 30 20:41:16 devstack sudo[107960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:16 devstack sudo[107960]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-85c9af13-5d53-4d78-ae84-1d2adb6ed99d tempest-ProjectMemberTests-47051868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c074ebd5-979d-4513-a546-a39212515d76.884d7ba6-4869-454b-b49d-afa61cdad2a3" returned: 0 in 0.271s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:16 devstack sudo[107959]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.315s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:16 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:41:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-85c9af13-5d53-4d78-ae84-1d2adb6ed99d tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c074ebd5-979d-4513-a546-a39212515d76.info {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:16 devstack cinder-volume[88719]: DEBUG oslo_service.periodic_task [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Running periodic task VolumeManager._thread_info {{(pid=88719) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 30 20:41:16 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] thread count: 28 {{(pid=88719) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 30 20:41:16 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] thread info: [<_MainThread(MainThread, started 132390416908416)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132390306497536)>, <Thread(Thread-3 (stat_writer), started daemon 132390304471680)>, <Thread(Rabbit-heartbeat, started daemon 132390303393408)>, <Thread(Thread-5 (_runner), started daemon 132390303543168)>, <Thread(Thread-7 (_runner), started daemon 132390303563392)>, <Thread(fd_logger, started daemon 132390301344640)>, <Thread(privsep_reader, started daemon 132390301560640)>, <Thread(tpool_thread_0, started daemon 132390291470016)>, <Thread(tpool_thread_1, started daemon 132390283077312)>, <Thread(tpool_thread_2, started daemon 132390274684608)>, <Thread(tpool_thread_3, started daemon 132390266291904)>, <Thread(tpool_thread_4, started daemon 132390257899200)>, <Thread(tpool_thread_5, started daemon 132390249506496)>, <Thread(tpool_thread_6, started daemon 132390241113792)>, <Thread(tpool_thread_7, started daemon 132390232721088)>, <Thread(tpool_thread_8, started daemon 132390224328384)>, <Thread(tpool_thread_9, started daemon 132390215919296)>, <Thread(tpool_thread_10, started daemon 132390207510208)>, <Thread(tpool_thread_11, started daemon 132390199101120)>, <Thread(tpool_thread_12, started daemon 132390190692032)>, <Thread(tpool_thread_13, started daemon 132390182282944)>, <Thread(tpool_thread_14, started daemon 132390173873856)>, <Thread(tpool_thread_15, started daemon 132390165464768)>, <Thread(tpool_thread_16, started daemon 132390157055680)>, <Thread(tpool_thread_17, started daemon 132390148646592)>, <Thread(tpool_thread_18, started daemon 132390140237504)>, <Thread(tpool_thread_19, started daemon 132390131828416)>] {{(pid=88719) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 30 20:41:16 devstack sudo[107965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c074ebd5-979d-4513-a546-a39212515d76.info
Jul 30 20:41:16 devstack sudo[107965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:17 devstack sudo[107965]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:17 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-85c9af13-5d53-4d78-ae84-1d2adb6ed99d tempest-ProjectMemberTests-47051868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c074ebd5-979d-4513-a546-a39212515d76.info" returned: 0 in 0.283s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:17 devstack cinder-volume[88719]: WARNING cinder.volume.drivers.remotefs [None req-85c9af13-5d53-4d78-ae84-1d2adb6ed99d tempest-ProjectMemberTests-47051868 None] /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c074ebd5-979d-4513-a546-a39212515d76.info is being set with open permissions: ugo+rw
Jul 30 20:41:17 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-85c9af13-5d53-4d78-ae84-1d2adb6ed99d tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c074ebd5-979d-4513-a546-a39212515d76.info {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:17 devstack sudo[107968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c074ebd5-979d-4513-a546-a39212515d76.info
Jul 30 20:41:17 devstack sudo[107968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:17 devstack sudo[107968]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:17 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-85c9af13-5d53-4d78-ae84-1d2adb6ed99d tempest-ProjectMemberTests-47051868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c074ebd5-979d-4513-a546-a39212515d76.info" returned: 0 in 0.275s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:17 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-85c9af13-5d53-4d78-ae84-1d2adb6ed99d tempest-ProjectMemberTests-47051868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.176s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:41:17 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-85c9af13-5d53-4d78-ae84-1d2adb6ed99d tempest-ProjectMemberTests-47051868 None] Create snapshot completed successfully
Jul 30 20:41:17 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-af3472c0-02f8-422b-9d4b-fd0f357961e1 tempest-CinderUnicodeTest-615614172 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:41:17 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-af3472c0-02f8-422b-9d4b-fd0f357961e1 tempest-CinderUnicodeTest-615614172 None] Flow 'volume_create_manager' (3982a46d-f55a-4323-a779-a716cc4d45e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:41:17 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-af3472c0-02f8-422b-9d4b-fd0f357961e1 tempest-CinderUnicodeTest-615614172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4432b04-e456-4b62-8b85-0bac0f0da999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:41:17 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-da780d29-2d68-4feb-8aa5-ed484097a245 tempest-ProjectMemberTests-47051868 None] Acquiring lock "cinder-884d7ba6-4869-454b-b49d-afa61cdad2a3-delete_snapshot" by "delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:41:17 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-af3472c0-02f8-422b-9d4b-fd0f357961e1 tempest-CinderUnicodeTest-615614172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4432b04-e456-4b62-8b85-0bac0f0da999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:41:17Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=032c6e34-68dc-4cf2-93f3-31632bd2fd1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99ca47c68c98497c819c3028412153fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:41:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:41:18Z,use_quota=True,user_id='0300e7ff90214b1a962466ec19f98793',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:41:17 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-af3472c0-02f8-422b-9d4b-fd0f357961e1 tempest-CinderUnicodeTest-615614172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdc613e5-65fd-4362-b07c-2af257b75df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:41:17 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-af3472c0-02f8-422b-9d4b-fd0f357961e1 tempest-CinderUnicodeTest-615614172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdc613e5-65fd-4362-b07c-2af257b75df7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:41:17 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-af3472c0-02f8-422b-9d4b-fd0f357961e1 tempest-CinderUnicodeTest-615614172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aae5b3a6-4dda-4efc-822a-197badd02961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:41:17 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-af3472c0-02f8-422b-9d4b-fd0f357961e1 tempest-CinderUnicodeTest-615614172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aae5b3a6-4dda-4efc-822a-197badd02961) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '032c6e34-68dc-4cf2-93f3-31632bd2fd1a', 'volume_name': 'volume-032c6e34-68dc-4cf2-93f3-31632bd2fd1a', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:41:17 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-af3472c0-02f8-422b-9d4b-fd0f357961e1 tempest-CinderUnicodeTest-615614172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17593e25-7ec2-4c17-8fa5-2fb92b1163f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:41:17 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-af3472c0-02f8-422b-9d4b-fd0f357961e1 tempest-CinderUnicodeTest-615614172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17593e25-7ec2-4c17-8fa5-2fb92b1163f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:41:17 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-af3472c0-02f8-422b-9d4b-fd0f357961e1 tempest-CinderUnicodeTest-615614172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e162923a-9167-4de5-99af-1ece617000d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:41:17 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-af3472c0-02f8-422b-9d4b-fd0f357961e1 tempest-CinderUnicodeTest-615614172 None] Volume 032c6e34-68dc-4cf2-93f3-31632bd2fd1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-032c6e34-68dc-4cf2-93f3-31632bd2fd1a', 'volume_size': 1}
Jul 30 20:41:17 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-af3472c0-02f8-422b-9d4b-fd0f357961e1 tempest-CinderUnicodeTest-615614172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:41:17 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-af3472c0-02f8-422b-9d4b-fd0f357961e1 tempest-CinderUnicodeTest-615614172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:41:17 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-af3472c0-02f8-422b-9d4b-fd0f357961e1 tempest-CinderUnicodeTest-615614172 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:41:17Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=032c6e34-68dc-4cf2-93f3-31632bd2fd1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99ca47c68c98497c819c3028412153fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:41:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:41:18Z,use_quota=True,user_id='0300e7ff90214b1a962466ec19f98793',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:41:17 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-af3472c0-02f8-422b-9d4b-fd0f357961e1 tempest-CinderUnicodeTest-615614172 None] Creating volume 032c6e34-68dc-4cf2-93f3-31632bd2fd1a {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:41:17 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-af3472c0-02f8-422b-9d4b-fd0f357961e1 tempest-CinderUnicodeTest-615614172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:41:17 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-af3472c0-02f8-422b-9d4b-fd0f357961e1 tempest-CinderUnicodeTest-615614172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:41:17 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-af3472c0-02f8-422b-9d4b-fd0f357961e1 tempest-CinderUnicodeTest-615614172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:41:17 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-af3472c0-02f8-422b-9d4b-fd0f357961e1 tempest-CinderUnicodeTest-615614172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:41:17 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-af3472c0-02f8-422b-9d4b-fd0f357961e1 tempest-CinderUnicodeTest-615614172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:41:17 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-af3472c0-02f8-422b-9d4b-fd0f357961e1 tempest-CinderUnicodeTest-615614172 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:41:17 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-af3472c0-02f8-422b-9d4b-fd0f357961e1 tempest-CinderUnicodeTest-615614172 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:41:17 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-af3472c0-02f8-422b-9d4b-fd0f357961e1 tempest-CinderUnicodeTest-615614172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-032c6e34-68dc-4cf2-93f3-31632bd2fd1a 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:17 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-da780d29-2d68-4feb-8aa5-ed484097a245 tempest-ProjectMemberTests-47051868 None] Lock "cinder-884d7ba6-4869-454b-b49d-afa61cdad2a3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.099s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:41:17 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-da780d29-2d68-4feb-8aa5-ed484097a245 tempest-ProjectMemberTests-47051868 None] Acquiring lock "cinder-quobyte-c074ebd5-979d-4513-a546-a39212515d76" by "delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:41:17 devstack sudo[107971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-032c6e34-68dc-4cf2-93f3-31632bd2fd1a 1073741824
Jul 30 20:41:17 devstack sudo[107971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:17 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-da780d29-2d68-4feb-8aa5-ed484097a245 tempest-ProjectMemberTests-47051868 None] Lock "cinder-quobyte-c074ebd5-979d-4513-a546-a39212515d76" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:41:17 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-da780d29-2d68-4feb-8aa5-ed484097a245 tempest-ProjectMemberTests-47051868 None] Acquiring lock "cinder-quobyte-884d7ba6-4869-454b-b49d-afa61cdad2a3" by "_delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:41:17 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-da780d29-2d68-4feb-8aa5-ed484097a245 tempest-ProjectMemberTests-47051868 None] Lock "cinder-quobyte-884d7ba6-4869-454b-b49d-afa61cdad2a3" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:41:17 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-da780d29-2d68-4feb-8aa5-ed484097a245 tempest-ProjectMemberTests-47051868 None] Deleting offline snapshot 884d7ba6-4869-454b-b49d-afa61cdad2a3 of volume c074ebd5-979d-4513-a546-a39212515d76 {{(pid=88719) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 30 20:41:17 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-da780d29-2d68-4feb-8aa5-ed484097a245 tempest-ProjectMemberTests-47051868 None] snapshot_file for this snap is: volume-c074ebd5-979d-4513-a546-a39212515d76.884d7ba6-4869-454b-b49d-afa61cdad2a3 {{(pid=88719) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 30 20:41:18 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c181895-d83f-4843-9e35-0df9d4edb700]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:41:18 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-da780d29-2d68-4feb-8aa5-ed484097a245 tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c074ebd5-979d-4513-a546-a39212515d76.884d7ba6-4869-454b-b49d-afa61cdad2a3 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:18 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-124d3446-39b8-4ac7-9ff4-4552756b62ad tempest-ProjectReaderTests-1699865179 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:41:18 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-124d3446-39b8-4ac7-9ff4-4552756b62ad tempest-ProjectReaderTests-1699865179 None] Flow 'volume_create_manager' (a892cd26-5c66-4e1d-ab69-93e792f93950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:41:18 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-124d3446-39b8-4ac7-9ff4-4552756b62ad tempest-ProjectReaderTests-1699865179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98ac7bd4-6329-449a-915f-3941b9618381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:41:18 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-124d3446-39b8-4ac7-9ff4-4552756b62ad tempest-ProjectReaderTests-1699865179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98ac7bd4-6329-449a-915f-3941b9618381) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:41:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-369525472',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01467084-b17c-43b6-b2ed-b5c486c49f69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2029c39c88314b52b1e8f64fc23f3e34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:41:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:41:18Z,use_quota=True,user_id='698804c67d0f4a778ad0b650a2b6468f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:41:18 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-124d3446-39b8-4ac7-9ff4-4552756b62ad tempest-ProjectReaderTests-1699865179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (422f9886-a826-4483-899c-61577ff0e9af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:41:18 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-124d3446-39b8-4ac7-9ff4-4552756b62ad tempest-ProjectReaderTests-1699865179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (422f9886-a826-4483-899c-61577ff0e9af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:41:18 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-124d3446-39b8-4ac7-9ff4-4552756b62ad tempest-ProjectReaderTests-1699865179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0407d8a0-53b2-4181-97fb-53b2b1905f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:41:18 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-124d3446-39b8-4ac7-9ff4-4552756b62ad tempest-ProjectReaderTests-1699865179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0407d8a0-53b2-4181-97fb-53b2b1905f2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01467084-b17c-43b6-b2ed-b5c486c49f69', 'volume_name': 'volume-01467084-b17c-43b6-b2ed-b5c486c49f69', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:41:18 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-124d3446-39b8-4ac7-9ff4-4552756b62ad tempest-ProjectReaderTests-1699865179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d29fa934-ec9e-4ee4-a87b-930592e3edb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:41:18 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-124d3446-39b8-4ac7-9ff4-4552756b62ad tempest-ProjectReaderTests-1699865179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d29fa934-ec9e-4ee4-a87b-930592e3edb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:41:18 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-124d3446-39b8-4ac7-9ff4-4552756b62ad tempest-ProjectReaderTests-1699865179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ad913ec-8a99-4d78-8e22-364087c7fc99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:41:18 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-124d3446-39b8-4ac7-9ff4-4552756b62ad tempest-ProjectReaderTests-1699865179 None] Volume 01467084-b17c-43b6-b2ed-b5c486c49f69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01467084-b17c-43b6-b2ed-b5c486c49f69', 'volume_size': 1}
Jul 30 20:41:18 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-124d3446-39b8-4ac7-9ff4-4552756b62ad tempest-ProjectReaderTests-1699865179 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:41:18 devstack sudo[107973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c074ebd5-979d-4513-a546-a39212515d76.884d7ba6-4869-454b-b49d-afa61cdad2a3
Jul 30 20:41:18 devstack sudo[107973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:18 devstack sudo[107971]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:18 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-af3472c0-02f8-422b-9d4b-fd0f357961e1 tempest-CinderUnicodeTest-615614172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-032c6e34-68dc-4cf2-93f3-31632bd2fd1a 1073741824" returned: 0 in 0.569s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:18 devstack sudo[107973]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:18 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-da780d29-2d68-4feb-8aa5-ed484097a245 tempest-ProjectMemberTests-47051868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c074ebd5-979d-4513-a546-a39212515d76.884d7ba6-4869-454b-b49d-afa61cdad2a3" returned: 0 in 0.469s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:18 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-da780d29-2d68-4feb-8aa5-ed484097a245 tempest-ProjectMemberTests-47051868 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c074ebd5-979d-4513-a546-a39212515d76(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88719) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 30 20:41:18 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-af3472c0-02f8-422b-9d4b-fd0f357961e1 tempest-CinderUnicodeTest-615614172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-032c6e34-68dc-4cf2-93f3-31632bd2fd1a {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:18 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb359280-086c-453f-96fa-656cb664c018]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:41:18 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-da780d29-2d68-4feb-8aa5-ed484097a245 tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c074ebd5-979d-4513-a546-a39212515d76 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:18 devstack sudo[107982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-032c6e34-68dc-4cf2-93f3-31632bd2fd1a
Jul 30 20:41:18 devstack sudo[107982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:18 devstack sudo[107983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c074ebd5-979d-4513-a546-a39212515d76
Jul 30 20:41:18 devstack sudo[107983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:18 devstack sudo[107982]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:18 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-af3472c0-02f8-422b-9d4b-fd0f357961e1 tempest-CinderUnicodeTest-615614172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-032c6e34-68dc-4cf2-93f3-31632bd2fd1a" returned: 0 in 0.267s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:18 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-af3472c0-02f8-422b-9d4b-fd0f357961e1 tempest-CinderUnicodeTest-615614172 None] <== create_volume: return (898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:41:18 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-af3472c0-02f8-422b-9d4b-fd0f357961e1 tempest-CinderUnicodeTest-615614172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:41:18 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-124d3446-39b8-4ac7-9ff4-4552756b62ad tempest-ProjectReaderTests-1699865179 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.637s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:41:18 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-124d3446-39b8-4ac7-9ff4-4552756b62ad tempest-ProjectReaderTests-1699865179 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:41:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-369525472',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01467084-b17c-43b6-b2ed-b5c486c49f69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2029c39c88314b52b1e8f64fc23f3e34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:41:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:41:18Z,use_quota=True,user_id='698804c67d0f4a778ad0b650a2b6468f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:41:18 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-124d3446-39b8-4ac7-9ff4-4552756b62ad tempest-ProjectReaderTests-1699865179 None] Creating volume 01467084-b17c-43b6-b2ed-b5c486c49f69 {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:41:18 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-124d3446-39b8-4ac7-9ff4-4552756b62ad tempest-ProjectReaderTests-1699865179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:41:18 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-124d3446-39b8-4ac7-9ff4-4552756b62ad tempest-ProjectReaderTests-1699865179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:41:18 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-124d3446-39b8-4ac7-9ff4-4552756b62ad tempest-ProjectReaderTests-1699865179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:41:18 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-124d3446-39b8-4ac7-9ff4-4552756b62ad tempest-ProjectReaderTests-1699865179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:41:18 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-124d3446-39b8-4ac7-9ff4-4552756b62ad tempest-ProjectReaderTests-1699865179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:41:18 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-124d3446-39b8-4ac7-9ff4-4552756b62ad tempest-ProjectReaderTests-1699865179 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:41:18 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-124d3446-39b8-4ac7-9ff4-4552756b62ad tempest-ProjectReaderTests-1699865179 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:41:18 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-124d3446-39b8-4ac7-9ff4-4552756b62ad tempest-ProjectReaderTests-1699865179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-01467084-b17c-43b6-b2ed-b5c486c49f69 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:18 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-af3472c0-02f8-422b-9d4b-fd0f357961e1 tempest-CinderUnicodeTest-615614172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e162923a-9167-4de5-99af-1ece617000d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-032c6e34-68dc-4cf2-93f3-31632bd2fd1a', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:41:18 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-af3472c0-02f8-422b-9d4b-fd0f357961e1 tempest-CinderUnicodeTest-615614172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a658bf4-5320-44d9-bc71-16264fab3926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:41:18 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-af3472c0-02f8-422b-9d4b-fd0f357961e1 tempest-CinderUnicodeTest-615614172 None] Volume volume-032c6e34-68dc-4cf2-93f3-31632bd2fd1a (032c6e34-68dc-4cf2-93f3-31632bd2fd1a): created successfully
Jul 30 20:41:18 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-af3472c0-02f8-422b-9d4b-fd0f357961e1 tempest-CinderUnicodeTest-615614172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a658bf4-5320-44d9-bc71-16264fab3926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:41:18 devstack sudo[107987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-01467084-b17c-43b6-b2ed-b5c486c49f69 1073741824
Jul 30 20:41:18 devstack sudo[107987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:18 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-af3472c0-02f8-422b-9d4b-fd0f357961e1 tempest-CinderUnicodeTest-615614172 None] Flow 'volume_create_manager' (3982a46d-f55a-4323-a779-a716cc4d45e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:41:18 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-af3472c0-02f8-422b-9d4b-fd0f357961e1 tempest-CinderUnicodeTest-615614172 None] Created volume successfully.
Jul 30 20:41:18 devstack sudo[107983]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:18 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-da780d29-2d68-4feb-8aa5-ed484097a245 tempest-ProjectMemberTests-47051868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c074ebd5-979d-4513-a546-a39212515d76" returned: 0 in 0.442s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:18 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-da780d29-2d68-4feb-8aa5-ed484097a245 tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c074ebd5-979d-4513-a546-a39212515d76.884d7ba6-4869-454b-b49d-afa61cdad2a3 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:19 devstack sudo[107992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c074ebd5-979d-4513-a546-a39212515d76.884d7ba6-4869-454b-b49d-afa61cdad2a3
Jul 30 20:41:19 devstack sudo[107992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:19 devstack sudo[107987]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:19 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-124d3446-39b8-4ac7-9ff4-4552756b62ad tempest-ProjectReaderTests-1699865179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-01467084-b17c-43b6-b2ed-b5c486c49f69 1073741824" returned: 0 in 0.548s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:19 devstack sudo[107992]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:19 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-da780d29-2d68-4feb-8aa5-ed484097a245 tempest-ProjectMemberTests-47051868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c074ebd5-979d-4513-a546-a39212515d76.884d7ba6-4869-454b-b49d-afa61cdad2a3" returned: 0 in 0.397s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:19 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-da780d29-2d68-4feb-8aa5-ed484097a245 tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c074ebd5-979d-4513-a546-a39212515d76.884d7ba6-4869-454b-b49d-afa61cdad2a3 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:19 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-124d3446-39b8-4ac7-9ff4-4552756b62ad tempest-ProjectReaderTests-1699865179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-01467084-b17c-43b6-b2ed-b5c486c49f69 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:19 devstack sudo[108001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c074ebd5-979d-4513-a546-a39212515d76.884d7ba6-4869-454b-b49d-afa61cdad2a3
Jul 30 20:41:19 devstack sudo[108001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:19 devstack sudo[108003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-01467084-b17c-43b6-b2ed-b5c486c49f69
Jul 30 20:41:19 devstack sudo[108003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:19 devstack sudo[108001]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:19 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-da780d29-2d68-4feb-8aa5-ed484097a245 tempest-ProjectMemberTests-47051868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c074ebd5-979d-4513-a546-a39212515d76.884d7ba6-4869-454b-b49d-afa61cdad2a3" returned: 0 in 0.265s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:19 devstack sudo[108003]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:19 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-124d3446-39b8-4ac7-9ff4-4552756b62ad tempest-ProjectReaderTests-1699865179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-01467084-b17c-43b6-b2ed-b5c486c49f69" returned: 0 in 0.265s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:19 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-124d3446-39b8-4ac7-9ff4-4552756b62ad tempest-ProjectReaderTests-1699865179 None] <== create_volume: return (876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:41:19 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-124d3446-39b8-4ac7-9ff4-4552756b62ad tempest-ProjectReaderTests-1699865179 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:41:19 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-da780d29-2d68-4feb-8aa5-ed484097a245 tempest-ProjectMemberTests-47051868 None] Lock "cinder-quobyte-884d7ba6-4869-454b-b49d-afa61cdad2a3" released by "_delete_snapshot" :: held 1.719s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:41:19 devstack cinder-volume[88719]: DEBUG dbcounter [-] [88719] Writing DB stats cinder:UPDATE=283,cinder:SELECT=227,cinder:INSERT=79,cinder:DELETE=22 {{(pid=88719) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 30 20:41:19 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-da780d29-2d68-4feb-8aa5-ed484097a245 tempest-ProjectMemberTests-47051868 None] Lock "cinder-quobyte-c074ebd5-979d-4513-a546-a39212515d76" released by "delete_snapshot" :: held 1.753s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:41:19 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-124d3446-39b8-4ac7-9ff4-4552756b62ad tempest-ProjectReaderTests-1699865179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ad913ec-8a99-4d78-8e22-364087c7fc99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01467084-b17c-43b6-b2ed-b5c486c49f69', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:41:19 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-124d3446-39b8-4ac7-9ff4-4552756b62ad tempest-ProjectReaderTests-1699865179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57f25fd4-dac6-4102-99c3-2f3994b252e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:41:19 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-124d3446-39b8-4ac7-9ff4-4552756b62ad tempest-ProjectReaderTests-1699865179 None] Volume volume-01467084-b17c-43b6-b2ed-b5c486c49f69 (01467084-b17c-43b6-b2ed-b5c486c49f69): created successfully
Jul 30 20:41:19 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-124d3446-39b8-4ac7-9ff4-4552756b62ad tempest-ProjectReaderTests-1699865179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57f25fd4-dac6-4102-99c3-2f3994b252e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:41:19 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-124d3446-39b8-4ac7-9ff4-4552756b62ad tempest-ProjectReaderTests-1699865179 None] Flow 'volume_create_manager' (a892cd26-5c66-4e1d-ab69-93e792f93950) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:41:19 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-124d3446-39b8-4ac7-9ff4-4552756b62ad tempest-ProjectReaderTests-1699865179 None] Created volume successfully.
Jul 30 20:41:19 devstack cinder-volume[88719]: DEBUG dbcounter [-] [88719] Writing DB stats cinder:SELECT=213,cinder:UPDATE=306,cinder:DELETE=32,cinder:INSERT=80 {{(pid=88719) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 30 20:41:19 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-da780d29-2d68-4feb-8aa5-ed484097a245 tempest-ProjectMemberTests-47051868 None] Created reservations ['900c0a53-a64b-43a9-807e-a53fe4dcba94', '254d2182-4102-40a6-a538-6c080c7e6f24', 'fcdfe45f-d8e3-4a5d-ab1f-ffe8cd7cf92f', 'a4462bda-607f-4d6b-98be-9aae90a7e6c6'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:41:19 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-da780d29-2d68-4feb-8aa5-ed484097a245 tempest-ProjectMemberTests-47051868 None] Delete snapshot completed successfully.
Jul 30 20:41:19 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-da780d29-2d68-4feb-8aa5-ed484097a245 tempest-ProjectMemberTests-47051868 None] Lock "cinder-884d7ba6-4869-454b-b49d-afa61cdad2a3-delete_snapshot" released by "delete_snapshot" :: held 1.980s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:41:19 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-3829958b-2cb9-4ce0-8825-43132e18ae38 tempest-ProjectMemberTests-47051868 None] Acquiring lock "cinder-c074ebd5-979d-4513-a546-a39212515d76-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:41:20 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-3829958b-2cb9-4ce0-8825-43132e18ae38 tempest-ProjectMemberTests-47051868 None] Lock "cinder-c074ebd5-979d-4513-a546-a39212515d76-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:41:20 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-3829958b-2cb9-4ce0-8825-43132e18ae38 tempest-ProjectMemberTests-47051868 None] Acquiring lock "cinder-quobyte-c074ebd5-979d-4513-a546-a39212515d76" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:41:20 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-3829958b-2cb9-4ce0-8825-43132e18ae38 tempest-ProjectMemberTests-47051868 None] Lock "cinder-quobyte-c074ebd5-979d-4513-a546-a39212515d76" acquired by "delete_volume" :: waited 0.032s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:41:20 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a5f109a-1490-4291-bf6d-5adc29b94850]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:41:20 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3829958b-2cb9-4ce0-8825-43132e18ae38 tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c074ebd5-979d-4513-a546-a39212515d76 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:20 devstack sudo[108007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c074ebd5-979d-4513-a546-a39212515d76
Jul 30 20:41:20 devstack sudo[108007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:20 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-61c712ac-d375-462a-a871-964c632b42e1 tempest-ProjectReaderTests-1699865179 None] Acquiring lock "cinder-01467084-b17c-43b6-b2ed-b5c486c49f69-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:41:20 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-61c712ac-d375-462a-a871-964c632b42e1 tempest-ProjectReaderTests-1699865179 None] Lock "cinder-01467084-b17c-43b6-b2ed-b5c486c49f69-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:41:20 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-c069c298-c297-441e-9fcb-746ee2ebc604 tempest-CinderUnicodeTest-615614172 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:41:20 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-c069c298-c297-441e-9fcb-746ee2ebc604 tempest-CinderUnicodeTest-615614172 None] Flow 'volume_create_manager' (062663b8-7c77-42be-8ef4-70c8f8789e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:41:20 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-c069c298-c297-441e-9fcb-746ee2ebc604 tempest-CinderUnicodeTest-615614172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (471b16c2-2c97-4549-ac98-36bcf47aedba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:41:20 devstack sudo[108007]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:20 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-c069c298-c297-441e-9fcb-746ee2ebc604 tempest-CinderUnicodeTest-615614172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (471b16c2-2c97-4549-ac98-36bcf47aedba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:41:20Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-832876311',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d80f85e-eed6-4d3a-990c-f39aebb90eaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99ca47c68c98497c819c3028412153fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:41:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:41:21Z,use_quota=True,user_id='0300e7ff90214b1a962466ec19f98793',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:41:20 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-c069c298-c297-441e-9fcb-746ee2ebc604 tempest-CinderUnicodeTest-615614172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e233f36-952e-4374-bca0-0365007860a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:41:20 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-c069c298-c297-441e-9fcb-746ee2ebc604 tempest-CinderUnicodeTest-615614172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e233f36-952e-4374-bca0-0365007860a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:41:20 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-c069c298-c297-441e-9fcb-746ee2ebc604 tempest-CinderUnicodeTest-615614172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e85a48e-6cd1-4eb5-98cd-f60c5427bd7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:41:20 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-c069c298-c297-441e-9fcb-746ee2ebc604 tempest-CinderUnicodeTest-615614172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e85a48e-6cd1-4eb5-98cd-f60c5427bd7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d80f85e-eed6-4d3a-990c-f39aebb90eaa', 'volume_name': 'volume-6d80f85e-eed6-4d3a-990c-f39aebb90eaa', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:41:20 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-c069c298-c297-441e-9fcb-746ee2ebc604 tempest-CinderUnicodeTest-615614172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c82a5cf-64b3-4419-beac-e168bf05779a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:41:20 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-c069c298-c297-441e-9fcb-746ee2ebc604 tempest-CinderUnicodeTest-615614172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c82a5cf-64b3-4419-beac-e168bf05779a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:41:20 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-c069c298-c297-441e-9fcb-746ee2ebc604 tempest-CinderUnicodeTest-615614172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0121e20-6b15-416a-9710-9da7ba9a0e37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:41:20 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-c069c298-c297-441e-9fcb-746ee2ebc604 tempest-CinderUnicodeTest-615614172 None] Volume 6d80f85e-eed6-4d3a-990c-f39aebb90eaa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d80f85e-eed6-4d3a-990c-f39aebb90eaa', 'volume_size': 1}
Jul 30 20:41:20 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-c069c298-c297-441e-9fcb-746ee2ebc604 tempest-CinderUnicodeTest-615614172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:41:20 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-c069c298-c297-441e-9fcb-746ee2ebc604 tempest-CinderUnicodeTest-615614172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:41:20 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-c069c298-c297-441e-9fcb-746ee2ebc604 tempest-CinderUnicodeTest-615614172 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:41:20Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-832876311',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d80f85e-eed6-4d3a-990c-f39aebb90eaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99ca47c68c98497c819c3028412153fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:41:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:41:21Z,use_quota=True,user_id='0300e7ff90214b1a962466ec19f98793',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:41:20 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-c069c298-c297-441e-9fcb-746ee2ebc604 tempest-CinderUnicodeTest-615614172 None] Creating volume 6d80f85e-eed6-4d3a-990c-f39aebb90eaa {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:41:20 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-c069c298-c297-441e-9fcb-746ee2ebc604 tempest-CinderUnicodeTest-615614172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:41:20 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-c069c298-c297-441e-9fcb-746ee2ebc604 tempest-CinderUnicodeTest-615614172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:41:20 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-c069c298-c297-441e-9fcb-746ee2ebc604 tempest-CinderUnicodeTest-615614172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:41:20 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-c069c298-c297-441e-9fcb-746ee2ebc604 tempest-CinderUnicodeTest-615614172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:41:20 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-c069c298-c297-441e-9fcb-746ee2ebc604 tempest-CinderUnicodeTest-615614172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:41:20 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-c069c298-c297-441e-9fcb-746ee2ebc604 tempest-CinderUnicodeTest-615614172 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:41:20 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-c069c298-c297-441e-9fcb-746ee2ebc604 tempest-CinderUnicodeTest-615614172 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:41:20 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-c069c298-c297-441e-9fcb-746ee2ebc604 tempest-CinderUnicodeTest-615614172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6d80f85e-eed6-4d3a-990c-f39aebb90eaa 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:20 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3829958b-2cb9-4ce0-8825-43132e18ae38 tempest-ProjectMemberTests-47051868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c074ebd5-979d-4513-a546-a39212515d76" returned: 0 in 0.561s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:20 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3829958b-2cb9-4ce0-8825-43132e18ae38 tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c074ebd5-979d-4513-a546-a39212515d76 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:20 devstack sudo[108012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6d80f85e-eed6-4d3a-990c-f39aebb90eaa 1073741824
Jul 30 20:41:20 devstack sudo[108012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:20 devstack sudo[108013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c074ebd5-979d-4513-a546-a39212515d76
Jul 30 20:41:20 devstack sudo[108013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:20 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-61c712ac-d375-462a-a871-964c632b42e1 tempest-ProjectReaderTests-1699865179 None] Acquiring lock "cinder-quobyte-01467084-b17c-43b6-b2ed-b5c486c49f69" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:41:20 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-61c712ac-d375-462a-a871-964c632b42e1 tempest-ProjectReaderTests-1699865179 None] Lock "cinder-quobyte-01467084-b17c-43b6-b2ed-b5c486c49f69" acquired by "delete_volume" :: waited 0.026s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:41:20 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[342a9fe6-464e-4b75-8a14-2a94e943808d]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:41:20 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-61c712ac-d375-462a-a871-964c632b42e1 tempest-ProjectReaderTests-1699865179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-01467084-b17c-43b6-b2ed-b5c486c49f69 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:21 devstack sudo[108016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-01467084-b17c-43b6-b2ed-b5c486c49f69
Jul 30 20:41:21 devstack sudo[108016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:21 devstack sudo[108013]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:21 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3829958b-2cb9-4ce0-8825-43132e18ae38 tempest-ProjectMemberTests-47051868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c074ebd5-979d-4513-a546-a39212515d76" returned: 0 in 0.281s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:21 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-3829958b-2cb9-4ce0-8825-43132e18ae38 tempest-ProjectMemberTests-47051868 None] Lock "cinder-quobyte-c074ebd5-979d-4513-a546-a39212515d76" released by "delete_volume" :: held 0.984s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:41:21 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-3829958b-2cb9-4ce0-8825-43132e18ae38 tempest-ProjectMemberTests-47051868 None] Created reservations ['297b1b13-98bc-4435-b822-6137e22f2476', '167a035c-d18f-40a1-84db-01b875a72b7d', '66f50995-b726-4812-95e3-bca9776e1f78', '03223a32-bdf4-485e-99d1-ea1dff09474e'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:41:21 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-3829958b-2cb9-4ce0-8825-43132e18ae38 tempest-ProjectMemberTests-47051868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:41:21 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-3829958b-2cb9-4ce0-8825-43132e18ae38 tempest-ProjectMemberTests-47051868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:41:21 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-3829958b-2cb9-4ce0-8825-43132e18ae38 tempest-ProjectMemberTests-47051868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:41:21 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-3829958b-2cb9-4ce0-8825-43132e18ae38 tempest-ProjectMemberTests-47051868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:41:21 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-3829958b-2cb9-4ce0-8825-43132e18ae38 tempest-ProjectMemberTests-47051868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:41:21 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3829958b-2cb9-4ce0-8825-43132e18ae38 tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:21 devstack sudo[108025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:41:21 devstack sudo[108025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:21 devstack sudo[108012]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:21 devstack sudo[108016]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:21 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-c069c298-c297-441e-9fcb-746ee2ebc604 tempest-CinderUnicodeTest-615614172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6d80f85e-eed6-4d3a-990c-f39aebb90eaa 1073741824" returned: 0 in 0.602s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:21 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-61c712ac-d375-462a-a871-964c632b42e1 tempest-ProjectReaderTests-1699865179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-01467084-b17c-43b6-b2ed-b5c486c49f69" returned: 0 in 0.470s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:21 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-61c712ac-d375-462a-a871-964c632b42e1 tempest-ProjectReaderTests-1699865179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-01467084-b17c-43b6-b2ed-b5c486c49f69 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:21 devstack sudo[108028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-01467084-b17c-43b6-b2ed-b5c486c49f69
Jul 30 20:41:21 devstack sudo[108028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:21 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-c069c298-c297-441e-9fcb-746ee2ebc604 tempest-CinderUnicodeTest-615614172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6d80f85e-eed6-4d3a-990c-f39aebb90eaa {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:21 devstack sudo[108030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6d80f85e-eed6-4d3a-990c-f39aebb90eaa
Jul 30 20:41:21 devstack sudo[108030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:21 devstack sudo[108025]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:21 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3829958b-2cb9-4ce0-8825-43132e18ae38 tempest-ProjectMemberTests-47051868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.276s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:21 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-3829958b-2cb9-4ce0-8825-43132e18ae38 tempest-ProjectMemberTests-47051868 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:41:21 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-3829958b-2cb9-4ce0-8825-43132e18ae38 tempest-ProjectMemberTests-47051868 None] Deleted volume successfully.
Jul 30 20:41:21 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-3829958b-2cb9-4ce0-8825-43132e18ae38 tempest-ProjectMemberTests-47051868 None] Lock "cinder-c074ebd5-979d-4513-a546-a39212515d76-delete_volume" released by "delete_volume" :: held 1.587s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:41:21 devstack sudo[108028]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:21 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-61c712ac-d375-462a-a871-964c632b42e1 tempest-ProjectReaderTests-1699865179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-01467084-b17c-43b6-b2ed-b5c486c49f69" returned: 0 in 0.274s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:21 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-61c712ac-d375-462a-a871-964c632b42e1 tempest-ProjectReaderTests-1699865179 None] Lock "cinder-quobyte-01467084-b17c-43b6-b2ed-b5c486c49f69" released by "delete_volume" :: held 0.799s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:41:21 devstack sudo[108030]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:21 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-c069c298-c297-441e-9fcb-746ee2ebc604 tempest-CinderUnicodeTest-615614172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6d80f85e-eed6-4d3a-990c-f39aebb90eaa" returned: 0 in 0.276s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:21 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-c069c298-c297-441e-9fcb-746ee2ebc604 tempest-CinderUnicodeTest-615614172 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:41:21 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-c069c298-c297-441e-9fcb-746ee2ebc604 tempest-CinderUnicodeTest-615614172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:41:21 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-c069c298-c297-441e-9fcb-746ee2ebc604 tempest-CinderUnicodeTest-615614172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0121e20-6b15-416a-9710-9da7ba9a0e37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d80f85e-eed6-4d3a-990c-f39aebb90eaa', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:41:21 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-c069c298-c297-441e-9fcb-746ee2ebc604 tempest-CinderUnicodeTest-615614172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98738cab-e423-40d1-ab68-58e8a79149a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:41:21 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-61c712ac-d375-462a-a871-964c632b42e1 tempest-ProjectReaderTests-1699865179 None] Created reservations ['6b4e6c0d-f406-40c5-9fa4-5a02cb6b5b3e', '498d5197-985a-4056-8b50-72c7292cc4c8', '4a3b3e39-87ef-4041-9a04-92120ac45a61', 'ea725064-9c87-4257-ad00-ddab0200377a'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:41:21 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-c069c298-c297-441e-9fcb-746ee2ebc604 tempest-CinderUnicodeTest-615614172 None] Volume volume-6d80f85e-eed6-4d3a-990c-f39aebb90eaa (6d80f85e-eed6-4d3a-990c-f39aebb90eaa): created successfully
Jul 30 20:41:21 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-c069c298-c297-441e-9fcb-746ee2ebc604 tempest-CinderUnicodeTest-615614172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98738cab-e423-40d1-ab68-58e8a79149a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:41:21 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-c069c298-c297-441e-9fcb-746ee2ebc604 tempest-CinderUnicodeTest-615614172 None] Flow 'volume_create_manager' (062663b8-7c77-42be-8ef4-70c8f8789e13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:41:21 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-c069c298-c297-441e-9fcb-746ee2ebc604 tempest-CinderUnicodeTest-615614172 None] Created volume successfully.
Jul 30 20:41:21 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-61c712ac-d375-462a-a871-964c632b42e1 tempest-ProjectReaderTests-1699865179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:41:21 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-61c712ac-d375-462a-a871-964c632b42e1 tempest-ProjectReaderTests-1699865179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:41:21 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-61c712ac-d375-462a-a871-964c632b42e1 tempest-ProjectReaderTests-1699865179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:41:21 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-61c712ac-d375-462a-a871-964c632b42e1 tempest-ProjectReaderTests-1699865179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:41:21 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-61c712ac-d375-462a-a871-964c632b42e1 tempest-ProjectReaderTests-1699865179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:41:21 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-61c712ac-d375-462a-a871-964c632b42e1 tempest-ProjectReaderTests-1699865179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:21 devstack sudo[108035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:41:21 devstack sudo[108035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:22 devstack sudo[108035]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:22 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-61c712ac-d375-462a-a871-964c632b42e1 tempest-ProjectReaderTests-1699865179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.248s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:22 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-61c712ac-d375-462a-a871-964c632b42e1 tempest-ProjectReaderTests-1699865179 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:41:22 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-61c712ac-d375-462a-a871-964c632b42e1 tempest-ProjectReaderTests-1699865179 None] Deleted volume successfully.
Jul 30 20:41:22 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-61c712ac-d375-462a-a871-964c632b42e1 tempest-ProjectReaderTests-1699865179 None] Lock "cinder-01467084-b17c-43b6-b2ed-b5c486c49f69-delete_volume" released by "delete_volume" :: held 1.449s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:41:22 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cb27619-6856-4b7b-8a50-40ad132acfc3 tempest-ProjectMemberTests-47051868 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:41:22 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-6cb27619-6856-4b7b-8a50-40ad132acfc3 tempest-ProjectMemberTests-47051868 None] Flow 'volume_create_manager' (1b0e757f-b55a-47d4-ac8f-f1c80ff50b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:41:22 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-6cb27619-6856-4b7b-8a50-40ad132acfc3 tempest-ProjectMemberTests-47051868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82cd2289-8462-4764-b3d8-864185519c27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:41:22 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-2eb7f513-fa09-4a4b-b3ce-9615d5d39abb tempest-CinderUnicodeTest-615614172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:41:22 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-2eb7f513-fa09-4a4b-b3ce-9615d5d39abb tempest-CinderUnicodeTest-615614172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:41:22 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-6cb27619-6856-4b7b-8a50-40ad132acfc3 tempest-ProjectMemberTests-47051868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82cd2289-8462-4764-b3d8-864185519c27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:41:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-417886937',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=892493b5-c610-44c9-b688-1ec8b3ee1d0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c483f66aa6ec477e9cb0547f0f04f6d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:41:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:41:23Z,use_quota=True,user_id='59a41c24b76545b79b09f90cd8c36728',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:41:22 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-6cb27619-6856-4b7b-8a50-40ad132acfc3 tempest-ProjectMemberTests-47051868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da4dfb10-f0b0-48f1-a935-487c23d04c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:41:22 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-6cb27619-6856-4b7b-8a50-40ad132acfc3 tempest-ProjectMemberTests-47051868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da4dfb10-f0b0-48f1-a935-487c23d04c49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:41:22 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-6cb27619-6856-4b7b-8a50-40ad132acfc3 tempest-ProjectMemberTests-47051868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26d32c7d-f239-4ef0-866a-ef1f34601633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:41:22 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-6cb27619-6856-4b7b-8a50-40ad132acfc3 tempest-ProjectMemberTests-47051868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26d32c7d-f239-4ef0-866a-ef1f34601633) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '892493b5-c610-44c9-b688-1ec8b3ee1d0a', 'volume_name': 'volume-892493b5-c610-44c9-b688-1ec8b3ee1d0a', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:41:22 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-6cb27619-6856-4b7b-8a50-40ad132acfc3 tempest-ProjectMemberTests-47051868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6667e566-b69c-4bba-95c5-23054da4081a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:41:22 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-6cb27619-6856-4b7b-8a50-40ad132acfc3 tempest-ProjectMemberTests-47051868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6667e566-b69c-4bba-95c5-23054da4081a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:41:22 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-6cb27619-6856-4b7b-8a50-40ad132acfc3 tempest-ProjectMemberTests-47051868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (498ddb91-645f-4f6d-9fb0-1fdc1e36da7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:41:22 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-6cb27619-6856-4b7b-8a50-40ad132acfc3 tempest-ProjectMemberTests-47051868 None] Volume 892493b5-c610-44c9-b688-1ec8b3ee1d0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-892493b5-c610-44c9-b688-1ec8b3ee1d0a', 'volume_size': 1}
Jul 30 20:41:22 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-6cb27619-6856-4b7b-8a50-40ad132acfc3 tempest-ProjectMemberTests-47051868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:41:22 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-2eb7f513-fa09-4a4b-b3ce-9615d5d39abb tempest-CinderUnicodeTest-615614172 None] Creating offline snapshot 718e8ca0-6114-40b0-94af-13a162166fa3 of volume 6d80f85e-eed6-4d3a-990c-f39aebb90eaa {{(pid=88719) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 30 20:41:22 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[8981967c-1d95-4006-ba7f-f2abac648acb]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:41:22 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2eb7f513-fa09-4a4b-b3ce-9615d5d39abb tempest-CinderUnicodeTest-615614172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6d80f85e-eed6-4d3a-990c-f39aebb90eaa {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:23 devstack sudo[108038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6d80f85e-eed6-4d3a-990c-f39aebb90eaa
Jul 30 20:41:23 devstack sudo[108038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:23 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-5baf5a34-6896-4a2c-b93f-2924166619c5 tempest-ProjectReaderTests-1699865179 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:41:23 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5baf5a34-6896-4a2c-b93f-2924166619c5 tempest-ProjectReaderTests-1699865179 None] Flow 'volume_create_manager' (2b40bb06-2771-4371-82db-f58ac4d46043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:41:23 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5baf5a34-6896-4a2c-b93f-2924166619c5 tempest-ProjectReaderTests-1699865179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (858ba34b-99a0-420e-bc91-27783646ed86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:41:23 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5baf5a34-6896-4a2c-b93f-2924166619c5 tempest-ProjectReaderTests-1699865179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (858ba34b-99a0-420e-bc91-27783646ed86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:41:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-272265630',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abe3c420-0d45-41f9-9425-bb51750bc83d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2029c39c88314b52b1e8f64fc23f3e34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:41:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:41:23Z,use_quota=True,user_id='698804c67d0f4a778ad0b650a2b6468f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:41:23 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5baf5a34-6896-4a2c-b93f-2924166619c5 tempest-ProjectReaderTests-1699865179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a9bf675-4966-4df5-8f68-f5c0cd0002ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:41:23 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5baf5a34-6896-4a2c-b93f-2924166619c5 tempest-ProjectReaderTests-1699865179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a9bf675-4966-4df5-8f68-f5c0cd0002ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:41:23 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5baf5a34-6896-4a2c-b93f-2924166619c5 tempest-ProjectReaderTests-1699865179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f768069-b71b-4035-8239-0ff5dfe011bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:41:23 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5baf5a34-6896-4a2c-b93f-2924166619c5 tempest-ProjectReaderTests-1699865179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f768069-b71b-4035-8239-0ff5dfe011bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abe3c420-0d45-41f9-9425-bb51750bc83d', 'volume_name': 'volume-abe3c420-0d45-41f9-9425-bb51750bc83d', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:41:23 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5baf5a34-6896-4a2c-b93f-2924166619c5 tempest-ProjectReaderTests-1699865179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc498c2f-986e-4a42-82e1-e903f183d087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:41:23 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5baf5a34-6896-4a2c-b93f-2924166619c5 tempest-ProjectReaderTests-1699865179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc498c2f-986e-4a42-82e1-e903f183d087) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:41:23 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5baf5a34-6896-4a2c-b93f-2924166619c5 tempest-ProjectReaderTests-1699865179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d55af10-1e7b-43f9-96cb-5280a8b62184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:41:23 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-5baf5a34-6896-4a2c-b93f-2924166619c5 tempest-ProjectReaderTests-1699865179 None] Volume abe3c420-0d45-41f9-9425-bb51750bc83d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abe3c420-0d45-41f9-9425-bb51750bc83d', 'volume_size': 1}
Jul 30 20:41:23 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-5baf5a34-6896-4a2c-b93f-2924166619c5 tempest-ProjectReaderTests-1699865179 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:41:23 devstack sudo[108038]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:23 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2eb7f513-fa09-4a4b-b3ce-9615d5d39abb tempest-CinderUnicodeTest-615614172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6d80f85e-eed6-4d3a-990c-f39aebb90eaa" returned: 0 in 0.421s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:23 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2eb7f513-fa09-4a4b-b3ce-9615d5d39abb tempest-CinderUnicodeTest-615614172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6d80f85e-eed6-4d3a-990c-f39aebb90eaa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6d80f85e-eed6-4d3a-990c-f39aebb90eaa.718e8ca0-6114-40b0-94af-13a162166fa3 1G {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:23 devstack sudo[108043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6d80f85e-eed6-4d3a-990c-f39aebb90eaa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6d80f85e-eed6-4d3a-990c-f39aebb90eaa.718e8ca0-6114-40b0-94af-13a162166fa3 1G
Jul 30 20:41:23 devstack sudo[108043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:23 devstack sudo[108043]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:23 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2eb7f513-fa09-4a4b-b3ce-9615d5d39abb tempest-CinderUnicodeTest-615614172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6d80f85e-eed6-4d3a-990c-f39aebb90eaa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6d80f85e-eed6-4d3a-990c-f39aebb90eaa.718e8ca0-6114-40b0-94af-13a162166fa3 1G" returned: 0 in 0.397s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:23 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2eb7f513-fa09-4a4b-b3ce-9615d5d39abb tempest-CinderUnicodeTest-615614172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d80f85e-eed6-4d3a-990c-f39aebb90eaa -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6d80f85e-eed6-4d3a-990c-f39aebb90eaa.718e8ca0-6114-40b0-94af-13a162166fa3 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:23 devstack sudo[108048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d80f85e-eed6-4d3a-990c-f39aebb90eaa -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6d80f85e-eed6-4d3a-990c-f39aebb90eaa.718e8ca0-6114-40b0-94af-13a162166fa3
Jul 30 20:41:23 devstack sudo[108048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:24 devstack sudo[108048]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:24 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2eb7f513-fa09-4a4b-b3ce-9615d5d39abb tempest-CinderUnicodeTest-615614172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d80f85e-eed6-4d3a-990c-f39aebb90eaa -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6d80f85e-eed6-4d3a-990c-f39aebb90eaa.718e8ca0-6114-40b0-94af-13a162166fa3" returned: 0 in 0.286s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:24 devstack cinder-volume[88719]: WARNING cinder.volume.drivers.remotefs [None req-2eb7f513-fa09-4a4b-b3ce-9615d5d39abb tempest-CinderUnicodeTest-615614172 None] /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6d80f85e-eed6-4d3a-990c-f39aebb90eaa.718e8ca0-6114-40b0-94af-13a162166fa3 is being set with open permissions: ugo+rw
Jul 30 20:41:24 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2eb7f513-fa09-4a4b-b3ce-9615d5d39abb tempest-CinderUnicodeTest-615614172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6d80f85e-eed6-4d3a-990c-f39aebb90eaa.718e8ca0-6114-40b0-94af-13a162166fa3 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:24 devstack sudo[108053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6d80f85e-eed6-4d3a-990c-f39aebb90eaa.718e8ca0-6114-40b0-94af-13a162166fa3
Jul 30 20:41:24 devstack sudo[108053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:24 devstack sudo[108053]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:24 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2eb7f513-fa09-4a4b-b3ce-9615d5d39abb tempest-CinderUnicodeTest-615614172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6d80f85e-eed6-4d3a-990c-f39aebb90eaa.718e8ca0-6114-40b0-94af-13a162166fa3" returned: 0 in 0.243s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:24 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2eb7f513-fa09-4a4b-b3ce-9615d5d39abb tempest-CinderUnicodeTest-615614172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6d80f85e-eed6-4d3a-990c-f39aebb90eaa.info {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:24 devstack sudo[108056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6d80f85e-eed6-4d3a-990c-f39aebb90eaa.info
Jul 30 20:41:24 devstack sudo[108056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:24 devstack sudo[108056]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:24 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2eb7f513-fa09-4a4b-b3ce-9615d5d39abb tempest-CinderUnicodeTest-615614172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6d80f85e-eed6-4d3a-990c-f39aebb90eaa.info" returned: 0 in 0.240s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:24 devstack cinder-volume[88719]: WARNING cinder.volume.drivers.remotefs [None req-2eb7f513-fa09-4a4b-b3ce-9615d5d39abb tempest-CinderUnicodeTest-615614172 None] /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6d80f85e-eed6-4d3a-990c-f39aebb90eaa.info is being set with open permissions: ugo+rw
Jul 30 20:41:24 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2eb7f513-fa09-4a4b-b3ce-9615d5d39abb tempest-CinderUnicodeTest-615614172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6d80f85e-eed6-4d3a-990c-f39aebb90eaa.info {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:24 devstack sudo[108059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6d80f85e-eed6-4d3a-990c-f39aebb90eaa.info
Jul 30 20:41:24 devstack sudo[108059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:24 devstack sudo[108059]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:24 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2eb7f513-fa09-4a4b-b3ce-9615d5d39abb tempest-CinderUnicodeTest-615614172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6d80f85e-eed6-4d3a-990c-f39aebb90eaa.info" returned: 0 in 0.243s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:24 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-2eb7f513-fa09-4a4b-b3ce-9615d5d39abb tempest-CinderUnicodeTest-615614172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.960s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:41:24 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-6cb27619-6856-4b7b-8a50-40ad132acfc3 tempest-ProjectMemberTests-47051868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.910s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:41:24 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-6cb27619-6856-4b7b-8a50-40ad132acfc3 tempest-ProjectMemberTests-47051868 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:41:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-417886937',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=892493b5-c610-44c9-b688-1ec8b3ee1d0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c483f66aa6ec477e9cb0547f0f04f6d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:41:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:41:23Z,use_quota=True,user_id='59a41c24b76545b79b09f90cd8c36728',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:41:24 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-6cb27619-6856-4b7b-8a50-40ad132acfc3 tempest-ProjectMemberTests-47051868 None] Creating volume 892493b5-c610-44c9-b688-1ec8b3ee1d0a {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:41:24 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-6cb27619-6856-4b7b-8a50-40ad132acfc3 tempest-ProjectMemberTests-47051868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:41:24 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-6cb27619-6856-4b7b-8a50-40ad132acfc3 tempest-ProjectMemberTests-47051868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:41:24 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-6cb27619-6856-4b7b-8a50-40ad132acfc3 tempest-ProjectMemberTests-47051868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:41:24 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-6cb27619-6856-4b7b-8a50-40ad132acfc3 tempest-ProjectMemberTests-47051868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:41:24 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-6cb27619-6856-4b7b-8a50-40ad132acfc3 tempest-ProjectMemberTests-47051868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:41:24 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-6cb27619-6856-4b7b-8a50-40ad132acfc3 tempest-ProjectMemberTests-47051868 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:41:24 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-6cb27619-6856-4b7b-8a50-40ad132acfc3 tempest-ProjectMemberTests-47051868 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:41:24 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-6cb27619-6856-4b7b-8a50-40ad132acfc3 tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-892493b5-c610-44c9-b688-1ec8b3ee1d0a 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:24 devstack sudo[108062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-892493b5-c610-44c9-b688-1ec8b3ee1d0a 1073741824
Jul 30 20:41:24 devstack sudo[108062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:24 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-2eb7f513-fa09-4a4b-b3ce-9615d5d39abb tempest-CinderUnicodeTest-615614172 None] Create snapshot completed successfully
Jul 30 20:41:25 devstack sudo[108062]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:25 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-6cb27619-6856-4b7b-8a50-40ad132acfc3 tempest-ProjectMemberTests-47051868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-892493b5-c610-44c9-b688-1ec8b3ee1d0a 1073741824" returned: 0 in 0.407s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:25 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-6cb27619-6856-4b7b-8a50-40ad132acfc3 tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-892493b5-c610-44c9-b688-1ec8b3ee1d0a {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:25 devstack sudo[108069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-892493b5-c610-44c9-b688-1ec8b3ee1d0a
Jul 30 20:41:25 devstack sudo[108069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:25 devstack sudo[108069]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:25 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-6cb27619-6856-4b7b-8a50-40ad132acfc3 tempest-ProjectMemberTests-47051868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-892493b5-c610-44c9-b688-1ec8b3ee1d0a" returned: 0 in 0.239s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:25 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-6cb27619-6856-4b7b-8a50-40ad132acfc3 tempest-ProjectMemberTests-47051868 None] <== create_volume: return (683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:41:25 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-6cb27619-6856-4b7b-8a50-40ad132acfc3 tempest-ProjectMemberTests-47051868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.686s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:41:25 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-5baf5a34-6896-4a2c-b93f-2924166619c5 tempest-ProjectReaderTests-1699865179 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.165s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:41:25 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-5baf5a34-6896-4a2c-b93f-2924166619c5 tempest-ProjectReaderTests-1699865179 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:41:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-272265630',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abe3c420-0d45-41f9-9425-bb51750bc83d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2029c39c88314b52b1e8f64fc23f3e34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:41:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:41:23Z,use_quota=True,user_id='698804c67d0f4a778ad0b650a2b6468f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:41:25 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-5baf5a34-6896-4a2c-b93f-2924166619c5 tempest-ProjectReaderTests-1699865179 None] Creating volume abe3c420-0d45-41f9-9425-bb51750bc83d {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:41:25 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-5baf5a34-6896-4a2c-b93f-2924166619c5 tempest-ProjectReaderTests-1699865179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:41:25 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-5baf5a34-6896-4a2c-b93f-2924166619c5 tempest-ProjectReaderTests-1699865179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:41:25 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-5baf5a34-6896-4a2c-b93f-2924166619c5 tempest-ProjectReaderTests-1699865179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:41:25 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-5baf5a34-6896-4a2c-b93f-2924166619c5 tempest-ProjectReaderTests-1699865179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:41:25 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-5baf5a34-6896-4a2c-b93f-2924166619c5 tempest-ProjectReaderTests-1699865179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:41:25 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-5baf5a34-6896-4a2c-b93f-2924166619c5 tempest-ProjectReaderTests-1699865179 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:41:25 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-5baf5a34-6896-4a2c-b93f-2924166619c5 tempest-ProjectReaderTests-1699865179 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:41:25 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-5baf5a34-6896-4a2c-b93f-2924166619c5 tempest-ProjectReaderTests-1699865179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-abe3c420-0d45-41f9-9425-bb51750bc83d 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:25 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-6cb27619-6856-4b7b-8a50-40ad132acfc3 tempest-ProjectMemberTests-47051868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (498ddb91-645f-4f6d-9fb0-1fdc1e36da7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-892493b5-c610-44c9-b688-1ec8b3ee1d0a', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:41:25 devstack sudo[108072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-abe3c420-0d45-41f9-9425-bb51750bc83d 1073741824
Jul 30 20:41:25 devstack sudo[108072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:25 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-6cb27619-6856-4b7b-8a50-40ad132acfc3 tempest-ProjectMemberTests-47051868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21e9ce43-5af9-41e0-8858-d0e4a2fecb86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:41:25 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-6cb27619-6856-4b7b-8a50-40ad132acfc3 tempest-ProjectMemberTests-47051868 None] Volume volume-892493b5-c610-44c9-b688-1ec8b3ee1d0a (892493b5-c610-44c9-b688-1ec8b3ee1d0a): created successfully
Jul 30 20:41:25 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-6cb27619-6856-4b7b-8a50-40ad132acfc3 tempest-ProjectMemberTests-47051868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21e9ce43-5af9-41e0-8858-d0e4a2fecb86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:41:25 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-6cb27619-6856-4b7b-8a50-40ad132acfc3 tempest-ProjectMemberTests-47051868 None] Flow 'volume_create_manager' (1b0e757f-b55a-47d4-ac8f-f1c80ff50b5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:41:25 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-6cb27619-6856-4b7b-8a50-40ad132acfc3 tempest-ProjectMemberTests-47051868 None] Created volume successfully.
Jul 30 20:41:26 devstack sudo[108072]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:26 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-5baf5a34-6896-4a2c-b93f-2924166619c5 tempest-ProjectReaderTests-1699865179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-abe3c420-0d45-41f9-9425-bb51750bc83d 1073741824" returned: 0 in 0.442s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:26 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-5baf5a34-6896-4a2c-b93f-2924166619c5 tempest-ProjectReaderTests-1699865179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-abe3c420-0d45-41f9-9425-bb51750bc83d {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:26 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-722179e0-aef7-4f7f-b3ff-85edcea7d7cc tempest-CinderUnicodeTest-615614172 None] Acquiring lock "cinder-718e8ca0-6114-40b0-94af-13a162166fa3-delete_snapshot" by "delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:41:26 devstack sudo[108078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-abe3c420-0d45-41f9-9425-bb51750bc83d
Jul 30 20:41:26 devstack sudo[108078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:26 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-722179e0-aef7-4f7f-b3ff-85edcea7d7cc tempest-CinderUnicodeTest-615614172 None] Lock "cinder-718e8ca0-6114-40b0-94af-13a162166fa3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:41:26 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-722179e0-aef7-4f7f-b3ff-85edcea7d7cc tempest-CinderUnicodeTest-615614172 None] Acquiring lock "cinder-quobyte-6d80f85e-eed6-4d3a-990c-f39aebb90eaa" by "delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:41:26 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-722179e0-aef7-4f7f-b3ff-85edcea7d7cc tempest-CinderUnicodeTest-615614172 None] Lock "cinder-quobyte-6d80f85e-eed6-4d3a-990c-f39aebb90eaa" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:41:26 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-722179e0-aef7-4f7f-b3ff-85edcea7d7cc tempest-CinderUnicodeTest-615614172 None] Acquiring lock "cinder-quobyte-718e8ca0-6114-40b0-94af-13a162166fa3" by "_delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:41:26 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-9f9508f8-1e5d-435a-9396-c351b3f11df6 tempest-ProjectMemberTests-47051868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:41:26 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-722179e0-aef7-4f7f-b3ff-85edcea7d7cc tempest-CinderUnicodeTest-615614172 None] Lock "cinder-quobyte-718e8ca0-6114-40b0-94af-13a162166fa3" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:41:26 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-722179e0-aef7-4f7f-b3ff-85edcea7d7cc tempest-CinderUnicodeTest-615614172 None] Deleting offline snapshot 718e8ca0-6114-40b0-94af-13a162166fa3 of volume 6d80f85e-eed6-4d3a-990c-f39aebb90eaa {{(pid=88719) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 30 20:41:26 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-722179e0-aef7-4f7f-b3ff-85edcea7d7cc tempest-CinderUnicodeTest-615614172 None] snapshot_file for this snap is: volume-6d80f85e-eed6-4d3a-990c-f39aebb90eaa.718e8ca0-6114-40b0-94af-13a162166fa3 {{(pid=88719) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 30 20:41:26 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[feeeb512-e19b-43f9-ba3a-c2f81a9cabc8]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:41:26 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-722179e0-aef7-4f7f-b3ff-85edcea7d7cc tempest-CinderUnicodeTest-615614172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6d80f85e-eed6-4d3a-990c-f39aebb90eaa.718e8ca0-6114-40b0-94af-13a162166fa3 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:26 devstack sudo[108080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6d80f85e-eed6-4d3a-990c-f39aebb90eaa.718e8ca0-6114-40b0-94af-13a162166fa3
Jul 30 20:41:26 devstack sudo[108080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:26 devstack sudo[108078]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:26 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-5baf5a34-6896-4a2c-b93f-2924166619c5 tempest-ProjectReaderTests-1699865179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-abe3c420-0d45-41f9-9425-bb51750bc83d" returned: 0 in 0.273s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:26 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-5baf5a34-6896-4a2c-b93f-2924166619c5 tempest-ProjectReaderTests-1699865179 None] <== create_volume: return (767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:41:26 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-5baf5a34-6896-4a2c-b93f-2924166619c5 tempest-ProjectReaderTests-1699865179 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:41:26 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-9f9508f8-1e5d-435a-9396-c351b3f11df6 tempest-ProjectMemberTests-47051868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.192s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:41:26 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5baf5a34-6896-4a2c-b93f-2924166619c5 tempest-ProjectReaderTests-1699865179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d55af10-1e7b-43f9-96cb-5280a8b62184) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abe3c420-0d45-41f9-9425-bb51750bc83d', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:41:26 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5baf5a34-6896-4a2c-b93f-2924166619c5 tempest-ProjectReaderTests-1699865179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c7a0cab-0bd3-432d-ace2-a8e1623c1f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:41:26 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-9f9508f8-1e5d-435a-9396-c351b3f11df6 tempest-ProjectMemberTests-47051868 None] Creating offline snapshot f1a9b171-1617-490a-8c12-6abb0a61b87d of volume 892493b5-c610-44c9-b688-1ec8b3ee1d0a {{(pid=88719) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 30 20:41:26 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-5baf5a34-6896-4a2c-b93f-2924166619c5 tempest-ProjectReaderTests-1699865179 None] Volume volume-abe3c420-0d45-41f9-9425-bb51750bc83d (abe3c420-0d45-41f9-9425-bb51750bc83d): created successfully
Jul 30 20:41:26 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5baf5a34-6896-4a2c-b93f-2924166619c5 tempest-ProjectReaderTests-1699865179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c7a0cab-0bd3-432d-ace2-a8e1623c1f09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:41:26 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-5baf5a34-6896-4a2c-b93f-2924166619c5 tempest-ProjectReaderTests-1699865179 None] Flow 'volume_create_manager' (2b40bb06-2771-4371-82db-f58ac4d46043) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:41:26 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[38e9874a-a060-4fb9-b057-e22a33573cf8]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:41:26 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-9f9508f8-1e5d-435a-9396-c351b3f11df6 tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-892493b5-c610-44c9-b688-1ec8b3ee1d0a {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:26 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-5baf5a34-6896-4a2c-b93f-2924166619c5 tempest-ProjectReaderTests-1699865179 None] Created volume successfully.
Jul 30 20:41:26 devstack sudo[108083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-892493b5-c610-44c9-b688-1ec8b3ee1d0a
Jul 30 20:41:26 devstack sudo[108083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:26 devstack sudo[108080]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:26 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-722179e0-aef7-4f7f-b3ff-85edcea7d7cc tempest-CinderUnicodeTest-615614172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6d80f85e-eed6-4d3a-990c-f39aebb90eaa.718e8ca0-6114-40b0-94af-13a162166fa3" returned: 0 in 0.382s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:26 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-722179e0-aef7-4f7f-b3ff-85edcea7d7cc tempest-CinderUnicodeTest-615614172 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6d80f85e-eed6-4d3a-990c-f39aebb90eaa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88719) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 30 20:41:26 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f38712c-859c-47e7-926c-a441551abf45]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:41:26 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-722179e0-aef7-4f7f-b3ff-85edcea7d7cc tempest-CinderUnicodeTest-615614172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6d80f85e-eed6-4d3a-990c-f39aebb90eaa {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:26 devstack sudo[108088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6d80f85e-eed6-4d3a-990c-f39aebb90eaa
Jul 30 20:41:26 devstack sudo[108088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:26 devstack sudo[108083]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:26 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-9f9508f8-1e5d-435a-9396-c351b3f11df6 tempest-ProjectMemberTests-47051868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-892493b5-c610-44c9-b688-1ec8b3ee1d0a" returned: 0 in 0.371s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:26 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-9f9508f8-1e5d-435a-9396-c351b3f11df6 tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-892493b5-c610-44c9-b688-1ec8b3ee1d0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-892493b5-c610-44c9-b688-1ec8b3ee1d0a.f1a9b171-1617-490a-8c12-6abb0a61b87d 1G {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:26 devstack sudo[108093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-892493b5-c610-44c9-b688-1ec8b3ee1d0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-892493b5-c610-44c9-b688-1ec8b3ee1d0a.f1a9b171-1617-490a-8c12-6abb0a61b87d 1G
Jul 30 20:41:26 devstack sudo[108093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:26 devstack sudo[108088]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:26 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-722179e0-aef7-4f7f-b3ff-85edcea7d7cc tempest-CinderUnicodeTest-615614172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6d80f85e-eed6-4d3a-990c-f39aebb90eaa" returned: 0 in 0.356s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:26 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-722179e0-aef7-4f7f-b3ff-85edcea7d7cc tempest-CinderUnicodeTest-615614172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6d80f85e-eed6-4d3a-990c-f39aebb90eaa.718e8ca0-6114-40b0-94af-13a162166fa3 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:26 devstack sudo[108098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6d80f85e-eed6-4d3a-990c-f39aebb90eaa.718e8ca0-6114-40b0-94af-13a162166fa3
Jul 30 20:41:26 devstack sudo[108098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:27 devstack sudo[108093]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:27 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-9f9508f8-1e5d-435a-9396-c351b3f11df6 tempest-ProjectMemberTests-47051868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-892493b5-c610-44c9-b688-1ec8b3ee1d0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-892493b5-c610-44c9-b688-1ec8b3ee1d0a.f1a9b171-1617-490a-8c12-6abb0a61b87d 1G" returned: 0 in 0.424s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:27 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-9f9508f8-1e5d-435a-9396-c351b3f11df6 tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-892493b5-c610-44c9-b688-1ec8b3ee1d0a -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-892493b5-c610-44c9-b688-1ec8b3ee1d0a.f1a9b171-1617-490a-8c12-6abb0a61b87d {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:27 devstack sudo[108105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-892493b5-c610-44c9-b688-1ec8b3ee1d0a -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-892493b5-c610-44c9-b688-1ec8b3ee1d0a.f1a9b171-1617-490a-8c12-6abb0a61b87d
Jul 30 20:41:27 devstack sudo[108105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:27 devstack sudo[108098]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:27 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-722179e0-aef7-4f7f-b3ff-85edcea7d7cc tempest-CinderUnicodeTest-615614172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6d80f85e-eed6-4d3a-990c-f39aebb90eaa.718e8ca0-6114-40b0-94af-13a162166fa3" returned: 0 in 0.355s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:27 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-722179e0-aef7-4f7f-b3ff-85edcea7d7cc tempest-CinderUnicodeTest-615614172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6d80f85e-eed6-4d3a-990c-f39aebb90eaa.718e8ca0-6114-40b0-94af-13a162166fa3 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:27 devstack sudo[108108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6d80f85e-eed6-4d3a-990c-f39aebb90eaa.718e8ca0-6114-40b0-94af-13a162166fa3
Jul 30 20:41:27 devstack sudo[108108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:27 devstack sudo[108105]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:27 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-9f9508f8-1e5d-435a-9396-c351b3f11df6 tempest-ProjectMemberTests-47051868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-892493b5-c610-44c9-b688-1ec8b3ee1d0a -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-892493b5-c610-44c9-b688-1ec8b3ee1d0a.f1a9b171-1617-490a-8c12-6abb0a61b87d" returned: 0 in 0.319s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:27 devstack cinder-volume[88719]: WARNING cinder.volume.drivers.remotefs [None req-9f9508f8-1e5d-435a-9396-c351b3f11df6 tempest-ProjectMemberTests-47051868 None] /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-892493b5-c610-44c9-b688-1ec8b3ee1d0a.f1a9b171-1617-490a-8c12-6abb0a61b87d is being set with open permissions: ugo+rw
Jul 30 20:41:27 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-9f9508f8-1e5d-435a-9396-c351b3f11df6 tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-892493b5-c610-44c9-b688-1ec8b3ee1d0a.f1a9b171-1617-490a-8c12-6abb0a61b87d {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:27 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-e5217ae6-de20-4ab3-868e-10904f9fc6de tempest-ProjectReaderTests-1699865179 None] Acquiring lock "cinder-abe3c420-0d45-41f9-9425-bb51750bc83d-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:41:27 devstack sudo[108114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-892493b5-c610-44c9-b688-1ec8b3ee1d0a.f1a9b171-1617-490a-8c12-6abb0a61b87d
Jul 30 20:41:27 devstack sudo[108114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:27 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-e5217ae6-de20-4ab3-868e-10904f9fc6de tempest-ProjectReaderTests-1699865179 None] Lock "cinder-abe3c420-0d45-41f9-9425-bb51750bc83d-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:41:27 devstack sudo[108108]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:27 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-722179e0-aef7-4f7f-b3ff-85edcea7d7cc tempest-CinderUnicodeTest-615614172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6d80f85e-eed6-4d3a-990c-f39aebb90eaa.718e8ca0-6114-40b0-94af-13a162166fa3" returned: 0 in 0.295s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:27 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-722179e0-aef7-4f7f-b3ff-85edcea7d7cc tempest-CinderUnicodeTest-615614172 None] Lock "cinder-quobyte-718e8ca0-6114-40b0-94af-13a162166fa3" released by "_delete_snapshot" :: held 1.506s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:41:27 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-e5217ae6-de20-4ab3-868e-10904f9fc6de tempest-ProjectReaderTests-1699865179 None] Acquiring lock "cinder-quobyte-abe3c420-0d45-41f9-9425-bb51750bc83d" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:41:27 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-722179e0-aef7-4f7f-b3ff-85edcea7d7cc tempest-CinderUnicodeTest-615614172 None] Lock "cinder-quobyte-6d80f85e-eed6-4d3a-990c-f39aebb90eaa" released by "delete_snapshot" :: held 1.531s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:41:27 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-e5217ae6-de20-4ab3-868e-10904f9fc6de tempest-ProjectReaderTests-1699865179 None] Lock "cinder-quobyte-abe3c420-0d45-41f9-9425-bb51750bc83d" acquired by "delete_volume" :: waited 0.018s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:41:27 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[e583a13f-3687-490b-95d4-77238b27e0c6]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:41:27 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-e5217ae6-de20-4ab3-868e-10904f9fc6de tempest-ProjectReaderTests-1699865179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-abe3c420-0d45-41f9-9425-bb51750bc83d {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:27 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-722179e0-aef7-4f7f-b3ff-85edcea7d7cc tempest-CinderUnicodeTest-615614172 None] Created reservations ['85c530ee-4118-459e-917f-b0526aae98ff', 'aa58d6db-435a-413f-ba6e-c7f3b0d514ef', '17ff2d8f-143a-4e39-a486-019e6ed49ccc', '2f8a9904-7038-4152-8503-a573a635321c'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:41:27 devstack sudo[108114]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:27 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-722179e0-aef7-4f7f-b3ff-85edcea7d7cc tempest-CinderUnicodeTest-615614172 None] Delete snapshot completed successfully.
Jul 30 20:41:27 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-9f9508f8-1e5d-435a-9396-c351b3f11df6 tempest-ProjectMemberTests-47051868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-892493b5-c610-44c9-b688-1ec8b3ee1d0a.f1a9b171-1617-490a-8c12-6abb0a61b87d" returned: 0 in 0.293s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:27 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-722179e0-aef7-4f7f-b3ff-85edcea7d7cc tempest-CinderUnicodeTest-615614172 None] Lock "cinder-718e8ca0-6114-40b0-94af-13a162166fa3-delete_snapshot" released by "delete_snapshot" :: held 1.707s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:41:27 devstack sudo[108117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-abe3c420-0d45-41f9-9425-bb51750bc83d
Jul 30 20:41:27 devstack sudo[108117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:27 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-9f9508f8-1e5d-435a-9396-c351b3f11df6 tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-892493b5-c610-44c9-b688-1ec8b3ee1d0a.info {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:27 devstack sudo[108120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-892493b5-c610-44c9-b688-1ec8b3ee1d0a.info
Jul 30 20:41:27 devstack sudo[108120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:28 devstack sudo[108117]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:28 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-e5217ae6-de20-4ab3-868e-10904f9fc6de tempest-ProjectReaderTests-1699865179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-abe3c420-0d45-41f9-9425-bb51750bc83d" returned: 0 in 0.368s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:28 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-e5217ae6-de20-4ab3-868e-10904f9fc6de tempest-ProjectReaderTests-1699865179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-abe3c420-0d45-41f9-9425-bb51750bc83d {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:28 devstack sudo[108120]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:28 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-9f9508f8-1e5d-435a-9396-c351b3f11df6 tempest-ProjectMemberTests-47051868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-892493b5-c610-44c9-b688-1ec8b3ee1d0a.info" returned: 0 in 0.247s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:28 devstack cinder-volume[88719]: WARNING cinder.volume.drivers.remotefs [None req-9f9508f8-1e5d-435a-9396-c351b3f11df6 tempest-ProjectMemberTests-47051868 None] /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-892493b5-c610-44c9-b688-1ec8b3ee1d0a.info is being set with open permissions: ugo+rw
Jul 30 20:41:28 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-9f9508f8-1e5d-435a-9396-c351b3f11df6 tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-892493b5-c610-44c9-b688-1ec8b3ee1d0a.info {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:28 devstack sudo[108126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-abe3c420-0d45-41f9-9425-bb51750bc83d
Jul 30 20:41:28 devstack sudo[108126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:28 devstack sudo[108127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-892493b5-c610-44c9-b688-1ec8b3ee1d0a.info
Jul 30 20:41:28 devstack sudo[108127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:28 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-2241a2fc-7cb1-4a59-88cc-0b7c3b520497 tempest-CinderUnicodeTest-615614172 None] Acquiring lock "cinder-6d80f85e-eed6-4d3a-990c-f39aebb90eaa-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:41:28 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-2241a2fc-7cb1-4a59-88cc-0b7c3b520497 tempest-CinderUnicodeTest-615614172 None] Lock "cinder-6d80f85e-eed6-4d3a-990c-f39aebb90eaa-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:41:28 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-2241a2fc-7cb1-4a59-88cc-0b7c3b520497 tempest-CinderUnicodeTest-615614172 None] Acquiring lock "cinder-quobyte-6d80f85e-eed6-4d3a-990c-f39aebb90eaa" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:41:28 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-2241a2fc-7cb1-4a59-88cc-0b7c3b520497 tempest-CinderUnicodeTest-615614172 None] Lock "cinder-quobyte-6d80f85e-eed6-4d3a-990c-f39aebb90eaa" acquired by "delete_volume" :: waited 0.016s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:41:28 devstack sudo[108126]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:28 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-e5217ae6-de20-4ab3-868e-10904f9fc6de tempest-ProjectReaderTests-1699865179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-abe3c420-0d45-41f9-9425-bb51750bc83d" returned: 0 in 0.293s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:28 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e5df905-29c0-40e3-b720-b1a53f36ea92]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:41:28 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-e5217ae6-de20-4ab3-868e-10904f9fc6de tempest-ProjectReaderTests-1699865179 None] Lock "cinder-quobyte-abe3c420-0d45-41f9-9425-bb51750bc83d" released by "delete_volume" :: held 0.702s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:41:28 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2241a2fc-7cb1-4a59-88cc-0b7c3b520497 tempest-CinderUnicodeTest-615614172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6d80f85e-eed6-4d3a-990c-f39aebb90eaa {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:28 devstack sudo[108127]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:28 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-9f9508f8-1e5d-435a-9396-c351b3f11df6 tempest-ProjectMemberTests-47051868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-892493b5-c610-44c9-b688-1ec8b3ee1d0a.info" returned: 0 in 0.318s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:28 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-9f9508f8-1e5d-435a-9396-c351b3f11df6 tempest-ProjectMemberTests-47051868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.090s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:41:28 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-9f9508f8-1e5d-435a-9396-c351b3f11df6 tempest-ProjectMemberTests-47051868 None] Create snapshot completed successfully
Jul 30 20:41:28 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-e5217ae6-de20-4ab3-868e-10904f9fc6de tempest-ProjectReaderTests-1699865179 None] Created reservations ['e5587370-ad81-4d7f-921e-c03752912215', 'c18c38fa-3f5d-41d5-8a83-7cee4a3d0ecc', '13cec65b-4929-4ec0-b262-eb971f399292', '6871217e-eca4-459a-93ff-b57ba467a3a2'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:41:28 devstack sudo[108132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6d80f85e-eed6-4d3a-990c-f39aebb90eaa
Jul 30 20:41:28 devstack sudo[108132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:28 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-e5217ae6-de20-4ab3-868e-10904f9fc6de tempest-ProjectReaderTests-1699865179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:41:28 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-e5217ae6-de20-4ab3-868e-10904f9fc6de tempest-ProjectReaderTests-1699865179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:41:28 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-e5217ae6-de20-4ab3-868e-10904f9fc6de tempest-ProjectReaderTests-1699865179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:41:28 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-e5217ae6-de20-4ab3-868e-10904f9fc6de tempest-ProjectReaderTests-1699865179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:41:28 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-e5217ae6-de20-4ab3-868e-10904f9fc6de tempest-ProjectReaderTests-1699865179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:41:28 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-e5217ae6-de20-4ab3-868e-10904f9fc6de tempest-ProjectReaderTests-1699865179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:28 devstack sudo[108134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:41:28 devstack sudo[108134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:28 devstack sudo[108132]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:28 devstack sudo[108134]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:28 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2241a2fc-7cb1-4a59-88cc-0b7c3b520497 tempest-CinderUnicodeTest-615614172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6d80f85e-eed6-4d3a-990c-f39aebb90eaa" returned: 0 in 0.419s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:28 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2241a2fc-7cb1-4a59-88cc-0b7c3b520497 tempest-CinderUnicodeTest-615614172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6d80f85e-eed6-4d3a-990c-f39aebb90eaa {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:28 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-e5217ae6-de20-4ab3-868e-10904f9fc6de tempest-ProjectReaderTests-1699865179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.267s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:28 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-e5217ae6-de20-4ab3-868e-10904f9fc6de tempest-ProjectReaderTests-1699865179 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:41:28 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-e5217ae6-de20-4ab3-868e-10904f9fc6de tempest-ProjectReaderTests-1699865179 None] Deleted volume successfully.
Jul 30 20:41:28 devstack sudo[108140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6d80f85e-eed6-4d3a-990c-f39aebb90eaa
Jul 30 20:41:28 devstack sudo[108140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:28 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-e5217ae6-de20-4ab3-868e-10904f9fc6de tempest-ProjectReaderTests-1699865179 None] Lock "cinder-abe3c420-0d45-41f9-9425-bb51750bc83d-delete_volume" released by "delete_volume" :: held 1.304s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:41:29 devstack sudo[108140]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:29 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2241a2fc-7cb1-4a59-88cc-0b7c3b520497 tempest-CinderUnicodeTest-615614172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6d80f85e-eed6-4d3a-990c-f39aebb90eaa" returned: 0 in 0.278s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:29 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-2241a2fc-7cb1-4a59-88cc-0b7c3b520497 tempest-CinderUnicodeTest-615614172 None] Lock "cinder-quobyte-6d80f85e-eed6-4d3a-990c-f39aebb90eaa" released by "delete_volume" :: held 0.775s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:41:29 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-2241a2fc-7cb1-4a59-88cc-0b7c3b520497 tempest-CinderUnicodeTest-615614172 None] Created reservations ['45aae7a8-8848-4364-a32b-5a6f416700c2', '706c4ffe-c84f-400c-a7d0-60ae3811da6e', 'a2606c42-048d-4719-8cc5-797a823b412a', '73e44cc0-a11b-4b2d-830e-c42410512de9'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:41:29 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-cba08175-53f2-477b-b235-28a08e38c1fd tempest-ProjectReaderTests-1699865179 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:41:29 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-cba08175-53f2-477b-b235-28a08e38c1fd tempest-ProjectReaderTests-1699865179 None] Flow 'volume_create_manager' (b9d4d38e-a2f6-44fc-bd50-da9c52c5ed42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:41:29 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-cba08175-53f2-477b-b235-28a08e38c1fd tempest-ProjectReaderTests-1699865179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0395f8e-e3d0-4aab-a821-95cd7bca2637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:41:29 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-2241a2fc-7cb1-4a59-88cc-0b7c3b520497 tempest-CinderUnicodeTest-615614172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:41:29 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-2241a2fc-7cb1-4a59-88cc-0b7c3b520497 tempest-CinderUnicodeTest-615614172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:41:29 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-2241a2fc-7cb1-4a59-88cc-0b7c3b520497 tempest-CinderUnicodeTest-615614172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:41:29 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-2241a2fc-7cb1-4a59-88cc-0b7c3b520497 tempest-CinderUnicodeTest-615614172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:41:29 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-2241a2fc-7cb1-4a59-88cc-0b7c3b520497 tempest-CinderUnicodeTest-615614172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:41:29 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2241a2fc-7cb1-4a59-88cc-0b7c3b520497 tempest-CinderUnicodeTest-615614172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:29 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-cba08175-53f2-477b-b235-28a08e38c1fd tempest-ProjectReaderTests-1699865179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0395f8e-e3d0-4aab-a821-95cd7bca2637) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:41:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2018957182',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6b92763-212c-4b09-b2b5-207e144f8808,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2029c39c88314b52b1e8f64fc23f3e34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:41:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:41:29Z,use_quota=True,user_id='698804c67d0f4a778ad0b650a2b6468f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:41:29 devstack sudo[108143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:41:29 devstack sudo[108143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:29 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-cba08175-53f2-477b-b235-28a08e38c1fd tempest-ProjectReaderTests-1699865179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8238d967-82fe-4a45-bcc0-8afee5f1bce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:41:29 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-cba08175-53f2-477b-b235-28a08e38c1fd tempest-ProjectReaderTests-1699865179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8238d967-82fe-4a45-bcc0-8afee5f1bce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:41:29 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-cba08175-53f2-477b-b235-28a08e38c1fd tempest-ProjectReaderTests-1699865179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b9126ca-8490-4331-a26d-3ff7019d12ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:41:29 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-cba08175-53f2-477b-b235-28a08e38c1fd tempest-ProjectReaderTests-1699865179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b9126ca-8490-4331-a26d-3ff7019d12ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6b92763-212c-4b09-b2b5-207e144f8808', 'volume_name': 'volume-f6b92763-212c-4b09-b2b5-207e144f8808', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:41:29 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-cba08175-53f2-477b-b235-28a08e38c1fd tempest-ProjectReaderTests-1699865179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (403ffd2c-4147-4f4a-8980-43a9fd8916d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:41:29 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-cba08175-53f2-477b-b235-28a08e38c1fd tempest-ProjectReaderTests-1699865179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (403ffd2c-4147-4f4a-8980-43a9fd8916d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:41:29 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-cba08175-53f2-477b-b235-28a08e38c1fd tempest-ProjectReaderTests-1699865179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (260b7e93-c127-4cc6-bfef-f20163c10576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:41:29 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-cba08175-53f2-477b-b235-28a08e38c1fd tempest-ProjectReaderTests-1699865179 None] Volume f6b92763-212c-4b09-b2b5-207e144f8808: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6b92763-212c-4b09-b2b5-207e144f8808', 'volume_size': 1}
Jul 30 20:41:29 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-cba08175-53f2-477b-b235-28a08e38c1fd tempest-ProjectReaderTests-1699865179 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:41:29 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-cba08175-53f2-477b-b235-28a08e38c1fd tempest-ProjectReaderTests-1699865179 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:41:29 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-cba08175-53f2-477b-b235-28a08e38c1fd tempest-ProjectReaderTests-1699865179 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:41:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2018957182',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6b92763-212c-4b09-b2b5-207e144f8808,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2029c39c88314b52b1e8f64fc23f3e34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:41:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:41:29Z,use_quota=True,user_id='698804c67d0f4a778ad0b650a2b6468f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:41:29 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-cba08175-53f2-477b-b235-28a08e38c1fd tempest-ProjectReaderTests-1699865179 None] Creating volume f6b92763-212c-4b09-b2b5-207e144f8808 {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:41:29 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-cba08175-53f2-477b-b235-28a08e38c1fd tempest-ProjectReaderTests-1699865179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:41:29 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-cba08175-53f2-477b-b235-28a08e38c1fd tempest-ProjectReaderTests-1699865179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:41:29 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-cba08175-53f2-477b-b235-28a08e38c1fd tempest-ProjectReaderTests-1699865179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:41:29 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-cba08175-53f2-477b-b235-28a08e38c1fd tempest-ProjectReaderTests-1699865179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:41:29 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-cba08175-53f2-477b-b235-28a08e38c1fd tempest-ProjectReaderTests-1699865179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:41:29 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-cba08175-53f2-477b-b235-28a08e38c1fd tempest-ProjectReaderTests-1699865179 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:41:29 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-cba08175-53f2-477b-b235-28a08e38c1fd tempest-ProjectReaderTests-1699865179 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:41:29 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-cba08175-53f2-477b-b235-28a08e38c1fd tempest-ProjectReaderTests-1699865179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f6b92763-212c-4b09-b2b5-207e144f8808 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:29 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-29397b74-36a4-4bf4-8a58-accec744dc29 tempest-ProjectMemberTests-47051868 None] Acquiring lock "cinder-f1a9b171-1617-490a-8c12-6abb0a61b87d-delete_snapshot" by "delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:41:29 devstack sudo[108145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f6b92763-212c-4b09-b2b5-207e144f8808 1073741824
Jul 30 20:41:29 devstack sudo[108145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:29 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-29397b74-36a4-4bf4-8a58-accec744dc29 tempest-ProjectMemberTests-47051868 None] Lock "cinder-f1a9b171-1617-490a-8c12-6abb0a61b87d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:41:29 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-29397b74-36a4-4bf4-8a58-accec744dc29 tempest-ProjectMemberTests-47051868 None] Acquiring lock "cinder-quobyte-892493b5-c610-44c9-b688-1ec8b3ee1d0a" by "delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:41:29 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-ed3968ba-331b-4bb6-8be0-573e573e60cb tempest-CinderUnicodeTest-615614172 None] Acquiring lock "cinder-032c6e34-68dc-4cf2-93f3-31632bd2fd1a-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:41:29 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-29397b74-36a4-4bf4-8a58-accec744dc29 tempest-ProjectMemberTests-47051868 None] Lock "cinder-quobyte-892493b5-c610-44c9-b688-1ec8b3ee1d0a" acquired by "delete_snapshot" :: waited 0.032s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:41:29 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-29397b74-36a4-4bf4-8a58-accec744dc29 tempest-ProjectMemberTests-47051868 None] Acquiring lock "cinder-quobyte-f1a9b171-1617-490a-8c12-6abb0a61b87d" by "_delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:41:29 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-ed3968ba-331b-4bb6-8be0-573e573e60cb tempest-CinderUnicodeTest-615614172 None] Lock "cinder-032c6e34-68dc-4cf2-93f3-31632bd2fd1a-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:41:29 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-29397b74-36a4-4bf4-8a58-accec744dc29 tempest-ProjectMemberTests-47051868 None] Lock "cinder-quobyte-f1a9b171-1617-490a-8c12-6abb0a61b87d" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:41:29 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-29397b74-36a4-4bf4-8a58-accec744dc29 tempest-ProjectMemberTests-47051868 None] Deleting offline snapshot f1a9b171-1617-490a-8c12-6abb0a61b87d of volume 892493b5-c610-44c9-b688-1ec8b3ee1d0a {{(pid=88719) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 30 20:41:29 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-29397b74-36a4-4bf4-8a58-accec744dc29 tempest-ProjectMemberTests-47051868 None] snapshot_file for this snap is: volume-892493b5-c610-44c9-b688-1ec8b3ee1d0a.f1a9b171-1617-490a-8c12-6abb0a61b87d {{(pid=88719) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 30 20:41:29 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[8687fc12-c6ae-4780-8dc8-34863a6b5dfc]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:41:29 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-29397b74-36a4-4bf4-8a58-accec744dc29 tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-892493b5-c610-44c9-b688-1ec8b3ee1d0a.f1a9b171-1617-490a-8c12-6abb0a61b87d {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:29 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-ed3968ba-331b-4bb6-8be0-573e573e60cb tempest-CinderUnicodeTest-615614172 None] Acquiring lock "cinder-quobyte-032c6e34-68dc-4cf2-93f3-31632bd2fd1a" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:41:29 devstack sudo[108143]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:29 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-ed3968ba-331b-4bb6-8be0-573e573e60cb tempest-CinderUnicodeTest-615614172 None] Lock "cinder-quobyte-032c6e34-68dc-4cf2-93f3-31632bd2fd1a" acquired by "delete_volume" :: waited 0.024s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:41:29 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2241a2fc-7cb1-4a59-88cc-0b7c3b520497 tempest-CinderUnicodeTest-615614172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.316s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:29 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-2241a2fc-7cb1-4a59-88cc-0b7c3b520497 tempest-CinderUnicodeTest-615614172 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:41:29 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-2241a2fc-7cb1-4a59-88cc-0b7c3b520497 tempest-CinderUnicodeTest-615614172 None] Deleted volume successfully.
Jul 30 20:41:29 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dfa5309-0e20-4e8e-afb8-2828370ee3ab]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:41:29 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-ed3968ba-331b-4bb6-8be0-573e573e60cb tempest-CinderUnicodeTest-615614172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-032c6e34-68dc-4cf2-93f3-31632bd2fd1a {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:29 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-2241a2fc-7cb1-4a59-88cc-0b7c3b520497 tempest-CinderUnicodeTest-615614172 None] Lock "cinder-6d80f85e-eed6-4d3a-990c-f39aebb90eaa-delete_volume" released by "delete_volume" :: held 1.383s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:41:29 devstack sudo[108147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-892493b5-c610-44c9-b688-1ec8b3ee1d0a.f1a9b171-1617-490a-8c12-6abb0a61b87d
Jul 30 20:41:29 devstack sudo[108147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:29 devstack sudo[108151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-032c6e34-68dc-4cf2-93f3-31632bd2fd1a
Jul 30 20:41:29 devstack sudo[108151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:29 devstack sudo[108145]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:29 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-cba08175-53f2-477b-b235-28a08e38c1fd tempest-ProjectReaderTests-1699865179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f6b92763-212c-4b09-b2b5-207e144f8808 1073741824" returned: 0 in 0.459s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:29 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-cba08175-53f2-477b-b235-28a08e38c1fd tempest-ProjectReaderTests-1699865179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f6b92763-212c-4b09-b2b5-207e144f8808 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:29 devstack sudo[108157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f6b92763-212c-4b09-b2b5-207e144f8808
Jul 30 20:41:29 devstack sudo[108157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:29 devstack sudo[108147]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:29 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-29397b74-36a4-4bf4-8a58-accec744dc29 tempest-ProjectMemberTests-47051868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-892493b5-c610-44c9-b688-1ec8b3ee1d0a.f1a9b171-1617-490a-8c12-6abb0a61b87d" returned: 0 in 0.410s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:29 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-29397b74-36a4-4bf4-8a58-accec744dc29 tempest-ProjectMemberTests-47051868 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-892493b5-c610-44c9-b688-1ec8b3ee1d0a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88719) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 30 20:41:29 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4694b61-a24f-4bcc-9906-e81bcd11c358]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:41:29 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-29397b74-36a4-4bf4-8a58-accec744dc29 tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-892493b5-c610-44c9-b688-1ec8b3ee1d0a {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:29 devstack sudo[108151]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:30 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-ed3968ba-331b-4bb6-8be0-573e573e60cb tempest-CinderUnicodeTest-615614172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-032c6e34-68dc-4cf2-93f3-31632bd2fd1a" returned: 0 in 0.381s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:30 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-ed3968ba-331b-4bb6-8be0-573e573e60cb tempest-CinderUnicodeTest-615614172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-032c6e34-68dc-4cf2-93f3-31632bd2fd1a {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:30 devstack sudo[108165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-032c6e34-68dc-4cf2-93f3-31632bd2fd1a
Jul 30 20:41:30 devstack sudo[108165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:30 devstack sudo[108164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-892493b5-c610-44c9-b688-1ec8b3ee1d0a
Jul 30 20:41:30 devstack sudo[108164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:30 devstack sudo[108157]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:30 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-cba08175-53f2-477b-b235-28a08e38c1fd tempest-ProjectReaderTests-1699865179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f6b92763-212c-4b09-b2b5-207e144f8808" returned: 0 in 0.285s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:30 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-cba08175-53f2-477b-b235-28a08e38c1fd tempest-ProjectReaderTests-1699865179 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:41:30 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-cba08175-53f2-477b-b235-28a08e38c1fd tempest-ProjectReaderTests-1699865179 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.791s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:41:30 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-cba08175-53f2-477b-b235-28a08e38c1fd tempest-ProjectReaderTests-1699865179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (260b7e93-c127-4cc6-bfef-f20163c10576) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6b92763-212c-4b09-b2b5-207e144f8808', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:41:30 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-cba08175-53f2-477b-b235-28a08e38c1fd tempest-ProjectReaderTests-1699865179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f647cc4-c0cc-4c69-82c9-c1b45e06b01a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:41:30 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-cba08175-53f2-477b-b235-28a08e38c1fd tempest-ProjectReaderTests-1699865179 None] Volume volume-f6b92763-212c-4b09-b2b5-207e144f8808 (f6b92763-212c-4b09-b2b5-207e144f8808): created successfully
Jul 30 20:41:30 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-cba08175-53f2-477b-b235-28a08e38c1fd tempest-ProjectReaderTests-1699865179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f647cc4-c0cc-4c69-82c9-c1b45e06b01a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:41:30 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-cba08175-53f2-477b-b235-28a08e38c1fd tempest-ProjectReaderTests-1699865179 None] Flow 'volume_create_manager' (b9d4d38e-a2f6-44fc-bd50-da9c52c5ed42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:41:30 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-cba08175-53f2-477b-b235-28a08e38c1fd tempest-ProjectReaderTests-1699865179 None] Created volume successfully.
Jul 30 20:41:30 devstack sudo[108165]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:30 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-ed3968ba-331b-4bb6-8be0-573e573e60cb tempest-CinderUnicodeTest-615614172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-032c6e34-68dc-4cf2-93f3-31632bd2fd1a" returned: 0 in 0.271s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:30 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-ed3968ba-331b-4bb6-8be0-573e573e60cb tempest-CinderUnicodeTest-615614172 None] Lock "cinder-quobyte-032c6e34-68dc-4cf2-93f3-31632bd2fd1a" released by "delete_volume" :: held 0.704s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:41:30 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-ed3968ba-331b-4bb6-8be0-573e573e60cb tempest-CinderUnicodeTest-615614172 None] Created reservations ['ea56e2da-62f9-4bb8-8017-ca1db57eee43', '3248af1a-bccc-4c3f-99d3-1bb1013c0055', 'e2f661f8-8497-43a3-999d-d60b7d04da52', '2d0af629-8080-4424-9bf4-434a9e1a0637'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:41:30 devstack sudo[108164]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:30 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-29397b74-36a4-4bf4-8a58-accec744dc29 tempest-ProjectMemberTests-47051868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-892493b5-c610-44c9-b688-1ec8b3ee1d0a" returned: 0 in 0.393s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:30 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-29397b74-36a4-4bf4-8a58-accec744dc29 tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-892493b5-c610-44c9-b688-1ec8b3ee1d0a.f1a9b171-1617-490a-8c12-6abb0a61b87d {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:30 devstack sudo[108173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-892493b5-c610-44c9-b688-1ec8b3ee1d0a.f1a9b171-1617-490a-8c12-6abb0a61b87d
Jul 30 20:41:30 devstack sudo[108173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:30 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-ed3968ba-331b-4bb6-8be0-573e573e60cb tempest-CinderUnicodeTest-615614172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:41:30 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-ed3968ba-331b-4bb6-8be0-573e573e60cb tempest-CinderUnicodeTest-615614172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:41:30 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-ed3968ba-331b-4bb6-8be0-573e573e60cb tempest-CinderUnicodeTest-615614172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:41:30 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-ed3968ba-331b-4bb6-8be0-573e573e60cb tempest-CinderUnicodeTest-615614172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:41:30 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-ed3968ba-331b-4bb6-8be0-573e573e60cb tempest-CinderUnicodeTest-615614172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:41:30 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-ed3968ba-331b-4bb6-8be0-573e573e60cb tempest-CinderUnicodeTest-615614172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:30 devstack sudo[108175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:41:30 devstack sudo[108175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:30 devstack sudo[108175]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:30 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-ed3968ba-331b-4bb6-8be0-573e573e60cb tempest-CinderUnicodeTest-615614172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.256s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:30 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-ed3968ba-331b-4bb6-8be0-573e573e60cb tempest-CinderUnicodeTest-615614172 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:41:30 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-ed3968ba-331b-4bb6-8be0-573e573e60cb tempest-CinderUnicodeTest-615614172 None] Deleted volume successfully.
Jul 30 20:41:30 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-ed3968ba-331b-4bb6-8be0-573e573e60cb tempest-CinderUnicodeTest-615614172 None] Lock "cinder-032c6e34-68dc-4cf2-93f3-31632bd2fd1a-delete_volume" released by "delete_volume" :: held 1.245s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:41:30 devstack sudo[108173]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:30 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-29397b74-36a4-4bf4-8a58-accec744dc29 tempest-ProjectMemberTests-47051868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-892493b5-c610-44c9-b688-1ec8b3ee1d0a.f1a9b171-1617-490a-8c12-6abb0a61b87d" returned: 0 in 0.397s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:30 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-29397b74-36a4-4bf4-8a58-accec744dc29 tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-892493b5-c610-44c9-b688-1ec8b3ee1d0a.f1a9b171-1617-490a-8c12-6abb0a61b87d {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:30 devstack sudo[108181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-892493b5-c610-44c9-b688-1ec8b3ee1d0a.f1a9b171-1617-490a-8c12-6abb0a61b87d
Jul 30 20:41:30 devstack sudo[108181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:31 devstack sudo[108181]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:31 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-29397b74-36a4-4bf4-8a58-accec744dc29 tempest-ProjectMemberTests-47051868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-892493b5-c610-44c9-b688-1ec8b3ee1d0a.f1a9b171-1617-490a-8c12-6abb0a61b87d" returned: 0 in 0.266s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:31 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-29397b74-36a4-4bf4-8a58-accec744dc29 tempest-ProjectMemberTests-47051868 None] Lock "cinder-quobyte-f1a9b171-1617-490a-8c12-6abb0a61b87d" released by "_delete_snapshot" :: held 1.577s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:41:31 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-29397b74-36a4-4bf4-8a58-accec744dc29 tempest-ProjectMemberTests-47051868 None] Lock "cinder-quobyte-892493b5-c610-44c9-b688-1ec8b3ee1d0a" released by "delete_snapshot" :: held 1.614s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:41:31 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-29397b74-36a4-4bf4-8a58-accec744dc29 tempest-ProjectMemberTests-47051868 None] Created reservations ['4db8da62-fa1a-44d6-9f44-325e352ceea5', '14f95330-6dc7-4590-8bc9-40f8659b4139', 'c315584d-7691-4029-b2cc-b88fbd5af29f', '2df3d1b1-fddf-45d9-b141-54718f150b46'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:41:31 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-29397b74-36a4-4bf4-8a58-accec744dc29 tempest-ProjectMemberTests-47051868 None] Delete snapshot completed successfully.
Jul 30 20:41:31 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-29397b74-36a4-4bf4-8a58-accec744dc29 tempest-ProjectMemberTests-47051868 None] Lock "cinder-f1a9b171-1617-490a-8c12-6abb0a61b87d-delete_snapshot" released by "delete_snapshot" :: held 1.770s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:41:31 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-fc43034f-611c-43ce-81e7-63c18bdf0d3a tempest-ProjectReaderTests-1699865179 None] Acquiring lock "cinder-f6b92763-212c-4b09-b2b5-207e144f8808-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:41:31 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-fc43034f-611c-43ce-81e7-63c18bdf0d3a tempest-ProjectReaderTests-1699865179 None] Lock "cinder-f6b92763-212c-4b09-b2b5-207e144f8808-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:41:31 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-fc43034f-611c-43ce-81e7-63c18bdf0d3a tempest-ProjectReaderTests-1699865179 None] Acquiring lock "cinder-quobyte-f6b92763-212c-4b09-b2b5-207e144f8808" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:41:31 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-fc43034f-611c-43ce-81e7-63c18bdf0d3a tempest-ProjectReaderTests-1699865179 None] Lock "cinder-quobyte-f6b92763-212c-4b09-b2b5-207e144f8808" acquired by "delete_volume" :: waited 0.021s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:41:31 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-8eddde12-4e9d-4516-99d4-ab0727180264 tempest-ProjectMemberTests-47051868 None] Acquiring lock "cinder-892493b5-c610-44c9-b688-1ec8b3ee1d0a-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:41:31 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[768004b8-2d4b-4760-9303-87cb43f313cb]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:41:31 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-fc43034f-611c-43ce-81e7-63c18bdf0d3a tempest-ProjectReaderTests-1699865179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f6b92763-212c-4b09-b2b5-207e144f8808 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:31 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-8eddde12-4e9d-4516-99d4-ab0727180264 tempest-ProjectMemberTests-47051868 None] Lock "cinder-892493b5-c610-44c9-b688-1ec8b3ee1d0a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:41:31 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-8eddde12-4e9d-4516-99d4-ab0727180264 tempest-ProjectMemberTests-47051868 None] Acquiring lock "cinder-quobyte-892493b5-c610-44c9-b688-1ec8b3ee1d0a" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:41:31 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-8eddde12-4e9d-4516-99d4-ab0727180264 tempest-ProjectMemberTests-47051868 None] Lock "cinder-quobyte-892493b5-c610-44c9-b688-1ec8b3ee1d0a" acquired by "delete_volume" :: waited 0.015s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:41:31 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[34c26c45-c2e8-4d90-b63f-064f58f8f356]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:41:31 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8eddde12-4e9d-4516-99d4-ab0727180264 tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-892493b5-c610-44c9-b688-1ec8b3ee1d0a {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:31 devstack sudo[108184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f6b92763-212c-4b09-b2b5-207e144f8808
Jul 30 20:41:31 devstack sudo[108184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:31 devstack sudo[108186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-892493b5-c610-44c9-b688-1ec8b3ee1d0a
Jul 30 20:41:31 devstack sudo[108186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:31 devstack sudo[108184]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:31 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-fc43034f-611c-43ce-81e7-63c18bdf0d3a tempest-ProjectReaderTests-1699865179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f6b92763-212c-4b09-b2b5-207e144f8808" returned: 0 in 0.413s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:31 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-fc43034f-611c-43ce-81e7-63c18bdf0d3a tempest-ProjectReaderTests-1699865179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f6b92763-212c-4b09-b2b5-207e144f8808 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:31 devstack sudo[108191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f6b92763-212c-4b09-b2b5-207e144f8808
Jul 30 20:41:31 devstack sudo[108191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:32 devstack sudo[108186]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:32 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8eddde12-4e9d-4516-99d4-ab0727180264 tempest-ProjectMemberTests-47051868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-892493b5-c610-44c9-b688-1ec8b3ee1d0a" returned: 0 in 0.394s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:32 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8eddde12-4e9d-4516-99d4-ab0727180264 tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-892493b5-c610-44c9-b688-1ec8b3ee1d0a {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:32 devstack sudo[108196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-892493b5-c610-44c9-b688-1ec8b3ee1d0a
Jul 30 20:41:32 devstack sudo[108196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:32 devstack sudo[108191]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:32 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-fc43034f-611c-43ce-81e7-63c18bdf0d3a tempest-ProjectReaderTests-1699865179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f6b92763-212c-4b09-b2b5-207e144f8808" returned: 0 in 0.282s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:32 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-fc43034f-611c-43ce-81e7-63c18bdf0d3a tempest-ProjectReaderTests-1699865179 None] Lock "cinder-quobyte-f6b92763-212c-4b09-b2b5-207e144f8808" released by "delete_volume" :: held 0.756s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:41:32 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-fc43034f-611c-43ce-81e7-63c18bdf0d3a tempest-ProjectReaderTests-1699865179 None] Created reservations ['ad640192-8a58-479c-8722-bfe2ba2a0b9b', '30e8b134-11ee-46cd-933d-fc149d944063', '8c730dba-7a7d-4270-8075-40c6abed98af', 'ee8b7f10-09f0-4cd3-9aca-ff1e4c9c715a'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:41:32 devstack sudo[108196]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:32 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8eddde12-4e9d-4516-99d4-ab0727180264 tempest-ProjectMemberTests-47051868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-892493b5-c610-44c9-b688-1ec8b3ee1d0a" returned: 0 in 0.294s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:32 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-8eddde12-4e9d-4516-99d4-ab0727180264 tempest-ProjectMemberTests-47051868 None] Lock "cinder-quobyte-892493b5-c610-44c9-b688-1ec8b3ee1d0a" released by "delete_volume" :: held 0.763s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:41:32 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-fc43034f-611c-43ce-81e7-63c18bdf0d3a tempest-ProjectReaderTests-1699865179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:41:32 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-fc43034f-611c-43ce-81e7-63c18bdf0d3a tempest-ProjectReaderTests-1699865179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:41:32 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-fc43034f-611c-43ce-81e7-63c18bdf0d3a tempest-ProjectReaderTests-1699865179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:41:32 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-fc43034f-611c-43ce-81e7-63c18bdf0d3a tempest-ProjectReaderTests-1699865179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:41:32 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-fc43034f-611c-43ce-81e7-63c18bdf0d3a tempest-ProjectReaderTests-1699865179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:41:32 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-fc43034f-611c-43ce-81e7-63c18bdf0d3a tempest-ProjectReaderTests-1699865179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:32 devstack sudo[108202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:41:32 devstack sudo[108202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:32 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-8eddde12-4e9d-4516-99d4-ab0727180264 tempest-ProjectMemberTests-47051868 None] Created reservations ['8328e69a-e03c-4ca3-a1e2-8ef5bf5c2a01', '591e3eb6-ffcf-425c-b3ba-7c7d207f85f9', 'a135b075-5c8f-4bfb-8c4a-76af5344d03e', '40dbad33-01dd-44a5-8303-e7bb5d88db5e'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:41:32 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-8eddde12-4e9d-4516-99d4-ab0727180264 tempest-ProjectMemberTests-47051868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:41:32 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-8eddde12-4e9d-4516-99d4-ab0727180264 tempest-ProjectMemberTests-47051868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:41:32 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-8eddde12-4e9d-4516-99d4-ab0727180264 tempest-ProjectMemberTests-47051868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:41:32 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-8eddde12-4e9d-4516-99d4-ab0727180264 tempest-ProjectMemberTests-47051868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:41:32 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-8eddde12-4e9d-4516-99d4-ab0727180264 tempest-ProjectMemberTests-47051868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:41:32 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8eddde12-4e9d-4516-99d4-ab0727180264 tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:32 devstack sudo[108204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:41:32 devstack sudo[108204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:32 devstack sudo[108202]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:32 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-fc43034f-611c-43ce-81e7-63c18bdf0d3a tempest-ProjectReaderTests-1699865179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.342s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:32 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-fc43034f-611c-43ce-81e7-63c18bdf0d3a tempest-ProjectReaderTests-1699865179 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:41:32 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-fc43034f-611c-43ce-81e7-63c18bdf0d3a tempest-ProjectReaderTests-1699865179 None] Deleted volume successfully.
Jul 30 20:41:32 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-fc43034f-611c-43ce-81e7-63c18bdf0d3a tempest-ProjectReaderTests-1699865179 None] Lock "cinder-f6b92763-212c-4b09-b2b5-207e144f8808-delete_volume" released by "delete_volume" :: held 1.443s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:41:32 devstack sudo[108204]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:32 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8eddde12-4e9d-4516-99d4-ab0727180264 tempest-ProjectMemberTests-47051868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.366s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:32 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-8eddde12-4e9d-4516-99d4-ab0727180264 tempest-ProjectMemberTests-47051868 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:41:32 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-8eddde12-4e9d-4516-99d4-ab0727180264 tempest-ProjectMemberTests-47051868 None] Deleted volume successfully.
Jul 30 20:41:33 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-8eddde12-4e9d-4516-99d4-ab0727180264 tempest-ProjectMemberTests-47051868 None] Lock "cinder-892493b5-c610-44c9-b688-1ec8b3ee1d0a-delete_volume" released by "delete_volume" :: held 1.453s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:41:33 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-78b4142d-be37-4112-837e-88af33ca5448 tempest-ProjectReaderTests-1699865179 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:41:33 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-78b4142d-be37-4112-837e-88af33ca5448 tempest-ProjectReaderTests-1699865179 None] Flow 'volume_create_manager' (57d406d7-049e-47c7-9e37-74a682146c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:41:33 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-78b4142d-be37-4112-837e-88af33ca5448 tempest-ProjectReaderTests-1699865179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7575794-0587-4a74-a8c4-93a13da368c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:41:33 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-78b4142d-be37-4112-837e-88af33ca5448 tempest-ProjectReaderTests-1699865179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7575794-0587-4a74-a8c4-93a13da368c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:41:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1053510744',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c0f8784-1e06-4014-8c99-9f066c555e29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2029c39c88314b52b1e8f64fc23f3e34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:41:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:41:33Z,use_quota=True,user_id='698804c67d0f4a778ad0b650a2b6468f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:41:33 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-78b4142d-be37-4112-837e-88af33ca5448 tempest-ProjectReaderTests-1699865179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14b0a655-3609-4b22-84a2-40c3d1047829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:41:33 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-78b4142d-be37-4112-837e-88af33ca5448 tempest-ProjectReaderTests-1699865179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14b0a655-3609-4b22-84a2-40c3d1047829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:41:33 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-78b4142d-be37-4112-837e-88af33ca5448 tempest-ProjectReaderTests-1699865179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e59edc4-4498-41a4-b83f-d975df9679c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:41:33 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-78b4142d-be37-4112-837e-88af33ca5448 tempest-ProjectReaderTests-1699865179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e59edc4-4498-41a4-b83f-d975df9679c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c0f8784-1e06-4014-8c99-9f066c555e29', 'volume_name': 'volume-6c0f8784-1e06-4014-8c99-9f066c555e29', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:41:33 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-78b4142d-be37-4112-837e-88af33ca5448 tempest-ProjectReaderTests-1699865179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (899e8a26-d44d-41c5-ae03-3d8e4987314c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:41:33 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-78b4142d-be37-4112-837e-88af33ca5448 tempest-ProjectReaderTests-1699865179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (899e8a26-d44d-41c5-ae03-3d8e4987314c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:41:33 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-78b4142d-be37-4112-837e-88af33ca5448 tempest-ProjectReaderTests-1699865179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c17ae8f3-5ee2-455f-a02e-6fca0f59d511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:41:33 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-78b4142d-be37-4112-837e-88af33ca5448 tempest-ProjectReaderTests-1699865179 None] Volume 6c0f8784-1e06-4014-8c99-9f066c555e29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c0f8784-1e06-4014-8c99-9f066c555e29', 'volume_size': 1}
Jul 30 20:41:33 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-78b4142d-be37-4112-837e-88af33ca5448 tempest-ProjectReaderTests-1699865179 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:41:33 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-78b4142d-be37-4112-837e-88af33ca5448 tempest-ProjectReaderTests-1699865179 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:41:33 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-78b4142d-be37-4112-837e-88af33ca5448 tempest-ProjectReaderTests-1699865179 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:41:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1053510744',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c0f8784-1e06-4014-8c99-9f066c555e29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2029c39c88314b52b1e8f64fc23f3e34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:41:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:41:33Z,use_quota=True,user_id='698804c67d0f4a778ad0b650a2b6468f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:41:33 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-78b4142d-be37-4112-837e-88af33ca5448 tempest-ProjectReaderTests-1699865179 None] Creating volume 6c0f8784-1e06-4014-8c99-9f066c555e29 {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:41:33 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-78b4142d-be37-4112-837e-88af33ca5448 tempest-ProjectReaderTests-1699865179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:41:33 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-78b4142d-be37-4112-837e-88af33ca5448 tempest-ProjectReaderTests-1699865179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:41:33 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-78b4142d-be37-4112-837e-88af33ca5448 tempest-ProjectReaderTests-1699865179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:41:33 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-78b4142d-be37-4112-837e-88af33ca5448 tempest-ProjectReaderTests-1699865179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:41:33 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-78b4142d-be37-4112-837e-88af33ca5448 tempest-ProjectReaderTests-1699865179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:41:33 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-78b4142d-be37-4112-837e-88af33ca5448 tempest-ProjectReaderTests-1699865179 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:41:33 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-78b4142d-be37-4112-837e-88af33ca5448 tempest-ProjectReaderTests-1699865179 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:41:33 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-78b4142d-be37-4112-837e-88af33ca5448 tempest-ProjectReaderTests-1699865179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6c0f8784-1e06-4014-8c99-9f066c555e29 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:33 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad13721b-be78-4212-825d-98451de20874 tempest-ProjectMemberTests-47051868 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:41:33 devstack sudo[108208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6c0f8784-1e06-4014-8c99-9f066c555e29 1073741824
Jul 30 20:41:33 devstack sudo[108208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:33 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-ad13721b-be78-4212-825d-98451de20874 tempest-ProjectMemberTests-47051868 None] Flow 'volume_create_manager' (68669b45-5285-4ccb-af93-f86b8cb9d481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:41:33 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-ad13721b-be78-4212-825d-98451de20874 tempest-ProjectMemberTests-47051868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54079825-def8-4d6e-a044-f687e66489b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:41:33 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-ad13721b-be78-4212-825d-98451de20874 tempest-ProjectMemberTests-47051868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54079825-def8-4d6e-a044-f687e66489b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:41:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1608000647',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14f3f22e-89f7-4614-9694-24e93ca1a960,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c483f66aa6ec477e9cb0547f0f04f6d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:41:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:41:33Z,use_quota=True,user_id='59a41c24b76545b79b09f90cd8c36728',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:41:33 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-ad13721b-be78-4212-825d-98451de20874 tempest-ProjectMemberTests-47051868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2411bd5b-6497-4521-b337-1ac42750f620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:41:33 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-ad13721b-be78-4212-825d-98451de20874 tempest-ProjectMemberTests-47051868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2411bd5b-6497-4521-b337-1ac42750f620) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:41:33 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-ad13721b-be78-4212-825d-98451de20874 tempest-ProjectMemberTests-47051868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20fcb874-1588-4eeb-a738-1ead5782bbc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:41:33 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-ad13721b-be78-4212-825d-98451de20874 tempest-ProjectMemberTests-47051868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20fcb874-1588-4eeb-a738-1ead5782bbc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14f3f22e-89f7-4614-9694-24e93ca1a960', 'volume_name': 'volume-14f3f22e-89f7-4614-9694-24e93ca1a960', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:41:33 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-ad13721b-be78-4212-825d-98451de20874 tempest-ProjectMemberTests-47051868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (145a8a07-f61a-4f06-ace4-4ec994e35dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:41:33 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-ad13721b-be78-4212-825d-98451de20874 tempest-ProjectMemberTests-47051868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (145a8a07-f61a-4f06-ace4-4ec994e35dbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:41:33 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-ad13721b-be78-4212-825d-98451de20874 tempest-ProjectMemberTests-47051868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5728e38-8a8a-4d01-8188-894698643e99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:41:33 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-ad13721b-be78-4212-825d-98451de20874 tempest-ProjectMemberTests-47051868 None] Volume 14f3f22e-89f7-4614-9694-24e93ca1a960: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14f3f22e-89f7-4614-9694-24e93ca1a960', 'volume_size': 1}
Jul 30 20:41:33 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-ad13721b-be78-4212-825d-98451de20874 tempest-ProjectMemberTests-47051868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:41:33 devstack sudo[108208]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:33 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-78b4142d-be37-4112-837e-88af33ca5448 tempest-ProjectReaderTests-1699865179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6c0f8784-1e06-4014-8c99-9f066c555e29 1073741824" returned: 0 in 0.443s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:33 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-78b4142d-be37-4112-837e-88af33ca5448 tempest-ProjectReaderTests-1699865179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6c0f8784-1e06-4014-8c99-9f066c555e29 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:33 devstack sudo[108214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6c0f8784-1e06-4014-8c99-9f066c555e29
Jul 30 20:41:33 devstack sudo[108214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:34 devstack sudo[108214]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:34 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-78b4142d-be37-4112-837e-88af33ca5448 tempest-ProjectReaderTests-1699865179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6c0f8784-1e06-4014-8c99-9f066c555e29" returned: 0 in 0.278s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:34 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-78b4142d-be37-4112-837e-88af33ca5448 tempest-ProjectReaderTests-1699865179 None] <== create_volume: return (761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:41:34 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-78b4142d-be37-4112-837e-88af33ca5448 tempest-ProjectReaderTests-1699865179 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.764s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:41:34 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-ad13721b-be78-4212-825d-98451de20874 tempest-ProjectMemberTests-47051868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.647s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:41:34 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-ad13721b-be78-4212-825d-98451de20874 tempest-ProjectMemberTests-47051868 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:41:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1608000647',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14f3f22e-89f7-4614-9694-24e93ca1a960,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c483f66aa6ec477e9cb0547f0f04f6d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:41:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:41:33Z,use_quota=True,user_id='59a41c24b76545b79b09f90cd8c36728',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:41:34 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-ad13721b-be78-4212-825d-98451de20874 tempest-ProjectMemberTests-47051868 None] Creating volume 14f3f22e-89f7-4614-9694-24e93ca1a960 {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:41:34 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-ad13721b-be78-4212-825d-98451de20874 tempest-ProjectMemberTests-47051868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:41:34 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-ad13721b-be78-4212-825d-98451de20874 tempest-ProjectMemberTests-47051868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:41:34 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-ad13721b-be78-4212-825d-98451de20874 tempest-ProjectMemberTests-47051868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:41:34 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-ad13721b-be78-4212-825d-98451de20874 tempest-ProjectMemberTests-47051868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:41:34 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-ad13721b-be78-4212-825d-98451de20874 tempest-ProjectMemberTests-47051868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:41:34 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-ad13721b-be78-4212-825d-98451de20874 tempest-ProjectMemberTests-47051868 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:41:34 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-ad13721b-be78-4212-825d-98451de20874 tempest-ProjectMemberTests-47051868 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:41:34 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-ad13721b-be78-4212-825d-98451de20874 tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-14f3f22e-89f7-4614-9694-24e93ca1a960 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:34 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-78b4142d-be37-4112-837e-88af33ca5448 tempest-ProjectReaderTests-1699865179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c17ae8f3-5ee2-455f-a02e-6fca0f59d511) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c0f8784-1e06-4014-8c99-9f066c555e29', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:41:34 devstack sudo[108217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-14f3f22e-89f7-4614-9694-24e93ca1a960 1073741824
Jul 30 20:41:34 devstack sudo[108217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:34 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-78b4142d-be37-4112-837e-88af33ca5448 tempest-ProjectReaderTests-1699865179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3780d7a-1b82-425f-9d2a-9a20a5a82dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:41:34 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-78b4142d-be37-4112-837e-88af33ca5448 tempest-ProjectReaderTests-1699865179 None] Volume volume-6c0f8784-1e06-4014-8c99-9f066c555e29 (6c0f8784-1e06-4014-8c99-9f066c555e29): created successfully
Jul 30 20:41:34 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-78b4142d-be37-4112-837e-88af33ca5448 tempest-ProjectReaderTests-1699865179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3780d7a-1b82-425f-9d2a-9a20a5a82dd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:41:34 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-78b4142d-be37-4112-837e-88af33ca5448 tempest-ProjectReaderTests-1699865179 None] Flow 'volume_create_manager' (57d406d7-049e-47c7-9e37-74a682146c46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:41:34 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-78b4142d-be37-4112-837e-88af33ca5448 tempest-ProjectReaderTests-1699865179 None] Created volume successfully.
Jul 30 20:41:34 devstack sudo[108217]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:34 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-ad13721b-be78-4212-825d-98451de20874 tempest-ProjectMemberTests-47051868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-14f3f22e-89f7-4614-9694-24e93ca1a960 1073741824" returned: 0 in 0.470s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:34 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-ad13721b-be78-4212-825d-98451de20874 tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-14f3f22e-89f7-4614-9694-24e93ca1a960 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:34 devstack sudo[108223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-14f3f22e-89f7-4614-9694-24e93ca1a960
Jul 30 20:41:34 devstack sudo[108223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:34 devstack sudo[108223]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:34 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-ad13721b-be78-4212-825d-98451de20874 tempest-ProjectMemberTests-47051868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-14f3f22e-89f7-4614-9694-24e93ca1a960" returned: 0 in 0.249s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:34 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-ad13721b-be78-4212-825d-98451de20874 tempest-ProjectMemberTests-47051868 None] <== create_volume: return (760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:41:34 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-ad13721b-be78-4212-825d-98451de20874 tempest-ProjectMemberTests-47051868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.763s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:41:34 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-ad13721b-be78-4212-825d-98451de20874 tempest-ProjectMemberTests-47051868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5728e38-8a8a-4d01-8188-894698643e99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14f3f22e-89f7-4614-9694-24e93ca1a960', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:41:35 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-ad13721b-be78-4212-825d-98451de20874 tempest-ProjectMemberTests-47051868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44a5bafb-dbd0-464a-9768-b095ff9f5ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:41:35 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-ad13721b-be78-4212-825d-98451de20874 tempest-ProjectMemberTests-47051868 None] Volume volume-14f3f22e-89f7-4614-9694-24e93ca1a960 (14f3f22e-89f7-4614-9694-24e93ca1a960): created successfully
Jul 30 20:41:35 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-ad13721b-be78-4212-825d-98451de20874 tempest-ProjectMemberTests-47051868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44a5bafb-dbd0-464a-9768-b095ff9f5ad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:41:35 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-ad13721b-be78-4212-825d-98451de20874 tempest-ProjectMemberTests-47051868 None] Flow 'volume_create_manager' (68669b45-5285-4ccb-af93-f86b8cb9d481) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:41:35 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-ad13721b-be78-4212-825d-98451de20874 tempest-ProjectMemberTests-47051868 None] Created volume successfully.
Jul 30 20:41:35 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-b55e8ecc-72fb-4bfd-8410-81fc40bc510c tempest-ProjectReaderTests-1699865179 None] Acquiring lock "cinder-6c0f8784-1e06-4014-8c99-9f066c555e29-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:41:35 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-b55e8ecc-72fb-4bfd-8410-81fc40bc510c tempest-ProjectReaderTests-1699865179 None] Lock "cinder-6c0f8784-1e06-4014-8c99-9f066c555e29-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:41:35 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-b55e8ecc-72fb-4bfd-8410-81fc40bc510c tempest-ProjectReaderTests-1699865179 None] Acquiring lock "cinder-quobyte-6c0f8784-1e06-4014-8c99-9f066c555e29" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:41:35 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-b55e8ecc-72fb-4bfd-8410-81fc40bc510c tempest-ProjectReaderTests-1699865179 None] Lock "cinder-quobyte-6c0f8784-1e06-4014-8c99-9f066c555e29" acquired by "delete_volume" :: waited 0.021s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:41:35 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b0956c-76bd-4840-a7c1-d81b94fd0f1c]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:41:35 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-b55e8ecc-72fb-4bfd-8410-81fc40bc510c tempest-ProjectReaderTests-1699865179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6c0f8784-1e06-4014-8c99-9f066c555e29 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:35 devstack sudo[108228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6c0f8784-1e06-4014-8c99-9f066c555e29
Jul 30 20:41:35 devstack sudo[108228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:35 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-3fa9d6b9-94e2-478a-be90-e450c6f68b6d tempest-ProjectMemberTests-47051868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:41:35 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-3fa9d6b9-94e2-478a-be90-e450c6f68b6d tempest-ProjectMemberTests-47051868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:41:35 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-3fa9d6b9-94e2-478a-be90-e450c6f68b6d tempest-ProjectMemberTests-47051868 None] Creating offline snapshot 6ca4d348-623f-46b3-8558-b49e0f6d1889 of volume 14f3f22e-89f7-4614-9694-24e93ca1a960 {{(pid=88719) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 30 20:41:35 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[2971e19a-0a48-45f1-b5f6-b7d898f12751]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:41:35 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3fa9d6b9-94e2-478a-be90-e450c6f68b6d tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-14f3f22e-89f7-4614-9694-24e93ca1a960 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:35 devstack sudo[108230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-14f3f22e-89f7-4614-9694-24e93ca1a960
Jul 30 20:41:35 devstack sudo[108230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:35 devstack sudo[108228]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:35 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-b55e8ecc-72fb-4bfd-8410-81fc40bc510c tempest-ProjectReaderTests-1699865179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6c0f8784-1e06-4014-8c99-9f066c555e29" returned: 0 in 0.406s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:35 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-b55e8ecc-72fb-4bfd-8410-81fc40bc510c tempest-ProjectReaderTests-1699865179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6c0f8784-1e06-4014-8c99-9f066c555e29 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:35 devstack sudo[108235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6c0f8784-1e06-4014-8c99-9f066c555e29
Jul 30 20:41:35 devstack sudo[108235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:35 devstack sudo[108230]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:35 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3fa9d6b9-94e2-478a-be90-e450c6f68b6d tempest-ProjectMemberTests-47051868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-14f3f22e-89f7-4614-9694-24e93ca1a960" returned: 0 in 0.378s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:35 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3fa9d6b9-94e2-478a-be90-e450c6f68b6d tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-14f3f22e-89f7-4614-9694-24e93ca1a960,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-14f3f22e-89f7-4614-9694-24e93ca1a960.6ca4d348-623f-46b3-8558-b49e0f6d1889 1G {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:35 devstack sudo[108240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-14f3f22e-89f7-4614-9694-24e93ca1a960,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-14f3f22e-89f7-4614-9694-24e93ca1a960.6ca4d348-623f-46b3-8558-b49e0f6d1889 1G
Jul 30 20:41:35 devstack sudo[108240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:36 devstack sudo[108235]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:36 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-b55e8ecc-72fb-4bfd-8410-81fc40bc510c tempest-ProjectReaderTests-1699865179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-6c0f8784-1e06-4014-8c99-9f066c555e29" returned: 0 in 0.291s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:36 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-b55e8ecc-72fb-4bfd-8410-81fc40bc510c tempest-ProjectReaderTests-1699865179 None] Lock "cinder-quobyte-6c0f8784-1e06-4014-8c99-9f066c555e29" released by "delete_volume" :: held 0.750s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:41:36 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-b55e8ecc-72fb-4bfd-8410-81fc40bc510c tempest-ProjectReaderTests-1699865179 None] Created reservations ['8f9a761a-9c87-41a9-bb39-97bd57be4e7e', '0b9aab81-7180-49d2-8495-7781663e6ffc', '544853a5-9c33-46d5-8fce-95a0cbbd2c65', 'e0acdbfb-e0d0-4147-ae98-7a421ddb7788'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:41:36 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-b55e8ecc-72fb-4bfd-8410-81fc40bc510c tempest-ProjectReaderTests-1699865179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:41:36 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-b55e8ecc-72fb-4bfd-8410-81fc40bc510c tempest-ProjectReaderTests-1699865179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:41:36 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-b55e8ecc-72fb-4bfd-8410-81fc40bc510c tempest-ProjectReaderTests-1699865179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:41:36 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-b55e8ecc-72fb-4bfd-8410-81fc40bc510c tempest-ProjectReaderTests-1699865179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:41:36 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-b55e8ecc-72fb-4bfd-8410-81fc40bc510c tempest-ProjectReaderTests-1699865179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:41:36 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-b55e8ecc-72fb-4bfd-8410-81fc40bc510c tempest-ProjectReaderTests-1699865179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:36 devstack sudo[108246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:41:36 devstack sudo[108246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:36 devstack sudo[108240]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:36 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3fa9d6b9-94e2-478a-be90-e450c6f68b6d tempest-ProjectMemberTests-47051868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-14f3f22e-89f7-4614-9694-24e93ca1a960,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-14f3f22e-89f7-4614-9694-24e93ca1a960.6ca4d348-623f-46b3-8558-b49e0f6d1889 1G" returned: 0 in 0.532s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:36 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3fa9d6b9-94e2-478a-be90-e450c6f68b6d tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14f3f22e-89f7-4614-9694-24e93ca1a960 -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-14f3f22e-89f7-4614-9694-24e93ca1a960.6ca4d348-623f-46b3-8558-b49e0f6d1889 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:36 devstack sudo[108249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14f3f22e-89f7-4614-9694-24e93ca1a960 -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-14f3f22e-89f7-4614-9694-24e93ca1a960.6ca4d348-623f-46b3-8558-b49e0f6d1889
Jul 30 20:41:36 devstack sudo[108249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:36 devstack sudo[108246]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:36 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-b55e8ecc-72fb-4bfd-8410-81fc40bc510c tempest-ProjectReaderTests-1699865179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.332s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:36 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-b55e8ecc-72fb-4bfd-8410-81fc40bc510c tempest-ProjectReaderTests-1699865179 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:41:36 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-b55e8ecc-72fb-4bfd-8410-81fc40bc510c tempest-ProjectReaderTests-1699865179 None] Deleted volume successfully.
Jul 30 20:41:36 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-b55e8ecc-72fb-4bfd-8410-81fc40bc510c tempest-ProjectReaderTests-1699865179 None] Lock "cinder-6c0f8784-1e06-4014-8c99-9f066c555e29-delete_volume" released by "delete_volume" :: held 1.347s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:41:36 devstack sudo[108249]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:36 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3fa9d6b9-94e2-478a-be90-e450c6f68b6d tempest-ProjectMemberTests-47051868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14f3f22e-89f7-4614-9694-24e93ca1a960 -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-14f3f22e-89f7-4614-9694-24e93ca1a960.6ca4d348-623f-46b3-8558-b49e0f6d1889" returned: 0 in 0.376s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:36 devstack cinder-volume[88719]: WARNING cinder.volume.drivers.remotefs [None req-3fa9d6b9-94e2-478a-be90-e450c6f68b6d tempest-ProjectMemberTests-47051868 None] /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-14f3f22e-89f7-4614-9694-24e93ca1a960.6ca4d348-623f-46b3-8558-b49e0f6d1889 is being set with open permissions: ugo+rw
Jul 30 20:41:36 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3fa9d6b9-94e2-478a-be90-e450c6f68b6d tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-14f3f22e-89f7-4614-9694-24e93ca1a960.6ca4d348-623f-46b3-8558-b49e0f6d1889 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:36 devstack sudo[108256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-14f3f22e-89f7-4614-9694-24e93ca1a960.6ca4d348-623f-46b3-8558-b49e0f6d1889
Jul 30 20:41:36 devstack sudo[108256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:37 devstack sudo[108256]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:37 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3fa9d6b9-94e2-478a-be90-e450c6f68b6d tempest-ProjectMemberTests-47051868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-14f3f22e-89f7-4614-9694-24e93ca1a960.6ca4d348-623f-46b3-8558-b49e0f6d1889" returned: 0 in 0.277s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:37 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3fa9d6b9-94e2-478a-be90-e450c6f68b6d tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-14f3f22e-89f7-4614-9694-24e93ca1a960.info {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:37 devstack sudo[108259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-14f3f22e-89f7-4614-9694-24e93ca1a960.info
Jul 30 20:41:37 devstack sudo[108259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:37 devstack sudo[108259]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:37 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3fa9d6b9-94e2-478a-be90-e450c6f68b6d tempest-ProjectMemberTests-47051868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-14f3f22e-89f7-4614-9694-24e93ca1a960.info" returned: 0 in 0.313s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:37 devstack cinder-volume[88719]: WARNING cinder.volume.drivers.remotefs [None req-3fa9d6b9-94e2-478a-be90-e450c6f68b6d tempest-ProjectMemberTests-47051868 None] /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-14f3f22e-89f7-4614-9694-24e93ca1a960.info is being set with open permissions: ugo+rw
Jul 30 20:41:37 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3fa9d6b9-94e2-478a-be90-e450c6f68b6d tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-14f3f22e-89f7-4614-9694-24e93ca1a960.info {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:37 devstack sudo[108262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-14f3f22e-89f7-4614-9694-24e93ca1a960.info
Jul 30 20:41:37 devstack sudo[108262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:37 devstack sudo[108262]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:37 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3fa9d6b9-94e2-478a-be90-e450c6f68b6d tempest-ProjectMemberTests-47051868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-14f3f22e-89f7-4614-9694-24e93ca1a960.info" returned: 0 in 0.267s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:37 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-3fa9d6b9-94e2-478a-be90-e450c6f68b6d tempest-ProjectMemberTests-47051868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.239s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:41:37 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-3fa9d6b9-94e2-478a-be90-e450c6f68b6d tempest-ProjectMemberTests-47051868 None] Create snapshot completed successfully
Jul 30 20:41:38 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-cb61ef10-7cb6-40cb-9e66-2e8248d849d1 tempest-ProjectMemberTests-47051868 None] Acquiring lock "cinder-6ca4d348-623f-46b3-8558-b49e0f6d1889-delete_snapshot" by "delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:41:38 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-cb61ef10-7cb6-40cb-9e66-2e8248d849d1 tempest-ProjectMemberTests-47051868 None] Lock "cinder-6ca4d348-623f-46b3-8558-b49e0f6d1889-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:41:38 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-cb61ef10-7cb6-40cb-9e66-2e8248d849d1 tempest-ProjectMemberTests-47051868 None] Acquiring lock "cinder-quobyte-14f3f22e-89f7-4614-9694-24e93ca1a960" by "delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:41:38 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-cb61ef10-7cb6-40cb-9e66-2e8248d849d1 tempest-ProjectMemberTests-47051868 None] Lock "cinder-quobyte-14f3f22e-89f7-4614-9694-24e93ca1a960" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:41:38 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-cb61ef10-7cb6-40cb-9e66-2e8248d849d1 tempest-ProjectMemberTests-47051868 None] Acquiring lock "cinder-quobyte-6ca4d348-623f-46b3-8558-b49e0f6d1889" by "_delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:41:38 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-cb61ef10-7cb6-40cb-9e66-2e8248d849d1 tempest-ProjectMemberTests-47051868 None] Lock "cinder-quobyte-6ca4d348-623f-46b3-8558-b49e0f6d1889" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:41:38 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-cb61ef10-7cb6-40cb-9e66-2e8248d849d1 tempest-ProjectMemberTests-47051868 None] Deleting offline snapshot 6ca4d348-623f-46b3-8558-b49e0f6d1889 of volume 14f3f22e-89f7-4614-9694-24e93ca1a960 {{(pid=88719) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 30 20:41:38 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-cb61ef10-7cb6-40cb-9e66-2e8248d849d1 tempest-ProjectMemberTests-47051868 None] snapshot_file for this snap is: volume-14f3f22e-89f7-4614-9694-24e93ca1a960.6ca4d348-623f-46b3-8558-b49e0f6d1889 {{(pid=88719) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 30 20:41:38 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d574bce-89bc-4386-b419-292601beb616]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:41:38 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-cb61ef10-7cb6-40cb-9e66-2e8248d849d1 tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-14f3f22e-89f7-4614-9694-24e93ca1a960.6ca4d348-623f-46b3-8558-b49e0f6d1889 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:38 devstack sudo[108267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-14f3f22e-89f7-4614-9694-24e93ca1a960.6ca4d348-623f-46b3-8558-b49e0f6d1889
Jul 30 20:41:38 devstack sudo[108267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:39 devstack sudo[108267]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:39 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-cb61ef10-7cb6-40cb-9e66-2e8248d849d1 tempest-ProjectMemberTests-47051868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-14f3f22e-89f7-4614-9694-24e93ca1a960.6ca4d348-623f-46b3-8558-b49e0f6d1889" returned: 0 in 0.405s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:39 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-cb61ef10-7cb6-40cb-9e66-2e8248d849d1 tempest-ProjectMemberTests-47051868 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-14f3f22e-89f7-4614-9694-24e93ca1a960(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88719) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 30 20:41:39 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[262d3c45-1250-4c6f-8f00-7e4f218b02cf]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:41:39 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-cb61ef10-7cb6-40cb-9e66-2e8248d849d1 tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-14f3f22e-89f7-4614-9694-24e93ca1a960 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:39 devstack sudo[108273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-14f3f22e-89f7-4614-9694-24e93ca1a960
Jul 30 20:41:39 devstack sudo[108273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:39 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-27effc4a-ce83-416f-b78b-eeaf0eced536 tempest-ProjectReaderTests-1988360028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:41:39 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-27effc4a-ce83-416f-b78b-eeaf0eced536 tempest-ProjectReaderTests-1988360028 None] Flow 'volume_create_manager' (ad760c1f-cc29-42dc-887f-bc3b173b4b41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:41:39 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-27effc4a-ce83-416f-b78b-eeaf0eced536 tempest-ProjectReaderTests-1988360028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (805582cf-cfcf-483c-bfd9-fe89d33c7d71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:41:39 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-27effc4a-ce83-416f-b78b-eeaf0eced536 tempest-ProjectReaderTests-1988360028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (805582cf-cfcf-483c-bfd9-fe89d33c7d71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:41:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-373639572',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=817ceee3-e94f-4ab4-9fc1-6735e04fee93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7b0c78c72fa4b7da70731a275a24f3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:41:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:41:39Z,use_quota=True,user_id='66f5ff347f4541e383a978346a7ec5a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:41:39 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-27effc4a-ce83-416f-b78b-eeaf0eced536 tempest-ProjectReaderTests-1988360028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee25cc70-96ca-4150-b2a2-0c42b436b866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:41:39 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-27effc4a-ce83-416f-b78b-eeaf0eced536 tempest-ProjectReaderTests-1988360028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee25cc70-96ca-4150-b2a2-0c42b436b866) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:41:39 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-27effc4a-ce83-416f-b78b-eeaf0eced536 tempest-ProjectReaderTests-1988360028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bd96755-b690-40dd-88ef-26e418ce8747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:41:39 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-27effc4a-ce83-416f-b78b-eeaf0eced536 tempest-ProjectReaderTests-1988360028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bd96755-b690-40dd-88ef-26e418ce8747) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '817ceee3-e94f-4ab4-9fc1-6735e04fee93', 'volume_name': 'volume-817ceee3-e94f-4ab4-9fc1-6735e04fee93', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:41:39 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-27effc4a-ce83-416f-b78b-eeaf0eced536 tempest-ProjectReaderTests-1988360028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c434eb6-d2e1-4529-94be-e95a99bcaf04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:41:39 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-27effc4a-ce83-416f-b78b-eeaf0eced536 tempest-ProjectReaderTests-1988360028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c434eb6-d2e1-4529-94be-e95a99bcaf04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:41:39 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-27effc4a-ce83-416f-b78b-eeaf0eced536 tempest-ProjectReaderTests-1988360028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbdee612-50b9-46b8-a088-6654160afef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:41:39 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-27effc4a-ce83-416f-b78b-eeaf0eced536 tempest-ProjectReaderTests-1988360028 None] Volume 817ceee3-e94f-4ab4-9fc1-6735e04fee93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-817ceee3-e94f-4ab4-9fc1-6735e04fee93', 'volume_size': 1}
Jul 30 20:41:39 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-27effc4a-ce83-416f-b78b-eeaf0eced536 tempest-ProjectReaderTests-1988360028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:41:39 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-27effc4a-ce83-416f-b78b-eeaf0eced536 tempest-ProjectReaderTests-1988360028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:41:39 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-27effc4a-ce83-416f-b78b-eeaf0eced536 tempest-ProjectReaderTests-1988360028 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:41:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-373639572',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=817ceee3-e94f-4ab4-9fc1-6735e04fee93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7b0c78c72fa4b7da70731a275a24f3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:41:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:41:39Z,use_quota=True,user_id='66f5ff347f4541e383a978346a7ec5a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:41:39 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-27effc4a-ce83-416f-b78b-eeaf0eced536 tempest-ProjectReaderTests-1988360028 None] Creating volume 817ceee3-e94f-4ab4-9fc1-6735e04fee93 {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:41:39 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-27effc4a-ce83-416f-b78b-eeaf0eced536 tempest-ProjectReaderTests-1988360028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:41:39 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-27effc4a-ce83-416f-b78b-eeaf0eced536 tempest-ProjectReaderTests-1988360028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:41:39 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-27effc4a-ce83-416f-b78b-eeaf0eced536 tempest-ProjectReaderTests-1988360028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:41:39 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-27effc4a-ce83-416f-b78b-eeaf0eced536 tempest-ProjectReaderTests-1988360028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:41:39 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-27effc4a-ce83-416f-b78b-eeaf0eced536 tempest-ProjectReaderTests-1988360028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:41:39 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-27effc4a-ce83-416f-b78b-eeaf0eced536 tempest-ProjectReaderTests-1988360028 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:41:39 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-27effc4a-ce83-416f-b78b-eeaf0eced536 tempest-ProjectReaderTests-1988360028 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:41:39 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-27effc4a-ce83-416f-b78b-eeaf0eced536 tempest-ProjectReaderTests-1988360028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-817ceee3-e94f-4ab4-9fc1-6735e04fee93 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:39 devstack sudo[108275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-817ceee3-e94f-4ab4-9fc1-6735e04fee93 1073741824
Jul 30 20:41:39 devstack sudo[108275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:39 devstack sudo[108273]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:39 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-cb61ef10-7cb6-40cb-9e66-2e8248d849d1 tempest-ProjectMemberTests-47051868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-14f3f22e-89f7-4614-9694-24e93ca1a960" returned: 0 in 0.368s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:39 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-cb61ef10-7cb6-40cb-9e66-2e8248d849d1 tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-14f3f22e-89f7-4614-9694-24e93ca1a960.6ca4d348-623f-46b3-8558-b49e0f6d1889 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:39 devstack sudo[108280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-14f3f22e-89f7-4614-9694-24e93ca1a960.6ca4d348-623f-46b3-8558-b49e0f6d1889
Jul 30 20:41:39 devstack sudo[108280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:39 devstack sudo[108275]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:39 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-27effc4a-ce83-416f-b78b-eeaf0eced536 tempest-ProjectReaderTests-1988360028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-817ceee3-e94f-4ab4-9fc1-6735e04fee93 1073741824" returned: 0 in 0.439s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:40 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-27effc4a-ce83-416f-b78b-eeaf0eced536 tempest-ProjectReaderTests-1988360028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-817ceee3-e94f-4ab4-9fc1-6735e04fee93 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:40 devstack sudo[108280]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:40 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-cb61ef10-7cb6-40cb-9e66-2e8248d849d1 tempest-ProjectMemberTests-47051868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-14f3f22e-89f7-4614-9694-24e93ca1a960.6ca4d348-623f-46b3-8558-b49e0f6d1889" returned: 0 in 0.362s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:40 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-cb61ef10-7cb6-40cb-9e66-2e8248d849d1 tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-14f3f22e-89f7-4614-9694-24e93ca1a960.6ca4d348-623f-46b3-8558-b49e0f6d1889 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:40 devstack sudo[108289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-817ceee3-e94f-4ab4-9fc1-6735e04fee93
Jul 30 20:41:40 devstack sudo[108289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:40 devstack sudo[108290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-14f3f22e-89f7-4614-9694-24e93ca1a960.6ca4d348-623f-46b3-8558-b49e0f6d1889
Jul 30 20:41:40 devstack sudo[108290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:40 devstack sudo[108289]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:40 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-27effc4a-ce83-416f-b78b-eeaf0eced536 tempest-ProjectReaderTests-1988360028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-817ceee3-e94f-4ab4-9fc1-6735e04fee93" returned: 0 in 0.267s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:40 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-27effc4a-ce83-416f-b78b-eeaf0eced536 tempest-ProjectReaderTests-1988360028 None] <== create_volume: return (751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:41:40 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-27effc4a-ce83-416f-b78b-eeaf0eced536 tempest-ProjectReaderTests-1988360028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.754s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:41:40 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-27effc4a-ce83-416f-b78b-eeaf0eced536 tempest-ProjectReaderTests-1988360028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbdee612-50b9-46b8-a088-6654160afef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-817ceee3-e94f-4ab4-9fc1-6735e04fee93', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:41:40 devstack sudo[108290]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:40 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-27effc4a-ce83-416f-b78b-eeaf0eced536 tempest-ProjectReaderTests-1988360028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (100bca9b-a3e3-414a-bd47-b23793faef0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:41:40 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-cb61ef10-7cb6-40cb-9e66-2e8248d849d1 tempest-ProjectMemberTests-47051868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-14f3f22e-89f7-4614-9694-24e93ca1a960.6ca4d348-623f-46b3-8558-b49e0f6d1889" returned: 0 in 0.273s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:40 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-cb61ef10-7cb6-40cb-9e66-2e8248d849d1 tempest-ProjectMemberTests-47051868 None] Lock "cinder-quobyte-6ca4d348-623f-46b3-8558-b49e0f6d1889" released by "_delete_snapshot" :: held 1.512s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:41:40 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-27effc4a-ce83-416f-b78b-eeaf0eced536 tempest-ProjectReaderTests-1988360028 None] Volume volume-817ceee3-e94f-4ab4-9fc1-6735e04fee93 (817ceee3-e94f-4ab4-9fc1-6735e04fee93): created successfully
Jul 30 20:41:40 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-27effc4a-ce83-416f-b78b-eeaf0eced536 tempest-ProjectReaderTests-1988360028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (100bca9b-a3e3-414a-bd47-b23793faef0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:41:40 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-27effc4a-ce83-416f-b78b-eeaf0eced536 tempest-ProjectReaderTests-1988360028 None] Flow 'volume_create_manager' (ad760c1f-cc29-42dc-887f-bc3b173b4b41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:41:40 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-cb61ef10-7cb6-40cb-9e66-2e8248d849d1 tempest-ProjectMemberTests-47051868 None] Lock "cinder-quobyte-14f3f22e-89f7-4614-9694-24e93ca1a960" released by "delete_snapshot" :: held 1.550s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:41:40 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-27effc4a-ce83-416f-b78b-eeaf0eced536 tempest-ProjectReaderTests-1988360028 None] Created volume successfully.
Jul 30 20:41:40 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-cb61ef10-7cb6-40cb-9e66-2e8248d849d1 tempest-ProjectMemberTests-47051868 None] Created reservations ['b413ff69-1013-4430-905a-6fe31114054e', '7b9e7bd5-fd78-4f44-bf3a-71a4ac950296', 'bbd3ce1c-b3d8-45ba-8f27-e8e599a0c44f', 'fda30251-0a73-4453-99a0-3bde4473f298'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:41:40 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-cb61ef10-7cb6-40cb-9e66-2e8248d849d1 tempest-ProjectMemberTests-47051868 None] Delete snapshot completed successfully.
Jul 30 20:41:40 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-cb61ef10-7cb6-40cb-9e66-2e8248d849d1 tempest-ProjectMemberTests-47051868 None] Lock "cinder-6ca4d348-623f-46b3-8558-b49e0f6d1889-delete_snapshot" released by "delete_snapshot" :: held 1.702s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:41:40 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-4aaccac5-54f6-4af7-a5eb-25f674f9ef21 tempest-ProjectReaderTests-1988360028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:41:40 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-4aaccac5-54f6-4af7-a5eb-25f674f9ef21 tempest-ProjectReaderTests-1988360028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:41:40 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-4aaccac5-54f6-4af7-a5eb-25f674f9ef21 tempest-ProjectReaderTests-1988360028 None] Creating offline snapshot ef54d9c2-93a2-4352-a401-36c5d1e25311 of volume 817ceee3-e94f-4ab4-9fc1-6735e04fee93 {{(pid=88719) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 30 20:41:40 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ac1d21c-d493-49f2-be0d-ec8fb40b8e8d]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:41:40 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-4aaccac5-54f6-4af7-a5eb-25f674f9ef21 tempest-ProjectReaderTests-1988360028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-817ceee3-e94f-4ab4-9fc1-6735e04fee93 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:40 devstack sudo[108295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-817ceee3-e94f-4ab4-9fc1-6735e04fee93
Jul 30 20:41:40 devstack sudo[108295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:40 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-589bb895-70b5-42ad-938a-580f9aec46f5 tempest-ProjectMemberTests-47051868 None] Acquiring lock "cinder-14f3f22e-89f7-4614-9694-24e93ca1a960-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:41:40 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-589bb895-70b5-42ad-938a-580f9aec46f5 tempest-ProjectMemberTests-47051868 None] Lock "cinder-14f3f22e-89f7-4614-9694-24e93ca1a960-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:41:40 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-589bb895-70b5-42ad-938a-580f9aec46f5 tempest-ProjectMemberTests-47051868 None] Acquiring lock "cinder-quobyte-14f3f22e-89f7-4614-9694-24e93ca1a960" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:41:40 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-589bb895-70b5-42ad-938a-580f9aec46f5 tempest-ProjectMemberTests-47051868 None] Lock "cinder-quobyte-14f3f22e-89f7-4614-9694-24e93ca1a960" acquired by "delete_volume" :: waited 0.015s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:41:41 devstack sudo[108295]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:41 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-4aaccac5-54f6-4af7-a5eb-25f674f9ef21 tempest-ProjectReaderTests-1988360028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-817ceee3-e94f-4ab4-9fc1-6735e04fee93" returned: 0 in 0.376s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:41 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-4aaccac5-54f6-4af7-a5eb-25f674f9ef21 tempest-ProjectReaderTests-1988360028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-817ceee3-e94f-4ab4-9fc1-6735e04fee93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-817ceee3-e94f-4ab4-9fc1-6735e04fee93.ef54d9c2-93a2-4352-a401-36c5d1e25311 1G {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:41 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf237aba-71a9-4286-a1d9-b909aa25f164]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:41:41 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-589bb895-70b5-42ad-938a-580f9aec46f5 tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-14f3f22e-89f7-4614-9694-24e93ca1a960 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:41 devstack sudo[108300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-817ceee3-e94f-4ab4-9fc1-6735e04fee93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-817ceee3-e94f-4ab4-9fc1-6735e04fee93.ef54d9c2-93a2-4352-a401-36c5d1e25311 1G
Jul 30 20:41:41 devstack sudo[108300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:41 devstack sudo[108301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-14f3f22e-89f7-4614-9694-24e93ca1a960
Jul 30 20:41:41 devstack sudo[108301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:41 devstack sudo[108300]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:41 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-4aaccac5-54f6-4af7-a5eb-25f674f9ef21 tempest-ProjectReaderTests-1988360028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-817ceee3-e94f-4ab4-9fc1-6735e04fee93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-817ceee3-e94f-4ab4-9fc1-6735e04fee93.ef54d9c2-93a2-4352-a401-36c5d1e25311 1G" returned: 0 in 0.390s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:41 devstack sudo[108301]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:41 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-4aaccac5-54f6-4af7-a5eb-25f674f9ef21 tempest-ProjectReaderTests-1988360028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-817ceee3-e94f-4ab4-9fc1-6735e04fee93 -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-817ceee3-e94f-4ab4-9fc1-6735e04fee93.ef54d9c2-93a2-4352-a401-36c5d1e25311 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:41 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-589bb895-70b5-42ad-938a-580f9aec46f5 tempest-ProjectMemberTests-47051868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-14f3f22e-89f7-4614-9694-24e93ca1a960" returned: 0 in 0.391s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:41 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-589bb895-70b5-42ad-938a-580f9aec46f5 tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-14f3f22e-89f7-4614-9694-24e93ca1a960 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:41 devstack sudo[108310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-817ceee3-e94f-4ab4-9fc1-6735e04fee93 -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-817ceee3-e94f-4ab4-9fc1-6735e04fee93.ef54d9c2-93a2-4352-a401-36c5d1e25311
Jul 30 20:41:41 devstack sudo[108310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:41 devstack sudo[108311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-14f3f22e-89f7-4614-9694-24e93ca1a960
Jul 30 20:41:41 devstack sudo[108311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:41 devstack sudo[108311]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:41 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-589bb895-70b5-42ad-938a-580f9aec46f5 tempest-ProjectMemberTests-47051868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-14f3f22e-89f7-4614-9694-24e93ca1a960" returned: 0 in 0.251s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:41 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-589bb895-70b5-42ad-938a-580f9aec46f5 tempest-ProjectMemberTests-47051868 None] Lock "cinder-quobyte-14f3f22e-89f7-4614-9694-24e93ca1a960" released by "delete_volume" :: held 0.716s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:41:41 devstack sudo[108310]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:41 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-4aaccac5-54f6-4af7-a5eb-25f674f9ef21 tempest-ProjectReaderTests-1988360028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-817ceee3-e94f-4ab4-9fc1-6735e04fee93 -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-817ceee3-e94f-4ab4-9fc1-6735e04fee93.ef54d9c2-93a2-4352-a401-36c5d1e25311" returned: 0 in 0.304s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:41 devstack cinder-volume[88719]: WARNING cinder.volume.drivers.remotefs [None req-4aaccac5-54f6-4af7-a5eb-25f674f9ef21 tempest-ProjectReaderTests-1988360028 None] /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-817ceee3-e94f-4ab4-9fc1-6735e04fee93.ef54d9c2-93a2-4352-a401-36c5d1e25311 is being set with open permissions: ugo+rw
Jul 30 20:41:41 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-4aaccac5-54f6-4af7-a5eb-25f674f9ef21 tempest-ProjectReaderTests-1988360028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-817ceee3-e94f-4ab4-9fc1-6735e04fee93.ef54d9c2-93a2-4352-a401-36c5d1e25311 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:41 devstack sudo[108318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-817ceee3-e94f-4ab4-9fc1-6735e04fee93.ef54d9c2-93a2-4352-a401-36c5d1e25311
Jul 30 20:41:41 devstack sudo[108318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:41 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-589bb895-70b5-42ad-938a-580f9aec46f5 tempest-ProjectMemberTests-47051868 None] Created reservations ['5a8d6e0d-54ca-491a-8632-93cad9fc1d3c', 'a1e2e23e-052f-46dd-8347-bf2d1e3bd988', '8a8dbad6-7ada-4c09-b402-c459f3ba59a1', '1aa9317f-1bd4-4097-8244-ba4a15ea55b4'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:41:41 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-589bb895-70b5-42ad-938a-580f9aec46f5 tempest-ProjectMemberTests-47051868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:41:41 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-589bb895-70b5-42ad-938a-580f9aec46f5 tempest-ProjectMemberTests-47051868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:41:41 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-589bb895-70b5-42ad-938a-580f9aec46f5 tempest-ProjectMemberTests-47051868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:41:41 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-589bb895-70b5-42ad-938a-580f9aec46f5 tempest-ProjectMemberTests-47051868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:41:41 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-589bb895-70b5-42ad-938a-580f9aec46f5 tempest-ProjectMemberTests-47051868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:41:41 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-589bb895-70b5-42ad-938a-580f9aec46f5 tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:41 devstack sudo[108320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:41:41 devstack sudo[108320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:41 devstack sudo[108318]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:41 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-4aaccac5-54f6-4af7-a5eb-25f674f9ef21 tempest-ProjectReaderTests-1988360028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-817ceee3-e94f-4ab4-9fc1-6735e04fee93.ef54d9c2-93a2-4352-a401-36c5d1e25311" returned: 0 in 0.257s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:42 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-4aaccac5-54f6-4af7-a5eb-25f674f9ef21 tempest-ProjectReaderTests-1988360028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-817ceee3-e94f-4ab4-9fc1-6735e04fee93.info {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:42 devstack sudo[108323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-817ceee3-e94f-4ab4-9fc1-6735e04fee93.info
Jul 30 20:41:42 devstack sudo[108323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:42 devstack sudo[108320]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:42 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-589bb895-70b5-42ad-938a-580f9aec46f5 tempest-ProjectMemberTests-47051868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.268s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:42 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-589bb895-70b5-42ad-938a-580f9aec46f5 tempest-ProjectMemberTests-47051868 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:41:42 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-589bb895-70b5-42ad-938a-580f9aec46f5 tempest-ProjectMemberTests-47051868 None] Deleted volume successfully.
Jul 30 20:41:42 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-589bb895-70b5-42ad-938a-580f9aec46f5 tempest-ProjectMemberTests-47051868 None] Lock "cinder-14f3f22e-89f7-4614-9694-24e93ca1a960-delete_volume" released by "delete_volume" :: held 1.205s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:41:42 devstack sudo[108323]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:42 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-4aaccac5-54f6-4af7-a5eb-25f674f9ef21 tempest-ProjectReaderTests-1988360028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-817ceee3-e94f-4ab4-9fc1-6735e04fee93.info" returned: 0 in 0.277s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:42 devstack cinder-volume[88719]: WARNING cinder.volume.drivers.remotefs [None req-4aaccac5-54f6-4af7-a5eb-25f674f9ef21 tempest-ProjectReaderTests-1988360028 None] /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-817ceee3-e94f-4ab4-9fc1-6735e04fee93.info is being set with open permissions: ugo+rw
Jul 30 20:41:42 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-4aaccac5-54f6-4af7-a5eb-25f674f9ef21 tempest-ProjectReaderTests-1988360028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-817ceee3-e94f-4ab4-9fc1-6735e04fee93.info {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:42 devstack sudo[108327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-817ceee3-e94f-4ab4-9fc1-6735e04fee93.info
Jul 30 20:41:42 devstack sudo[108327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:42 devstack sudo[108327]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:42 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-a02b1446-fb81-4529-9e08-51b35832c29d tempest-ProjectMemberTests-47051868 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:41:42 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-a02b1446-fb81-4529-9e08-51b35832c29d tempest-ProjectMemberTests-47051868 None] Flow 'volume_create_manager' (44e4c996-3880-43cc-9595-a98b67eb39ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:41:42 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-a02b1446-fb81-4529-9e08-51b35832c29d tempest-ProjectMemberTests-47051868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1858971-01a6-44ad-aacc-ff8059f7054f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:41:42 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-4aaccac5-54f6-4af7-a5eb-25f674f9ef21 tempest-ProjectReaderTests-1988360028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-817ceee3-e94f-4ab4-9fc1-6735e04fee93.info" returned: 0 in 0.288s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:42 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-4aaccac5-54f6-4af7-a5eb-25f674f9ef21 tempest-ProjectReaderTests-1988360028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.973s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:41:42 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-a02b1446-fb81-4529-9e08-51b35832c29d tempest-ProjectMemberTests-47051868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1858971-01a6-44ad-aacc-ff8059f7054f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:41:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-220571115',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=454edfee-64b1-440b-b8a3-6dc31bcfaab1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c483f66aa6ec477e9cb0547f0f04f6d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:41:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:41:43Z,use_quota=True,user_id='59a41c24b76545b79b09f90cd8c36728',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:41:42 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-a02b1446-fb81-4529-9e08-51b35832c29d tempest-ProjectMemberTests-47051868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (887c778c-de4b-42fd-b09f-5e376d9d62a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:41:42 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-a02b1446-fb81-4529-9e08-51b35832c29d tempest-ProjectMemberTests-47051868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (887c778c-de4b-42fd-b09f-5e376d9d62a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:41:42 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-a02b1446-fb81-4529-9e08-51b35832c29d tempest-ProjectMemberTests-47051868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b90dc67-baac-4800-8d42-7b75b0cee093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:41:42 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-a02b1446-fb81-4529-9e08-51b35832c29d tempest-ProjectMemberTests-47051868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b90dc67-baac-4800-8d42-7b75b0cee093) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '454edfee-64b1-440b-b8a3-6dc31bcfaab1', 'volume_name': 'volume-454edfee-64b1-440b-b8a3-6dc31bcfaab1', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:41:42 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-a02b1446-fb81-4529-9e08-51b35832c29d tempest-ProjectMemberTests-47051868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19733808-ac94-4a3c-95de-1fef4f4c2929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:41:42 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-a02b1446-fb81-4529-9e08-51b35832c29d tempest-ProjectMemberTests-47051868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19733808-ac94-4a3c-95de-1fef4f4c2929) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:41:42 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-a02b1446-fb81-4529-9e08-51b35832c29d tempest-ProjectMemberTests-47051868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e28dc65-0ebf-4a07-8f0c-52c3b9478d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:41:42 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-a02b1446-fb81-4529-9e08-51b35832c29d tempest-ProjectMemberTests-47051868 None] Volume 454edfee-64b1-440b-b8a3-6dc31bcfaab1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-454edfee-64b1-440b-b8a3-6dc31bcfaab1', 'volume_size': 1}
Jul 30 20:41:42 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-a02b1446-fb81-4529-9e08-51b35832c29d tempest-ProjectMemberTests-47051868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:41:42 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-a02b1446-fb81-4529-9e08-51b35832c29d tempest-ProjectMemberTests-47051868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:41:42 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-a02b1446-fb81-4529-9e08-51b35832c29d tempest-ProjectMemberTests-47051868 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:41:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-220571115',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=454edfee-64b1-440b-b8a3-6dc31bcfaab1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c483f66aa6ec477e9cb0547f0f04f6d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:41:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:41:43Z,use_quota=True,user_id='59a41c24b76545b79b09f90cd8c36728',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:41:42 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-a02b1446-fb81-4529-9e08-51b35832c29d tempest-ProjectMemberTests-47051868 None] Creating volume 454edfee-64b1-440b-b8a3-6dc31bcfaab1 {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:41:42 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-a02b1446-fb81-4529-9e08-51b35832c29d tempest-ProjectMemberTests-47051868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:41:42 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-a02b1446-fb81-4529-9e08-51b35832c29d tempest-ProjectMemberTests-47051868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:41:42 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-a02b1446-fb81-4529-9e08-51b35832c29d tempest-ProjectMemberTests-47051868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:41:42 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-a02b1446-fb81-4529-9e08-51b35832c29d tempest-ProjectMemberTests-47051868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:41:42 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-a02b1446-fb81-4529-9e08-51b35832c29d tempest-ProjectMemberTests-47051868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:41:42 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-a02b1446-fb81-4529-9e08-51b35832c29d tempest-ProjectMemberTests-47051868 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:41:42 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-a02b1446-fb81-4529-9e08-51b35832c29d tempest-ProjectMemberTests-47051868 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:41:42 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-a02b1446-fb81-4529-9e08-51b35832c29d tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-454edfee-64b1-440b-b8a3-6dc31bcfaab1 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:42 devstack sudo[108330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-454edfee-64b1-440b-b8a3-6dc31bcfaab1 1073741824
Jul 30 20:41:42 devstack sudo[108330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:42 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-4aaccac5-54f6-4af7-a5eb-25f674f9ef21 tempest-ProjectReaderTests-1988360028 None] Create snapshot completed successfully
Jul 30 20:41:43 devstack sudo[108330]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:43 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-a02b1446-fb81-4529-9e08-51b35832c29d tempest-ProjectMemberTests-47051868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-454edfee-64b1-440b-b8a3-6dc31bcfaab1 1073741824" returned: 0 in 0.402s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:43 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-a02b1446-fb81-4529-9e08-51b35832c29d tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-454edfee-64b1-440b-b8a3-6dc31bcfaab1 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:43 devstack sudo[108336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-454edfee-64b1-440b-b8a3-6dc31bcfaab1
Jul 30 20:41:43 devstack sudo[108336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:43 devstack sudo[108336]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:43 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-a02b1446-fb81-4529-9e08-51b35832c29d tempest-ProjectMemberTests-47051868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-454edfee-64b1-440b-b8a3-6dc31bcfaab1" returned: 0 in 0.248s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:43 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-a02b1446-fb81-4529-9e08-51b35832c29d tempest-ProjectMemberTests-47051868 None] <== create_volume: return (687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:41:43 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-a02b1446-fb81-4529-9e08-51b35832c29d tempest-ProjectMemberTests-47051868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.689s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:41:43 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-a02b1446-fb81-4529-9e08-51b35832c29d tempest-ProjectMemberTests-47051868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e28dc65-0ebf-4a07-8f0c-52c3b9478d18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-454edfee-64b1-440b-b8a3-6dc31bcfaab1', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:41:43 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-a02b1446-fb81-4529-9e08-51b35832c29d tempest-ProjectMemberTests-47051868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7470bf7b-6d2b-499c-b9a2-7a652c4fa407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:41:43 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-a02b1446-fb81-4529-9e08-51b35832c29d tempest-ProjectMemberTests-47051868 None] Volume volume-454edfee-64b1-440b-b8a3-6dc31bcfaab1 (454edfee-64b1-440b-b8a3-6dc31bcfaab1): created successfully
Jul 30 20:41:43 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-a02b1446-fb81-4529-9e08-51b35832c29d tempest-ProjectMemberTests-47051868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7470bf7b-6d2b-499c-b9a2-7a652c4fa407) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:41:43 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-a02b1446-fb81-4529-9e08-51b35832c29d tempest-ProjectMemberTests-47051868 None] Flow 'volume_create_manager' (44e4c996-3880-43cc-9595-a98b67eb39ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:41:43 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-a02b1446-fb81-4529-9e08-51b35832c29d tempest-ProjectMemberTests-47051868 None] Created volume successfully.
Jul 30 20:41:43 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-b745f3a7-5cac-4bd8-81bb-29a8e30bb62d tempest-ProjectMemberTests-47051868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:41:43 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-b745f3a7-5cac-4bd8-81bb-29a8e30bb62d tempest-ProjectMemberTests-47051868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:41:43 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-b745f3a7-5cac-4bd8-81bb-29a8e30bb62d tempest-ProjectMemberTests-47051868 None] Creating offline snapshot af89ee97-dbcc-41e0-862f-e5a36620f90f of volume 454edfee-64b1-440b-b8a3-6dc31bcfaab1 {{(pid=88719) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 30 20:41:43 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e57152f-a7ea-4409-8a31-70bfb686569e]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:41:43 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-b745f3a7-5cac-4bd8-81bb-29a8e30bb62d tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-454edfee-64b1-440b-b8a3-6dc31bcfaab1 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:43 devstack sudo[108339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-454edfee-64b1-440b-b8a3-6dc31bcfaab1
Jul 30 20:41:43 devstack sudo[108339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:43 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-639d3f7b-19cb-40e4-ab37-5efd20d91cb0 tempest-ProjectReaderTests-1988360028 None] Acquiring lock "cinder-ef54d9c2-93a2-4352-a401-36c5d1e25311-delete_snapshot" by "delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:41:43 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-639d3f7b-19cb-40e4-ab37-5efd20d91cb0 tempest-ProjectReaderTests-1988360028 None] Lock "cinder-ef54d9c2-93a2-4352-a401-36c5d1e25311-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:41:43 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-639d3f7b-19cb-40e4-ab37-5efd20d91cb0 tempest-ProjectReaderTests-1988360028 None] Acquiring lock "cinder-quobyte-817ceee3-e94f-4ab4-9fc1-6735e04fee93" by "delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:41:43 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-639d3f7b-19cb-40e4-ab37-5efd20d91cb0 tempest-ProjectReaderTests-1988360028 None] Lock "cinder-quobyte-817ceee3-e94f-4ab4-9fc1-6735e04fee93" acquired by "delete_snapshot" :: waited 0.014s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:41:43 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-639d3f7b-19cb-40e4-ab37-5efd20d91cb0 tempest-ProjectReaderTests-1988360028 None] Acquiring lock "cinder-quobyte-ef54d9c2-93a2-4352-a401-36c5d1e25311" by "_delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:41:43 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-639d3f7b-19cb-40e4-ab37-5efd20d91cb0 tempest-ProjectReaderTests-1988360028 None] Lock "cinder-quobyte-ef54d9c2-93a2-4352-a401-36c5d1e25311" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:41:43 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-639d3f7b-19cb-40e4-ab37-5efd20d91cb0 tempest-ProjectReaderTests-1988360028 None] Deleting offline snapshot ef54d9c2-93a2-4352-a401-36c5d1e25311 of volume 817ceee3-e94f-4ab4-9fc1-6735e04fee93 {{(pid=88719) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 30 20:41:44 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-639d3f7b-19cb-40e4-ab37-5efd20d91cb0 tempest-ProjectReaderTests-1988360028 None] snapshot_file for this snap is: volume-817ceee3-e94f-4ab4-9fc1-6735e04fee93.ef54d9c2-93a2-4352-a401-36c5d1e25311 {{(pid=88719) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 30 20:41:44 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d3b0c86-02fb-44e3-aa4d-b9d01bc50617]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:41:44 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-639d3f7b-19cb-40e4-ab37-5efd20d91cb0 tempest-ProjectReaderTests-1988360028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-817ceee3-e94f-4ab4-9fc1-6735e04fee93.ef54d9c2-93a2-4352-a401-36c5d1e25311 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:44 devstack sudo[108339]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:44 devstack sudo[108341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-817ceee3-e94f-4ab4-9fc1-6735e04fee93.ef54d9c2-93a2-4352-a401-36c5d1e25311
Jul 30 20:41:44 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-b745f3a7-5cac-4bd8-81bb-29a8e30bb62d tempest-ProjectMemberTests-47051868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-454edfee-64b1-440b-b8a3-6dc31bcfaab1" returned: 0 in 0.401s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:44 devstack sudo[108341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:44 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-b745f3a7-5cac-4bd8-81bb-29a8e30bb62d tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-454edfee-64b1-440b-b8a3-6dc31bcfaab1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-454edfee-64b1-440b-b8a3-6dc31bcfaab1.af89ee97-dbcc-41e0-862f-e5a36620f90f 1G {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:44 devstack sudo[108346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-454edfee-64b1-440b-b8a3-6dc31bcfaab1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-454edfee-64b1-440b-b8a3-6dc31bcfaab1.af89ee97-dbcc-41e0-862f-e5a36620f90f 1G
Jul 30 20:41:44 devstack sudo[108346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:44 devstack sudo[108341]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:44 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-639d3f7b-19cb-40e4-ab37-5efd20d91cb0 tempest-ProjectReaderTests-1988360028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-817ceee3-e94f-4ab4-9fc1-6735e04fee93.ef54d9c2-93a2-4352-a401-36c5d1e25311" returned: 0 in 0.381s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:44 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-639d3f7b-19cb-40e4-ab37-5efd20d91cb0 tempest-ProjectReaderTests-1988360028 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-817ceee3-e94f-4ab4-9fc1-6735e04fee93(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88719) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 30 20:41:44 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[237cfbfd-8bf0-4819-b91a-ab0fd50897ad]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:41:44 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-639d3f7b-19cb-40e4-ab37-5efd20d91cb0 tempest-ProjectReaderTests-1988360028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-817ceee3-e94f-4ab4-9fc1-6735e04fee93 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:44 devstack sudo[108355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-817ceee3-e94f-4ab4-9fc1-6735e04fee93
Jul 30 20:41:44 devstack sudo[108355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:44 devstack sudo[108346]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:44 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-b745f3a7-5cac-4bd8-81bb-29a8e30bb62d tempest-ProjectMemberTests-47051868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-454edfee-64b1-440b-b8a3-6dc31bcfaab1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-454edfee-64b1-440b-b8a3-6dc31bcfaab1.af89ee97-dbcc-41e0-862f-e5a36620f90f 1G" returned: 0 in 0.405s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:44 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-b745f3a7-5cac-4bd8-81bb-29a8e30bb62d tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-454edfee-64b1-440b-b8a3-6dc31bcfaab1 -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-454edfee-64b1-440b-b8a3-6dc31bcfaab1.af89ee97-dbcc-41e0-862f-e5a36620f90f {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:44 devstack sudo[108357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-454edfee-64b1-440b-b8a3-6dc31bcfaab1 -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-454edfee-64b1-440b-b8a3-6dc31bcfaab1.af89ee97-dbcc-41e0-862f-e5a36620f90f
Jul 30 20:41:44 devstack sudo[108357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:44 devstack sudo[108355]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:44 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-639d3f7b-19cb-40e4-ab37-5efd20d91cb0 tempest-ProjectReaderTests-1988360028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-817ceee3-e94f-4ab4-9fc1-6735e04fee93" returned: 0 in 0.375s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:44 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-639d3f7b-19cb-40e4-ab37-5efd20d91cb0 tempest-ProjectReaderTests-1988360028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-817ceee3-e94f-4ab4-9fc1-6735e04fee93.ef54d9c2-93a2-4352-a401-36c5d1e25311 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:44 devstack sudo[108365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-817ceee3-e94f-4ab4-9fc1-6735e04fee93.ef54d9c2-93a2-4352-a401-36c5d1e25311
Jul 30 20:41:44 devstack sudo[108365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:44 devstack sudo[108357]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:44 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-b745f3a7-5cac-4bd8-81bb-29a8e30bb62d tempest-ProjectMemberTests-47051868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-454edfee-64b1-440b-b8a3-6dc31bcfaab1 -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-454edfee-64b1-440b-b8a3-6dc31bcfaab1.af89ee97-dbcc-41e0-862f-e5a36620f90f" returned: 0 in 0.288s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:44 devstack cinder-volume[88719]: WARNING cinder.volume.drivers.remotefs [None req-b745f3a7-5cac-4bd8-81bb-29a8e30bb62d tempest-ProjectMemberTests-47051868 None] /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-454edfee-64b1-440b-b8a3-6dc31bcfaab1.af89ee97-dbcc-41e0-862f-e5a36620f90f is being set with open permissions: ugo+rw
Jul 30 20:41:44 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-b745f3a7-5cac-4bd8-81bb-29a8e30bb62d tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-454edfee-64b1-440b-b8a3-6dc31bcfaab1.af89ee97-dbcc-41e0-862f-e5a36620f90f {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:44 devstack sudo[108367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-454edfee-64b1-440b-b8a3-6dc31bcfaab1.af89ee97-dbcc-41e0-862f-e5a36620f90f
Jul 30 20:41:44 devstack sudo[108367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:45 devstack sudo[108367]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:45 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-b745f3a7-5cac-4bd8-81bb-29a8e30bb62d tempest-ProjectMemberTests-47051868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-454edfee-64b1-440b-b8a3-6dc31bcfaab1.af89ee97-dbcc-41e0-862f-e5a36620f90f" returned: 0 in 0.255s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:45 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-b745f3a7-5cac-4bd8-81bb-29a8e30bb62d tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-454edfee-64b1-440b-b8a3-6dc31bcfaab1.info {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:45 devstack sudo[108365]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:45 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-639d3f7b-19cb-40e4-ab37-5efd20d91cb0 tempest-ProjectReaderTests-1988360028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-817ceee3-e94f-4ab4-9fc1-6735e04fee93.ef54d9c2-93a2-4352-a401-36c5d1e25311" returned: 0 in 0.342s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:45 devstack sudo[108373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-454edfee-64b1-440b-b8a3-6dc31bcfaab1.info
Jul 30 20:41:45 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-639d3f7b-19cb-40e4-ab37-5efd20d91cb0 tempest-ProjectReaderTests-1988360028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-817ceee3-e94f-4ab4-9fc1-6735e04fee93.ef54d9c2-93a2-4352-a401-36c5d1e25311 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:45 devstack sudo[108373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:45 devstack sudo[108375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-817ceee3-e94f-4ab4-9fc1-6735e04fee93.ef54d9c2-93a2-4352-a401-36c5d1e25311
Jul 30 20:41:45 devstack sudo[108375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:45 devstack sudo[108373]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:45 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-b745f3a7-5cac-4bd8-81bb-29a8e30bb62d tempest-ProjectMemberTests-47051868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-454edfee-64b1-440b-b8a3-6dc31bcfaab1.info" returned: 0 in 0.258s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:45 devstack cinder-volume[88719]: WARNING cinder.volume.drivers.remotefs [None req-b745f3a7-5cac-4bd8-81bb-29a8e30bb62d tempest-ProjectMemberTests-47051868 None] /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-454edfee-64b1-440b-b8a3-6dc31bcfaab1.info is being set with open permissions: ugo+rw
Jul 30 20:41:45 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-b745f3a7-5cac-4bd8-81bb-29a8e30bb62d tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-454edfee-64b1-440b-b8a3-6dc31bcfaab1.info {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:45 devstack sudo[108375]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:45 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-639d3f7b-19cb-40e4-ab37-5efd20d91cb0 tempest-ProjectReaderTests-1988360028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-817ceee3-e94f-4ab4-9fc1-6735e04fee93.ef54d9c2-93a2-4352-a401-36c5d1e25311" returned: 0 in 0.249s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:45 devstack sudo[108380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-454edfee-64b1-440b-b8a3-6dc31bcfaab1.info
Jul 30 20:41:45 devstack sudo[108380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:45 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-639d3f7b-19cb-40e4-ab37-5efd20d91cb0 tempest-ProjectReaderTests-1988360028 None] Lock "cinder-quobyte-ef54d9c2-93a2-4352-a401-36c5d1e25311" released by "_delete_snapshot" :: held 1.434s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:41:45 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-639d3f7b-19cb-40e4-ab37-5efd20d91cb0 tempest-ProjectReaderTests-1988360028 None] Lock "cinder-quobyte-817ceee3-e94f-4ab4-9fc1-6735e04fee93" released by "delete_snapshot" :: held 1.459s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:41:45 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-639d3f7b-19cb-40e4-ab37-5efd20d91cb0 tempest-ProjectReaderTests-1988360028 None] Created reservations ['5b49fa38-fa70-45ae-b008-3b996b6694da', '487c43b2-b062-4c85-9461-f40fcdb5367e', 'bb6bb2e8-2a8d-4b2c-8546-a14b0206eb37', 'ffa2baf5-82bc-4853-a355-40566e2ba875'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:41:45 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-639d3f7b-19cb-40e4-ab37-5efd20d91cb0 tempest-ProjectReaderTests-1988360028 None] Delete snapshot completed successfully.
Jul 30 20:41:45 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-639d3f7b-19cb-40e4-ab37-5efd20d91cb0 tempest-ProjectReaderTests-1988360028 None] Lock "cinder-ef54d9c2-93a2-4352-a401-36c5d1e25311-delete_snapshot" released by "delete_snapshot" :: held 1.595s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:41:45 devstack sudo[108380]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:45 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-b745f3a7-5cac-4bd8-81bb-29a8e30bb62d tempest-ProjectMemberTests-47051868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-454edfee-64b1-440b-b8a3-6dc31bcfaab1.info" returned: 0 in 0.242s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:45 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-b745f3a7-5cac-4bd8-81bb-29a8e30bb62d tempest-ProjectMemberTests-47051868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.932s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:41:45 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-b745f3a7-5cac-4bd8-81bb-29a8e30bb62d tempest-ProjectMemberTests-47051868 None] Create snapshot completed successfully
Jul 30 20:41:45 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-432d84ad-c821-4b8e-873d-52b9d14fdde6 tempest-ProjectMemberTests-47051868 None] Acquiring lock "cinder-af89ee97-dbcc-41e0-862f-e5a36620f90f-delete_snapshot" by "delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:41:45 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-432d84ad-c821-4b8e-873d-52b9d14fdde6 tempest-ProjectMemberTests-47051868 None] Lock "cinder-af89ee97-dbcc-41e0-862f-e5a36620f90f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:41:45 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-432d84ad-c821-4b8e-873d-52b9d14fdde6 tempest-ProjectMemberTests-47051868 None] Acquiring lock "cinder-quobyte-454edfee-64b1-440b-b8a3-6dc31bcfaab1" by "delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:41:45 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-432d84ad-c821-4b8e-873d-52b9d14fdde6 tempest-ProjectMemberTests-47051868 None] Lock "cinder-quobyte-454edfee-64b1-440b-b8a3-6dc31bcfaab1" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:41:45 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-432d84ad-c821-4b8e-873d-52b9d14fdde6 tempest-ProjectMemberTests-47051868 None] Acquiring lock "cinder-quobyte-af89ee97-dbcc-41e0-862f-e5a36620f90f" by "_delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:41:45 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-432d84ad-c821-4b8e-873d-52b9d14fdde6 tempest-ProjectMemberTests-47051868 None] Lock "cinder-quobyte-af89ee97-dbcc-41e0-862f-e5a36620f90f" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:41:45 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-432d84ad-c821-4b8e-873d-52b9d14fdde6 tempest-ProjectMemberTests-47051868 None] Deleting offline snapshot af89ee97-dbcc-41e0-862f-e5a36620f90f of volume 454edfee-64b1-440b-b8a3-6dc31bcfaab1 {{(pid=88719) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 30 20:41:45 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-432d84ad-c821-4b8e-873d-52b9d14fdde6 tempest-ProjectMemberTests-47051868 None] snapshot_file for this snap is: volume-454edfee-64b1-440b-b8a3-6dc31bcfaab1.af89ee97-dbcc-41e0-862f-e5a36620f90f {{(pid=88719) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 30 20:41:45 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8eeb4a4-3d0a-4683-aab6-a9443b348ecc]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:41:45 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-432d84ad-c821-4b8e-873d-52b9d14fdde6 tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-454edfee-64b1-440b-b8a3-6dc31bcfaab1.af89ee97-dbcc-41e0-862f-e5a36620f90f {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:46 devstack sudo[108383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-454edfee-64b1-440b-b8a3-6dc31bcfaab1.af89ee97-dbcc-41e0-862f-e5a36620f90f
Jul 30 20:41:46 devstack sudo[108383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:46 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-e806e0ce-b292-4916-9ce9-8690562f401a tempest-ProjectReaderTests-1988360028 None] Acquiring lock "cinder-817ceee3-e94f-4ab4-9fc1-6735e04fee93-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:41:46 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-e806e0ce-b292-4916-9ce9-8690562f401a tempest-ProjectReaderTests-1988360028 None] Lock "cinder-817ceee3-e94f-4ab4-9fc1-6735e04fee93-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:41:46 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-e806e0ce-b292-4916-9ce9-8690562f401a tempest-ProjectReaderTests-1988360028 None] Acquiring lock "cinder-quobyte-817ceee3-e94f-4ab4-9fc1-6735e04fee93" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:41:46 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-e806e0ce-b292-4916-9ce9-8690562f401a tempest-ProjectReaderTests-1988360028 None] Lock "cinder-quobyte-817ceee3-e94f-4ab4-9fc1-6735e04fee93" acquired by "delete_volume" :: waited 0.017s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:41:46 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[affc6f1b-cb48-4b52-a990-a1d5390b9648]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:41:46 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-e806e0ce-b292-4916-9ce9-8690562f401a tempest-ProjectReaderTests-1988360028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-817ceee3-e94f-4ab4-9fc1-6735e04fee93 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:46 devstack sudo[108383]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:46 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-432d84ad-c821-4b8e-873d-52b9d14fdde6 tempest-ProjectMemberTests-47051868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-454edfee-64b1-440b-b8a3-6dc31bcfaab1.af89ee97-dbcc-41e0-862f-e5a36620f90f" returned: 0 in 0.377s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:46 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-432d84ad-c821-4b8e-873d-52b9d14fdde6 tempest-ProjectMemberTests-47051868 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-454edfee-64b1-440b-b8a3-6dc31bcfaab1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88719) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 30 20:41:46 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[40cce2b2-9897-4701-939a-102e9833b738]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:41:46 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-432d84ad-c821-4b8e-873d-52b9d14fdde6 tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-454edfee-64b1-440b-b8a3-6dc31bcfaab1 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:46 devstack sudo[108386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-817ceee3-e94f-4ab4-9fc1-6735e04fee93
Jul 30 20:41:46 devstack sudo[108386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:46 devstack sudo[108389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-454edfee-64b1-440b-b8a3-6dc31bcfaab1
Jul 30 20:41:46 devstack sudo[108389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:46 devstack sudo[108386]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:46 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-e806e0ce-b292-4916-9ce9-8690562f401a tempest-ProjectReaderTests-1988360028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-817ceee3-e94f-4ab4-9fc1-6735e04fee93" returned: 0 in 0.363s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:46 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-e806e0ce-b292-4916-9ce9-8690562f401a tempest-ProjectReaderTests-1988360028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-817ceee3-e94f-4ab4-9fc1-6735e04fee93 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:46 devstack sudo[108395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-817ceee3-e94f-4ab4-9fc1-6735e04fee93
Jul 30 20:41:46 devstack sudo[108395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:46 devstack sudo[108389]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:46 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-432d84ad-c821-4b8e-873d-52b9d14fdde6 tempest-ProjectMemberTests-47051868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-454edfee-64b1-440b-b8a3-6dc31bcfaab1" returned: 0 in 0.359s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:46 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-432d84ad-c821-4b8e-873d-52b9d14fdde6 tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-454edfee-64b1-440b-b8a3-6dc31bcfaab1.af89ee97-dbcc-41e0-862f-e5a36620f90f {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:46 devstack sudo[108400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-454edfee-64b1-440b-b8a3-6dc31bcfaab1.af89ee97-dbcc-41e0-862f-e5a36620f90f
Jul 30 20:41:46 devstack sudo[108400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:46 devstack sudo[108395]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:46 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-e806e0ce-b292-4916-9ce9-8690562f401a tempest-ProjectReaderTests-1988360028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-817ceee3-e94f-4ab4-9fc1-6735e04fee93" returned: 0 in 0.256s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:46 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-e806e0ce-b292-4916-9ce9-8690562f401a tempest-ProjectReaderTests-1988360028 None] Lock "cinder-quobyte-817ceee3-e94f-4ab4-9fc1-6735e04fee93" released by "delete_volume" :: held 0.689s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:41:46 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-e806e0ce-b292-4916-9ce9-8690562f401a tempest-ProjectReaderTests-1988360028 None] Created reservations ['584eb46a-9f4b-4323-a623-dc52c423e365', '053aff2b-6ff8-4e3d-96b3-8216f9a973d2', '994a1a7d-ef1e-4594-8fe7-c2b18e9d4ad0', '21dabc72-9492-43bd-8cd6-9ab6f86caad4'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:41:46 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-e806e0ce-b292-4916-9ce9-8690562f401a tempest-ProjectReaderTests-1988360028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:41:46 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-e806e0ce-b292-4916-9ce9-8690562f401a tempest-ProjectReaderTests-1988360028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:41:46 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-e806e0ce-b292-4916-9ce9-8690562f401a tempest-ProjectReaderTests-1988360028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:41:46 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-e806e0ce-b292-4916-9ce9-8690562f401a tempest-ProjectReaderTests-1988360028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:41:46 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-e806e0ce-b292-4916-9ce9-8690562f401a tempest-ProjectReaderTests-1988360028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:41:46 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-e806e0ce-b292-4916-9ce9-8690562f401a tempest-ProjectReaderTests-1988360028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:47 devstack sudo[108407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:41:47 devstack sudo[108407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:47 devstack sudo[108400]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:47 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-432d84ad-c821-4b8e-873d-52b9d14fdde6 tempest-ProjectMemberTests-47051868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-454edfee-64b1-440b-b8a3-6dc31bcfaab1.af89ee97-dbcc-41e0-862f-e5a36620f90f" returned: 0 in 0.356s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:47 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-432d84ad-c821-4b8e-873d-52b9d14fdde6 tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-454edfee-64b1-440b-b8a3-6dc31bcfaab1.af89ee97-dbcc-41e0-862f-e5a36620f90f {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:47 devstack sudo[108409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-454edfee-64b1-440b-b8a3-6dc31bcfaab1.af89ee97-dbcc-41e0-862f-e5a36620f90f
Jul 30 20:41:47 devstack sudo[108409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:47 devstack sudo[108407]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:47 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-e806e0ce-b292-4916-9ce9-8690562f401a tempest-ProjectReaderTests-1988360028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.266s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:47 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-e806e0ce-b292-4916-9ce9-8690562f401a tempest-ProjectReaderTests-1988360028 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:41:47 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-e806e0ce-b292-4916-9ce9-8690562f401a tempest-ProjectReaderTests-1988360028 None] Deleted volume successfully.
Jul 30 20:41:47 devstack sudo[108409]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:47 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-e806e0ce-b292-4916-9ce9-8690562f401a tempest-ProjectReaderTests-1988360028 None] Lock "cinder-817ceee3-e94f-4ab4-9fc1-6735e04fee93-delete_volume" released by "delete_volume" :: held 1.179s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:41:47 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-432d84ad-c821-4b8e-873d-52b9d14fdde6 tempest-ProjectMemberTests-47051868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-454edfee-64b1-440b-b8a3-6dc31bcfaab1.af89ee97-dbcc-41e0-862f-e5a36620f90f" returned: 0 in 0.261s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:47 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-432d84ad-c821-4b8e-873d-52b9d14fdde6 tempest-ProjectMemberTests-47051868 None] Lock "cinder-quobyte-af89ee97-dbcc-41e0-862f-e5a36620f90f" released by "_delete_snapshot" :: held 1.437s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:41:47 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-432d84ad-c821-4b8e-873d-52b9d14fdde6 tempest-ProjectMemberTests-47051868 None] Lock "cinder-quobyte-454edfee-64b1-440b-b8a3-6dc31bcfaab1" released by "delete_snapshot" :: held 1.467s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:41:47 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-432d84ad-c821-4b8e-873d-52b9d14fdde6 tempest-ProjectMemberTests-47051868 None] Created reservations ['186bfb16-806d-4c33-941a-a097042ca1cf', 'ef0438d3-75e5-4689-b624-eb2d5f4eb7c6', '8cb0d471-f847-486e-b820-92ad34e791b8', '885d506b-ce25-41bd-a56e-b94425b6d8be'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:41:47 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-432d84ad-c821-4b8e-873d-52b9d14fdde6 tempest-ProjectMemberTests-47051868 None] Delete snapshot completed successfully.
Jul 30 20:41:47 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-432d84ad-c821-4b8e-873d-52b9d14fdde6 tempest-ProjectMemberTests-47051868 None] Lock "cinder-af89ee97-dbcc-41e0-862f-e5a36620f90f-delete_snapshot" released by "delete_snapshot" :: held 1.613s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:41:47 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-9caa6a01-ed5d-455e-a5f7-2079c9401006 tempest-ProjectReaderTests-1988360028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:41:47 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-9caa6a01-ed5d-455e-a5f7-2079c9401006 tempest-ProjectReaderTests-1988360028 None] Flow 'volume_create_manager' (bbb84c08-fc23-4fbf-b8ba-aa2b8582012d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:41:47 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-9caa6a01-ed5d-455e-a5f7-2079c9401006 tempest-ProjectReaderTests-1988360028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4993dede-87bc-47a1-b5a6-c935e5014783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:41:47 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-9caa6a01-ed5d-455e-a5f7-2079c9401006 tempest-ProjectReaderTests-1988360028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4993dede-87bc-47a1-b5a6-c935e5014783) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:41:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-202922357',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c502654-bc5a-4228-aa3c-ea8d7d1f1766,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7b0c78c72fa4b7da70731a275a24f3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:41:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:41:48Z,use_quota=True,user_id='66f5ff347f4541e383a978346a7ec5a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:41:47 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-9caa6a01-ed5d-455e-a5f7-2079c9401006 tempest-ProjectReaderTests-1988360028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d64ff4c-7d5a-4910-8505-b7d6dafc6544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:41:47 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-9caa6a01-ed5d-455e-a5f7-2079c9401006 tempest-ProjectReaderTests-1988360028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d64ff4c-7d5a-4910-8505-b7d6dafc6544) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:41:47 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-9caa6a01-ed5d-455e-a5f7-2079c9401006 tempest-ProjectReaderTests-1988360028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5035787a-3b5a-49d8-83df-31f72edcf978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:41:47 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-9caa6a01-ed5d-455e-a5f7-2079c9401006 tempest-ProjectReaderTests-1988360028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5035787a-3b5a-49d8-83df-31f72edcf978) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c502654-bc5a-4228-aa3c-ea8d7d1f1766', 'volume_name': 'volume-4c502654-bc5a-4228-aa3c-ea8d7d1f1766', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:41:47 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-9caa6a01-ed5d-455e-a5f7-2079c9401006 tempest-ProjectReaderTests-1988360028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08ac0d5b-794f-46c0-9962-0b453e824095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:41:47 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-9caa6a01-ed5d-455e-a5f7-2079c9401006 tempest-ProjectReaderTests-1988360028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08ac0d5b-794f-46c0-9962-0b453e824095) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:41:47 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-9caa6a01-ed5d-455e-a5f7-2079c9401006 tempest-ProjectReaderTests-1988360028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1b5dcee-53b4-4f9a-851d-c2e233695632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:41:47 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-9caa6a01-ed5d-455e-a5f7-2079c9401006 tempest-ProjectReaderTests-1988360028 None] Volume 4c502654-bc5a-4228-aa3c-ea8d7d1f1766: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c502654-bc5a-4228-aa3c-ea8d7d1f1766', 'volume_size': 1}
Jul 30 20:41:47 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-9caa6a01-ed5d-455e-a5f7-2079c9401006 tempest-ProjectReaderTests-1988360028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:41:47 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-9caa6a01-ed5d-455e-a5f7-2079c9401006 tempest-ProjectReaderTests-1988360028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:41:47 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-9caa6a01-ed5d-455e-a5f7-2079c9401006 tempest-ProjectReaderTests-1988360028 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:41:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-202922357',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c502654-bc5a-4228-aa3c-ea8d7d1f1766,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7b0c78c72fa4b7da70731a275a24f3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:41:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:41:48Z,use_quota=True,user_id='66f5ff347f4541e383a978346a7ec5a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:41:47 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-9caa6a01-ed5d-455e-a5f7-2079c9401006 tempest-ProjectReaderTests-1988360028 None] Creating volume 4c502654-bc5a-4228-aa3c-ea8d7d1f1766 {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:41:47 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-9caa6a01-ed5d-455e-a5f7-2079c9401006 tempest-ProjectReaderTests-1988360028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:41:47 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-9caa6a01-ed5d-455e-a5f7-2079c9401006 tempest-ProjectReaderTests-1988360028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:41:47 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-9caa6a01-ed5d-455e-a5f7-2079c9401006 tempest-ProjectReaderTests-1988360028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:41:47 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-9caa6a01-ed5d-455e-a5f7-2079c9401006 tempest-ProjectReaderTests-1988360028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:41:47 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-9caa6a01-ed5d-455e-a5f7-2079c9401006 tempest-ProjectReaderTests-1988360028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:41:47 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-9caa6a01-ed5d-455e-a5f7-2079c9401006 tempest-ProjectReaderTests-1988360028 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:41:47 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-9caa6a01-ed5d-455e-a5f7-2079c9401006 tempest-ProjectReaderTests-1988360028 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:41:47 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-9caa6a01-ed5d-455e-a5f7-2079c9401006 tempest-ProjectReaderTests-1988360028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-4c502654-bc5a-4228-aa3c-ea8d7d1f1766 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:47 devstack sudo[108413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-4c502654-bc5a-4228-aa3c-ea8d7d1f1766 1073741824
Jul 30 20:41:47 devstack sudo[108413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:47 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-aa50e9e6-cd73-4411-94c0-534ca45ecd5e tempest-ProjectMemberTests-47051868 None] Acquiring lock "cinder-454edfee-64b1-440b-b8a3-6dc31bcfaab1-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:41:48 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-aa50e9e6-cd73-4411-94c0-534ca45ecd5e tempest-ProjectMemberTests-47051868 None] Lock "cinder-454edfee-64b1-440b-b8a3-6dc31bcfaab1-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:41:48 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-aa50e9e6-cd73-4411-94c0-534ca45ecd5e tempest-ProjectMemberTests-47051868 None] Acquiring lock "cinder-quobyte-454edfee-64b1-440b-b8a3-6dc31bcfaab1" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:41:48 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-aa50e9e6-cd73-4411-94c0-534ca45ecd5e tempest-ProjectMemberTests-47051868 None] Lock "cinder-quobyte-454edfee-64b1-440b-b8a3-6dc31bcfaab1" acquired by "delete_volume" :: waited 0.019s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:41:48 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[03163b4f-9b7a-403f-b7d0-1e976b7a77ba]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:41:48 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-aa50e9e6-cd73-4411-94c0-534ca45ecd5e tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-454edfee-64b1-440b-b8a3-6dc31bcfaab1 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:48 devstack sudo[108413]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:48 devstack sudo[108419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-454edfee-64b1-440b-b8a3-6dc31bcfaab1
Jul 30 20:41:48 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-9caa6a01-ed5d-455e-a5f7-2079c9401006 tempest-ProjectReaderTests-1988360028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-4c502654-bc5a-4228-aa3c-ea8d7d1f1766 1073741824" returned: 0 in 0.454s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:48 devstack sudo[108419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:48 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-9caa6a01-ed5d-455e-a5f7-2079c9401006 tempest-ProjectReaderTests-1988360028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-4c502654-bc5a-4228-aa3c-ea8d7d1f1766 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:48 devstack sudo[108421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-4c502654-bc5a-4228-aa3c-ea8d7d1f1766
Jul 30 20:41:48 devstack sudo[108421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:48 devstack sudo[108419]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:48 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-aa50e9e6-cd73-4411-94c0-534ca45ecd5e tempest-ProjectMemberTests-47051868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-454edfee-64b1-440b-b8a3-6dc31bcfaab1" returned: 0 in 0.385s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:48 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-aa50e9e6-cd73-4411-94c0-534ca45ecd5e tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-454edfee-64b1-440b-b8a3-6dc31bcfaab1 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:48 devstack sudo[108421]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:48 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-9caa6a01-ed5d-455e-a5f7-2079c9401006 tempest-ProjectReaderTests-1988360028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-4c502654-bc5a-4228-aa3c-ea8d7d1f1766" returned: 0 in 0.247s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:48 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-9caa6a01-ed5d-455e-a5f7-2079c9401006 tempest-ProjectReaderTests-1988360028 None] <== create_volume: return (741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:41:48 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-9caa6a01-ed5d-455e-a5f7-2079c9401006 tempest-ProjectReaderTests-1988360028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.743s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:41:48 devstack sudo[108427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-454edfee-64b1-440b-b8a3-6dc31bcfaab1
Jul 30 20:41:48 devstack sudo[108427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:48 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-9caa6a01-ed5d-455e-a5f7-2079c9401006 tempest-ProjectReaderTests-1988360028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1b5dcee-53b4-4f9a-851d-c2e233695632) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c502654-bc5a-4228-aa3c-ea8d7d1f1766', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:41:48 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-9caa6a01-ed5d-455e-a5f7-2079c9401006 tempest-ProjectReaderTests-1988360028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14796c0f-8c51-4f16-87ed-09fdc9821f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:41:48 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-9caa6a01-ed5d-455e-a5f7-2079c9401006 tempest-ProjectReaderTests-1988360028 None] Volume volume-4c502654-bc5a-4228-aa3c-ea8d7d1f1766 (4c502654-bc5a-4228-aa3c-ea8d7d1f1766): created successfully
Jul 30 20:41:48 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-9caa6a01-ed5d-455e-a5f7-2079c9401006 tempest-ProjectReaderTests-1988360028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14796c0f-8c51-4f16-87ed-09fdc9821f49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:41:48 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-9caa6a01-ed5d-455e-a5f7-2079c9401006 tempest-ProjectReaderTests-1988360028 None] Flow 'volume_create_manager' (bbb84c08-fc23-4fbf-b8ba-aa2b8582012d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:41:48 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-9caa6a01-ed5d-455e-a5f7-2079c9401006 tempest-ProjectReaderTests-1988360028 None] Created volume successfully.
Jul 30 20:41:48 devstack sudo[108427]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:48 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-aa50e9e6-cd73-4411-94c0-534ca45ecd5e tempest-ProjectMemberTests-47051868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-454edfee-64b1-440b-b8a3-6dc31bcfaab1" returned: 0 in 0.246s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:48 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-aa50e9e6-cd73-4411-94c0-534ca45ecd5e tempest-ProjectMemberTests-47051868 None] Lock "cinder-quobyte-454edfee-64b1-440b-b8a3-6dc31bcfaab1" released by "delete_volume" :: held 0.694s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:41:48 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-aa50e9e6-cd73-4411-94c0-534ca45ecd5e tempest-ProjectMemberTests-47051868 None] Created reservations ['e0a252d0-9254-4c50-bbf3-8ce4c48fe931', 'f67c5283-336d-4ac2-8116-16e726799b20', '0890acdf-ac05-46f9-91de-6a79dab4aae5', '516d00ac-a709-4141-b4d8-fefbcef30021'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:41:48 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-01aa58a9-f20f-44c9-93a7-09c14f820fe5 tempest-ProjectReaderTests-1988360028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:41:48 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-01aa58a9-f20f-44c9-93a7-09c14f820fe5 tempest-ProjectReaderTests-1988360028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:41:48 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-01aa58a9-f20f-44c9-93a7-09c14f820fe5 tempest-ProjectReaderTests-1988360028 None] Creating offline snapshot 29167d93-33ef-4045-a39e-916a4ad7e97d of volume 4c502654-bc5a-4228-aa3c-ea8d7d1f1766 {{(pid=88719) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 30 20:41:48 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-aa50e9e6-cd73-4411-94c0-534ca45ecd5e tempest-ProjectMemberTests-47051868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:41:48 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-aa50e9e6-cd73-4411-94c0-534ca45ecd5e tempest-ProjectMemberTests-47051868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:41:48 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-aa50e9e6-cd73-4411-94c0-534ca45ecd5e tempest-ProjectMemberTests-47051868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:41:48 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-aa50e9e6-cd73-4411-94c0-534ca45ecd5e tempest-ProjectMemberTests-47051868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:41:48 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-aa50e9e6-cd73-4411-94c0-534ca45ecd5e tempest-ProjectMemberTests-47051868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:41:48 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-aa50e9e6-cd73-4411-94c0-534ca45ecd5e tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:48 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[922e5459-20f3-4433-ba27-56221f86c717]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:41:48 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-01aa58a9-f20f-44c9-93a7-09c14f820fe5 tempest-ProjectReaderTests-1988360028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-4c502654-bc5a-4228-aa3c-ea8d7d1f1766 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:48 devstack sudo[108430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:41:48 devstack sudo[108430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:49 devstack sudo[108431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-4c502654-bc5a-4228-aa3c-ea8d7d1f1766
Jul 30 20:41:49 devstack sudo[108431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:49 devstack sudo[108430]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:49 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-aa50e9e6-cd73-4411-94c0-534ca45ecd5e tempest-ProjectMemberTests-47051868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.269s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:49 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-aa50e9e6-cd73-4411-94c0-534ca45ecd5e tempest-ProjectMemberTests-47051868 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:41:49 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-aa50e9e6-cd73-4411-94c0-534ca45ecd5e tempest-ProjectMemberTests-47051868 None] Deleted volume successfully.
Jul 30 20:41:49 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-aa50e9e6-cd73-4411-94c0-534ca45ecd5e tempest-ProjectMemberTests-47051868 None] Lock "cinder-454edfee-64b1-440b-b8a3-6dc31bcfaab1-delete_volume" released by "delete_volume" :: held 1.236s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:41:49 devstack sudo[108431]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:49 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-01aa58a9-f20f-44c9-93a7-09c14f820fe5 tempest-ProjectReaderTests-1988360028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-4c502654-bc5a-4228-aa3c-ea8d7d1f1766" returned: 0 in 0.401s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:49 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-01aa58a9-f20f-44c9-93a7-09c14f820fe5 tempest-ProjectReaderTests-1988360028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-4c502654-bc5a-4228-aa3c-ea8d7d1f1766,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-4c502654-bc5a-4228-aa3c-ea8d7d1f1766.29167d93-33ef-4045-a39e-916a4ad7e97d 1G {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:49 devstack sudo[108438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-4c502654-bc5a-4228-aa3c-ea8d7d1f1766,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-4c502654-bc5a-4228-aa3c-ea8d7d1f1766.29167d93-33ef-4045-a39e-916a4ad7e97d 1G
Jul 30 20:41:49 devstack sudo[108438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:49 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-debdb34e-6545-4a20-8f5c-3b7de5c3b095 tempest-ProjectMemberTests-47051868 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:41:49 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-debdb34e-6545-4a20-8f5c-3b7de5c3b095 tempest-ProjectMemberTests-47051868 None] Flow 'volume_create_manager' (fbdedd7e-afd3-4270-ada5-d61adc81b533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:41:49 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-debdb34e-6545-4a20-8f5c-3b7de5c3b095 tempest-ProjectMemberTests-47051868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afdefc15-f453-4154-a04b-9e1394f8c8de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:41:49 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-debdb34e-6545-4a20-8f5c-3b7de5c3b095 tempest-ProjectMemberTests-47051868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afdefc15-f453-4154-a04b-9e1394f8c8de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:41:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-448656954',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d2df796-83ad-451b-9ed2-8c1f49f10f70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c483f66aa6ec477e9cb0547f0f04f6d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:41:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:41:50Z,use_quota=True,user_id='59a41c24b76545b79b09f90cd8c36728',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:41:49 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-debdb34e-6545-4a20-8f5c-3b7de5c3b095 tempest-ProjectMemberTests-47051868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12acb42f-d0b8-4c6f-97cc-0ce94d159469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:41:49 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-debdb34e-6545-4a20-8f5c-3b7de5c3b095 tempest-ProjectMemberTests-47051868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12acb42f-d0b8-4c6f-97cc-0ce94d159469) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:41:49 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-debdb34e-6545-4a20-8f5c-3b7de5c3b095 tempest-ProjectMemberTests-47051868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a4eee64-7ac3-4a3e-b487-98d9ffaeebac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:41:49 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-debdb34e-6545-4a20-8f5c-3b7de5c3b095 tempest-ProjectMemberTests-47051868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a4eee64-7ac3-4a3e-b487-98d9ffaeebac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d2df796-83ad-451b-9ed2-8c1f49f10f70', 'volume_name': 'volume-1d2df796-83ad-451b-9ed2-8c1f49f10f70', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:41:49 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-debdb34e-6545-4a20-8f5c-3b7de5c3b095 tempest-ProjectMemberTests-47051868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e95f060-06b2-45c1-a590-25f4ba1e06eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:41:49 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-debdb34e-6545-4a20-8f5c-3b7de5c3b095 tempest-ProjectMemberTests-47051868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e95f060-06b2-45c1-a590-25f4ba1e06eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:41:49 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-debdb34e-6545-4a20-8f5c-3b7de5c3b095 tempest-ProjectMemberTests-47051868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b4872c0-1474-4098-a533-87d0f199b39e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:41:49 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-debdb34e-6545-4a20-8f5c-3b7de5c3b095 tempest-ProjectMemberTests-47051868 None] Volume 1d2df796-83ad-451b-9ed2-8c1f49f10f70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d2df796-83ad-451b-9ed2-8c1f49f10f70', 'volume_size': 1}
Jul 30 20:41:49 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-debdb34e-6545-4a20-8f5c-3b7de5c3b095 tempest-ProjectMemberTests-47051868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:41:49 devstack sudo[108438]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:49 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-01aa58a9-f20f-44c9-93a7-09c14f820fe5 tempest-ProjectReaderTests-1988360028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-4c502654-bc5a-4228-aa3c-ea8d7d1f1766,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-4c502654-bc5a-4228-aa3c-ea8d7d1f1766.29167d93-33ef-4045-a39e-916a4ad7e97d 1G" returned: 0 in 0.448s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:49 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-01aa58a9-f20f-44c9-93a7-09c14f820fe5 tempest-ProjectReaderTests-1988360028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c502654-bc5a-4228-aa3c-ea8d7d1f1766 -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-4c502654-bc5a-4228-aa3c-ea8d7d1f1766.29167d93-33ef-4045-a39e-916a4ad7e97d {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:49 devstack sudo[108444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c502654-bc5a-4228-aa3c-ea8d7d1f1766 -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-4c502654-bc5a-4228-aa3c-ea8d7d1f1766.29167d93-33ef-4045-a39e-916a4ad7e97d
Jul 30 20:41:49 devstack sudo[108444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:50 devstack sudo[108444]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:50 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-01aa58a9-f20f-44c9-93a7-09c14f820fe5 tempest-ProjectReaderTests-1988360028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c502654-bc5a-4228-aa3c-ea8d7d1f1766 -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-4c502654-bc5a-4228-aa3c-ea8d7d1f1766.29167d93-33ef-4045-a39e-916a4ad7e97d" returned: 0 in 0.293s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:50 devstack cinder-volume[88719]: WARNING cinder.volume.drivers.remotefs [None req-01aa58a9-f20f-44c9-93a7-09c14f820fe5 tempest-ProjectReaderTests-1988360028 None] /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-4c502654-bc5a-4228-aa3c-ea8d7d1f1766.29167d93-33ef-4045-a39e-916a4ad7e97d is being set with open permissions: ugo+rw
Jul 30 20:41:50 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-01aa58a9-f20f-44c9-93a7-09c14f820fe5 tempest-ProjectReaderTests-1988360028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-4c502654-bc5a-4228-aa3c-ea8d7d1f1766.29167d93-33ef-4045-a39e-916a4ad7e97d {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:50 devstack sudo[108449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-4c502654-bc5a-4228-aa3c-ea8d7d1f1766.29167d93-33ef-4045-a39e-916a4ad7e97d
Jul 30 20:41:50 devstack sudo[108449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:50 devstack sudo[108449]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:50 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-01aa58a9-f20f-44c9-93a7-09c14f820fe5 tempest-ProjectReaderTests-1988360028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-4c502654-bc5a-4228-aa3c-ea8d7d1f1766.29167d93-33ef-4045-a39e-916a4ad7e97d" returned: 0 in 0.253s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:50 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-01aa58a9-f20f-44c9-93a7-09c14f820fe5 tempest-ProjectReaderTests-1988360028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-4c502654-bc5a-4228-aa3c-ea8d7d1f1766.info {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:50 devstack sudo[108452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-4c502654-bc5a-4228-aa3c-ea8d7d1f1766.info
Jul 30 20:41:50 devstack sudo[108452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:50 devstack sudo[108452]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:50 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-01aa58a9-f20f-44c9-93a7-09c14f820fe5 tempest-ProjectReaderTests-1988360028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-4c502654-bc5a-4228-aa3c-ea8d7d1f1766.info" returned: 0 in 0.270s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:50 devstack cinder-volume[88719]: WARNING cinder.volume.drivers.remotefs [None req-01aa58a9-f20f-44c9-93a7-09c14f820fe5 tempest-ProjectReaderTests-1988360028 None] /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-4c502654-bc5a-4228-aa3c-ea8d7d1f1766.info is being set with open permissions: ugo+rw
Jul 30 20:41:50 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-01aa58a9-f20f-44c9-93a7-09c14f820fe5 tempest-ProjectReaderTests-1988360028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-4c502654-bc5a-4228-aa3c-ea8d7d1f1766.info {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:50 devstack sudo[108455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-4c502654-bc5a-4228-aa3c-ea8d7d1f1766.info
Jul 30 20:41:50 devstack sudo[108455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:50 devstack sudo[108455]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:50 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-01aa58a9-f20f-44c9-93a7-09c14f820fe5 tempest-ProjectReaderTests-1988360028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-4c502654-bc5a-4228-aa3c-ea8d7d1f1766.info" returned: 0 in 0.238s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:50 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-01aa58a9-f20f-44c9-93a7-09c14f820fe5 tempest-ProjectReaderTests-1988360028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.003s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:41:50 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-debdb34e-6545-4a20-8f5c-3b7de5c3b095 tempest-ProjectMemberTests-47051868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.191s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:41:50 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-debdb34e-6545-4a20-8f5c-3b7de5c3b095 tempest-ProjectMemberTests-47051868 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:41:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-448656954',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d2df796-83ad-451b-9ed2-8c1f49f10f70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c483f66aa6ec477e9cb0547f0f04f6d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:41:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:41:50Z,use_quota=True,user_id='59a41c24b76545b79b09f90cd8c36728',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:41:50 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-debdb34e-6545-4a20-8f5c-3b7de5c3b095 tempest-ProjectMemberTests-47051868 None] Creating volume 1d2df796-83ad-451b-9ed2-8c1f49f10f70 {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:41:50 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-debdb34e-6545-4a20-8f5c-3b7de5c3b095 tempest-ProjectMemberTests-47051868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:41:50 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-debdb34e-6545-4a20-8f5c-3b7de5c3b095 tempest-ProjectMemberTests-47051868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:41:50 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-debdb34e-6545-4a20-8f5c-3b7de5c3b095 tempest-ProjectMemberTests-47051868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:41:50 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-debdb34e-6545-4a20-8f5c-3b7de5c3b095 tempest-ProjectMemberTests-47051868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:41:50 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-debdb34e-6545-4a20-8f5c-3b7de5c3b095 tempest-ProjectMemberTests-47051868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:41:50 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-debdb34e-6545-4a20-8f5c-3b7de5c3b095 tempest-ProjectMemberTests-47051868 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:41:50 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-debdb34e-6545-4a20-8f5c-3b7de5c3b095 tempest-ProjectMemberTests-47051868 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:41:50 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-debdb34e-6545-4a20-8f5c-3b7de5c3b095 tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1d2df796-83ad-451b-9ed2-8c1f49f10f70 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:50 devstack sudo[108458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1d2df796-83ad-451b-9ed2-8c1f49f10f70 1073741824
Jul 30 20:41:50 devstack sudo[108458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:50 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-01aa58a9-f20f-44c9-93a7-09c14f820fe5 tempest-ProjectReaderTests-1988360028 None] Create snapshot completed successfully
Jul 30 20:41:51 devstack sudo[108458]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:51 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-debdb34e-6545-4a20-8f5c-3b7de5c3b095 tempest-ProjectMemberTests-47051868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1d2df796-83ad-451b-9ed2-8c1f49f10f70 1073741824" returned: 0 in 0.416s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:51 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-debdb34e-6545-4a20-8f5c-3b7de5c3b095 tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1d2df796-83ad-451b-9ed2-8c1f49f10f70 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:51 devstack sudo[108464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1d2df796-83ad-451b-9ed2-8c1f49f10f70
Jul 30 20:41:51 devstack sudo[108464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:51 devstack sudo[108464]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:51 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-debdb34e-6545-4a20-8f5c-3b7de5c3b095 tempest-ProjectMemberTests-47051868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1d2df796-83ad-451b-9ed2-8c1f49f10f70" returned: 0 in 0.249s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:51 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-debdb34e-6545-4a20-8f5c-3b7de5c3b095 tempest-ProjectMemberTests-47051868 None] <== create_volume: return (702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:41:51 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-debdb34e-6545-4a20-8f5c-3b7de5c3b095 tempest-ProjectMemberTests-47051868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.705s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:41:51 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-debdb34e-6545-4a20-8f5c-3b7de5c3b095 tempest-ProjectMemberTests-47051868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b4872c0-1474-4098-a533-87d0f199b39e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d2df796-83ad-451b-9ed2-8c1f49f10f70', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:41:51 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-debdb34e-6545-4a20-8f5c-3b7de5c3b095 tempest-ProjectMemberTests-47051868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (674b09c5-01e2-4756-a3bb-78e99cf74955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:41:51 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-debdb34e-6545-4a20-8f5c-3b7de5c3b095 tempest-ProjectMemberTests-47051868 None] Volume volume-1d2df796-83ad-451b-9ed2-8c1f49f10f70 (1d2df796-83ad-451b-9ed2-8c1f49f10f70): created successfully
Jul 30 20:41:51 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-debdb34e-6545-4a20-8f5c-3b7de5c3b095 tempest-ProjectMemberTests-47051868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (674b09c5-01e2-4756-a3bb-78e99cf74955) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:41:51 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-debdb34e-6545-4a20-8f5c-3b7de5c3b095 tempest-ProjectMemberTests-47051868 None] Flow 'volume_create_manager' (fbdedd7e-afd3-4270-ada5-d61adc81b533) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:41:51 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-debdb34e-6545-4a20-8f5c-3b7de5c3b095 tempest-ProjectMemberTests-47051868 None] Created volume successfully.
Jul 30 20:41:52 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-2056fe26-9cc2-4dec-9890-bfb8b9547f25 tempest-ProjectReaderTests-1988360028 None] Acquiring lock "cinder-29167d93-33ef-4045-a39e-916a4ad7e97d-delete_snapshot" by "delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:41:52 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-2056fe26-9cc2-4dec-9890-bfb8b9547f25 tempest-ProjectReaderTests-1988360028 None] Lock "cinder-29167d93-33ef-4045-a39e-916a4ad7e97d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:41:52 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-2056fe26-9cc2-4dec-9890-bfb8b9547f25 tempest-ProjectReaderTests-1988360028 None] Acquiring lock "cinder-quobyte-4c502654-bc5a-4228-aa3c-ea8d7d1f1766" by "delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:41:52 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-2056fe26-9cc2-4dec-9890-bfb8b9547f25 tempest-ProjectReaderTests-1988360028 None] Lock "cinder-quobyte-4c502654-bc5a-4228-aa3c-ea8d7d1f1766" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:41:52 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-2056fe26-9cc2-4dec-9890-bfb8b9547f25 tempest-ProjectReaderTests-1988360028 None] Acquiring lock "cinder-quobyte-29167d93-33ef-4045-a39e-916a4ad7e97d" by "_delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:41:52 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-2056fe26-9cc2-4dec-9890-bfb8b9547f25 tempest-ProjectReaderTests-1988360028 None] Lock "cinder-quobyte-29167d93-33ef-4045-a39e-916a4ad7e97d" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:41:52 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-2056fe26-9cc2-4dec-9890-bfb8b9547f25 tempest-ProjectReaderTests-1988360028 None] Deleting offline snapshot 29167d93-33ef-4045-a39e-916a4ad7e97d of volume 4c502654-bc5a-4228-aa3c-ea8d7d1f1766 {{(pid=88719) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 30 20:41:52 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-2056fe26-9cc2-4dec-9890-bfb8b9547f25 tempest-ProjectReaderTests-1988360028 None] snapshot_file for this snap is: volume-4c502654-bc5a-4228-aa3c-ea8d7d1f1766.29167d93-33ef-4045-a39e-916a4ad7e97d {{(pid=88719) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 30 20:41:52 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[710ca3f1-3a09-4c77-ad5b-aa14ad3b0ae5]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:41:52 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2056fe26-9cc2-4dec-9890-bfb8b9547f25 tempest-ProjectReaderTests-1988360028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-4c502654-bc5a-4228-aa3c-ea8d7d1f1766.29167d93-33ef-4045-a39e-916a4ad7e97d {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:52 devstack sudo[108467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-4c502654-bc5a-4228-aa3c-ea8d7d1f1766.29167d93-33ef-4045-a39e-916a4ad7e97d
Jul 30 20:41:52 devstack sudo[108467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:52 devstack sudo[108467]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:52 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2056fe26-9cc2-4dec-9890-bfb8b9547f25 tempest-ProjectReaderTests-1988360028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-4c502654-bc5a-4228-aa3c-ea8d7d1f1766.29167d93-33ef-4045-a39e-916a4ad7e97d" returned: 0 in 0.370s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:52 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-2056fe26-9cc2-4dec-9890-bfb8b9547f25 tempest-ProjectReaderTests-1988360028 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4c502654-bc5a-4228-aa3c-ea8d7d1f1766(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88719) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 30 20:41:52 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[24b15c5a-0a4b-4e85-9270-f2ae6eb3390b]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:41:52 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2056fe26-9cc2-4dec-9890-bfb8b9547f25 tempest-ProjectReaderTests-1988360028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-4c502654-bc5a-4228-aa3c-ea8d7d1f1766 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:52 devstack sudo[108472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-4c502654-bc5a-4228-aa3c-ea8d7d1f1766
Jul 30 20:41:52 devstack sudo[108472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:52 devstack sudo[108472]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:52 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2056fe26-9cc2-4dec-9890-bfb8b9547f25 tempest-ProjectReaderTests-1988360028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-4c502654-bc5a-4228-aa3c-ea8d7d1f1766" returned: 0 in 0.381s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:52 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2056fe26-9cc2-4dec-9890-bfb8b9547f25 tempest-ProjectReaderTests-1988360028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-4c502654-bc5a-4228-aa3c-ea8d7d1f1766.29167d93-33ef-4045-a39e-916a4ad7e97d {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:52 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-8ee9a5fa-64e9-430c-9332-14c92111cdb8 tempest-ProjectMemberTests-47051868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:41:52 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-8ee9a5fa-64e9-430c-9332-14c92111cdb8 tempest-ProjectMemberTests-47051868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:41:52 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-8ee9a5fa-64e9-430c-9332-14c92111cdb8 tempest-ProjectMemberTests-47051868 None] Creating offline snapshot 0145ba93-e7c2-4d1f-95f1-3dd5968bdfe4 of volume 1d2df796-83ad-451b-9ed2-8c1f49f10f70 {{(pid=88719) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 30 20:41:52 devstack sudo[108477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-4c502654-bc5a-4228-aa3c-ea8d7d1f1766.29167d93-33ef-4045-a39e-916a4ad7e97d
Jul 30 20:41:52 devstack sudo[108477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:52 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b2b62f2-3323-48ef-bcf4-b70c68e1836d]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:41:52 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8ee9a5fa-64e9-430c-9332-14c92111cdb8 tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1d2df796-83ad-451b-9ed2-8c1f49f10f70 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:53 devstack sudo[108479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1d2df796-83ad-451b-9ed2-8c1f49f10f70
Jul 30 20:41:53 devstack sudo[108479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:53 devstack sudo[108477]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:53 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2056fe26-9cc2-4dec-9890-bfb8b9547f25 tempest-ProjectReaderTests-1988360028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-4c502654-bc5a-4228-aa3c-ea8d7d1f1766.29167d93-33ef-4045-a39e-916a4ad7e97d" returned: 0 in 0.333s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:53 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2056fe26-9cc2-4dec-9890-bfb8b9547f25 tempest-ProjectReaderTests-1988360028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-4c502654-bc5a-4228-aa3c-ea8d7d1f1766.29167d93-33ef-4045-a39e-916a4ad7e97d {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:53 devstack sudo[108484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-4c502654-bc5a-4228-aa3c-ea8d7d1f1766.29167d93-33ef-4045-a39e-916a4ad7e97d
Jul 30 20:41:53 devstack sudo[108484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:53 devstack sudo[108479]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:53 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8ee9a5fa-64e9-430c-9332-14c92111cdb8 tempest-ProjectMemberTests-47051868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1d2df796-83ad-451b-9ed2-8c1f49f10f70" returned: 0 in 0.380s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:53 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8ee9a5fa-64e9-430c-9332-14c92111cdb8 tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1d2df796-83ad-451b-9ed2-8c1f49f10f70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1d2df796-83ad-451b-9ed2-8c1f49f10f70.0145ba93-e7c2-4d1f-95f1-3dd5968bdfe4 1G {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:53 devstack sudo[108489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1d2df796-83ad-451b-9ed2-8c1f49f10f70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1d2df796-83ad-451b-9ed2-8c1f49f10f70.0145ba93-e7c2-4d1f-95f1-3dd5968bdfe4 1G
Jul 30 20:41:53 devstack sudo[108489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:53 devstack sudo[108484]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:53 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-2056fe26-9cc2-4dec-9890-bfb8b9547f25 tempest-ProjectReaderTests-1988360028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-4c502654-bc5a-4228-aa3c-ea8d7d1f1766.29167d93-33ef-4045-a39e-916a4ad7e97d" returned: 0 in 0.265s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:53 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-2056fe26-9cc2-4dec-9890-bfb8b9547f25 tempest-ProjectReaderTests-1988360028 None] Lock "cinder-quobyte-29167d93-33ef-4045-a39e-916a4ad7e97d" released by "_delete_snapshot" :: held 1.441s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:41:53 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-2056fe26-9cc2-4dec-9890-bfb8b9547f25 tempest-ProjectReaderTests-1988360028 None] Lock "cinder-quobyte-4c502654-bc5a-4228-aa3c-ea8d7d1f1766" released by "delete_snapshot" :: held 1.462s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:41:53 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-2056fe26-9cc2-4dec-9890-bfb8b9547f25 tempest-ProjectReaderTests-1988360028 None] Created reservations ['59d18257-4765-47c8-87e3-5aa3a277d0f2', '4beeacc3-6ce8-42c4-952d-65913f33d187', 'fe48cac8-8497-4b79-91e0-55269d27c5d2', '5bad2a84-468d-480c-b9ed-adf77c37aca9'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:41:53 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-2056fe26-9cc2-4dec-9890-bfb8b9547f25 tempest-ProjectReaderTests-1988360028 None] Delete snapshot completed successfully.
Jul 30 20:41:53 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-2056fe26-9cc2-4dec-9890-bfb8b9547f25 tempest-ProjectReaderTests-1988360028 None] Lock "cinder-29167d93-33ef-4045-a39e-916a4ad7e97d-delete_snapshot" released by "delete_snapshot" :: held 1.600s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:41:53 devstack sudo[108489]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:53 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8ee9a5fa-64e9-430c-9332-14c92111cdb8 tempest-ProjectMemberTests-47051868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1d2df796-83ad-451b-9ed2-8c1f49f10f70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1d2df796-83ad-451b-9ed2-8c1f49f10f70.0145ba93-e7c2-4d1f-95f1-3dd5968bdfe4 1G" returned: 0 in 0.405s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:53 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8ee9a5fa-64e9-430c-9332-14c92111cdb8 tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d2df796-83ad-451b-9ed2-8c1f49f10f70 -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1d2df796-83ad-451b-9ed2-8c1f49f10f70.0145ba93-e7c2-4d1f-95f1-3dd5968bdfe4 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:53 devstack sudo[108495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d2df796-83ad-451b-9ed2-8c1f49f10f70 -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1d2df796-83ad-451b-9ed2-8c1f49f10f70.0145ba93-e7c2-4d1f-95f1-3dd5968bdfe4
Jul 30 20:41:53 devstack sudo[108495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:54 devstack sudo[108495]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:54 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8ee9a5fa-64e9-430c-9332-14c92111cdb8 tempest-ProjectMemberTests-47051868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d2df796-83ad-451b-9ed2-8c1f49f10f70 -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1d2df796-83ad-451b-9ed2-8c1f49f10f70.0145ba93-e7c2-4d1f-95f1-3dd5968bdfe4" returned: 0 in 0.287s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:54 devstack cinder-volume[88719]: WARNING cinder.volume.drivers.remotefs [None req-8ee9a5fa-64e9-430c-9332-14c92111cdb8 tempest-ProjectMemberTests-47051868 None] /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1d2df796-83ad-451b-9ed2-8c1f49f10f70.0145ba93-e7c2-4d1f-95f1-3dd5968bdfe4 is being set with open permissions: ugo+rw
Jul 30 20:41:54 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8ee9a5fa-64e9-430c-9332-14c92111cdb8 tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1d2df796-83ad-451b-9ed2-8c1f49f10f70.0145ba93-e7c2-4d1f-95f1-3dd5968bdfe4 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:54 devstack sudo[108500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1d2df796-83ad-451b-9ed2-8c1f49f10f70.0145ba93-e7c2-4d1f-95f1-3dd5968bdfe4
Jul 30 20:41:54 devstack sudo[108500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:54 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-88db56b3-cd0d-4238-9a26-714ed48cb47f tempest-ProjectReaderTests-1988360028 None] Acquiring lock "cinder-4c502654-bc5a-4228-aa3c-ea8d7d1f1766-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:41:54 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-88db56b3-cd0d-4238-9a26-714ed48cb47f tempest-ProjectReaderTests-1988360028 None] Lock "cinder-4c502654-bc5a-4228-aa3c-ea8d7d1f1766-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:41:54 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-88db56b3-cd0d-4238-9a26-714ed48cb47f tempest-ProjectReaderTests-1988360028 None] Acquiring lock "cinder-quobyte-4c502654-bc5a-4228-aa3c-ea8d7d1f1766" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:41:54 devstack sudo[108500]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:54 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-88db56b3-cd0d-4238-9a26-714ed48cb47f tempest-ProjectReaderTests-1988360028 None] Lock "cinder-quobyte-4c502654-bc5a-4228-aa3c-ea8d7d1f1766" acquired by "delete_volume" :: waited 0.014s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:41:54 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8ee9a5fa-64e9-430c-9332-14c92111cdb8 tempest-ProjectMemberTests-47051868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1d2df796-83ad-451b-9ed2-8c1f49f10f70.0145ba93-e7c2-4d1f-95f1-3dd5968bdfe4" returned: 0 in 0.285s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:54 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8fd7fa0-9663-40c7-ad46-b2ec22745ed4]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:41:54 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-88db56b3-cd0d-4238-9a26-714ed48cb47f tempest-ProjectReaderTests-1988360028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-4c502654-bc5a-4228-aa3c-ea8d7d1f1766 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:54 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8ee9a5fa-64e9-430c-9332-14c92111cdb8 tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1d2df796-83ad-451b-9ed2-8c1f49f10f70.info {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:54 devstack sudo[108504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1d2df796-83ad-451b-9ed2-8c1f49f10f70.info
Jul 30 20:41:54 devstack sudo[108504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:54 devstack sudo[108503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-4c502654-bc5a-4228-aa3c-ea8d7d1f1766
Jul 30 20:41:54 devstack sudo[108503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:54 devstack sudo[108504]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:54 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8ee9a5fa-64e9-430c-9332-14c92111cdb8 tempest-ProjectMemberTests-47051868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1d2df796-83ad-451b-9ed2-8c1f49f10f70.info" returned: 0 in 0.262s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:54 devstack cinder-volume[88719]: WARNING cinder.volume.drivers.remotefs [None req-8ee9a5fa-64e9-430c-9332-14c92111cdb8 tempest-ProjectMemberTests-47051868 None] /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1d2df796-83ad-451b-9ed2-8c1f49f10f70.info is being set with open permissions: ugo+rw
Jul 30 20:41:54 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8ee9a5fa-64e9-430c-9332-14c92111cdb8 tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1d2df796-83ad-451b-9ed2-8c1f49f10f70.info {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:54 devstack sudo[108510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1d2df796-83ad-451b-9ed2-8c1f49f10f70.info
Jul 30 20:41:54 devstack sudo[108510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:54 devstack sudo[108503]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:54 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-88db56b3-cd0d-4238-9a26-714ed48cb47f tempest-ProjectReaderTests-1988360028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-4c502654-bc5a-4228-aa3c-ea8d7d1f1766" returned: 0 in 0.367s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:54 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-88db56b3-cd0d-4238-9a26-714ed48cb47f tempest-ProjectReaderTests-1988360028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-4c502654-bc5a-4228-aa3c-ea8d7d1f1766 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:54 devstack sudo[108513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-4c502654-bc5a-4228-aa3c-ea8d7d1f1766
Jul 30 20:41:54 devstack sudo[108513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:54 devstack sudo[108510]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:54 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8ee9a5fa-64e9-430c-9332-14c92111cdb8 tempest-ProjectMemberTests-47051868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1d2df796-83ad-451b-9ed2-8c1f49f10f70.info" returned: 0 in 0.268s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:54 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-8ee9a5fa-64e9-430c-9332-14c92111cdb8 tempest-ProjectMemberTests-47051868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.992s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:41:54 devstack sudo[108513]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:54 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-88db56b3-cd0d-4238-9a26-714ed48cb47f tempest-ProjectReaderTests-1988360028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-4c502654-bc5a-4228-aa3c-ea8d7d1f1766" returned: 0 in 0.288s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:54 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-8ee9a5fa-64e9-430c-9332-14c92111cdb8 tempest-ProjectMemberTests-47051868 None] Create snapshot completed successfully
Jul 30 20:41:54 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-88db56b3-cd0d-4238-9a26-714ed48cb47f tempest-ProjectReaderTests-1988360028 None] Lock "cinder-quobyte-4c502654-bc5a-4228-aa3c-ea8d7d1f1766" released by "delete_volume" :: held 0.719s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:41:55 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-88db56b3-cd0d-4238-9a26-714ed48cb47f tempest-ProjectReaderTests-1988360028 None] Created reservations ['d3de15cb-537b-4f25-b776-a8ee9a461bdc', '5194e5ad-2fa6-4b90-a69d-dbfc6dee35c6', '335b1fa2-74e3-4ecd-8805-d7691e414f33', '269e406f-9e86-4a50-9ab0-6a68d2acb607'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:41:55 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-88db56b3-cd0d-4238-9a26-714ed48cb47f tempest-ProjectReaderTests-1988360028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:41:55 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-88db56b3-cd0d-4238-9a26-714ed48cb47f tempest-ProjectReaderTests-1988360028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:41:55 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-88db56b3-cd0d-4238-9a26-714ed48cb47f tempest-ProjectReaderTests-1988360028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:41:55 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-88db56b3-cd0d-4238-9a26-714ed48cb47f tempest-ProjectReaderTests-1988360028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:41:55 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-88db56b3-cd0d-4238-9a26-714ed48cb47f tempest-ProjectReaderTests-1988360028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:41:55 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-88db56b3-cd0d-4238-9a26-714ed48cb47f tempest-ProjectReaderTests-1988360028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:55 devstack sudo[108517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:41:55 devstack sudo[108517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:55 devstack sudo[108517]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:55 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-88db56b3-cd0d-4238-9a26-714ed48cb47f tempest-ProjectReaderTests-1988360028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.253s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:55 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-88db56b3-cd0d-4238-9a26-714ed48cb47f tempest-ProjectReaderTests-1988360028 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:41:55 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-88db56b3-cd0d-4238-9a26-714ed48cb47f tempest-ProjectReaderTests-1988360028 None] Deleted volume successfully.
Jul 30 20:41:55 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-88db56b3-cd0d-4238-9a26-714ed48cb47f tempest-ProjectReaderTests-1988360028 None] Lock "cinder-4c502654-bc5a-4228-aa3c-ea8d7d1f1766-delete_volume" released by "delete_volume" :: held 1.164s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:41:55 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fc0cfa8-a74c-4753-9995-7df32c94681f tempest-ProjectReaderTests-1988360028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:41:55 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-3fc0cfa8-a74c-4753-9995-7df32c94681f tempest-ProjectReaderTests-1988360028 None] Flow 'volume_create_manager' (6d296910-32ab-49ff-b89a-b273da60c51b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:41:55 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-3fc0cfa8-a74c-4753-9995-7df32c94681f tempest-ProjectReaderTests-1988360028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41510d22-7d4c-456d-bcdc-02d204066265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:41:55 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-3fc0cfa8-a74c-4753-9995-7df32c94681f tempest-ProjectReaderTests-1988360028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41510d22-7d4c-456d-bcdc-02d204066265) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:41:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1121183446',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=612d2291-b312-4251-ad34-d91ff1e86d4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7b0c78c72fa4b7da70731a275a24f3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:41:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:41:56Z,use_quota=True,user_id='66f5ff347f4541e383a978346a7ec5a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:41:55 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-3fc0cfa8-a74c-4753-9995-7df32c94681f tempest-ProjectReaderTests-1988360028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de87dff3-8096-4d1c-8dc9-ee90e66f887a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:41:55 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-3fc0cfa8-a74c-4753-9995-7df32c94681f tempest-ProjectReaderTests-1988360028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de87dff3-8096-4d1c-8dc9-ee90e66f887a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:41:55 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-3fc0cfa8-a74c-4753-9995-7df32c94681f tempest-ProjectReaderTests-1988360028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbd66798-3295-47f0-9f11-809c2ddb7c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:41:55 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-3fc0cfa8-a74c-4753-9995-7df32c94681f tempest-ProjectReaderTests-1988360028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbd66798-3295-47f0-9f11-809c2ddb7c89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '612d2291-b312-4251-ad34-d91ff1e86d4c', 'volume_name': 'volume-612d2291-b312-4251-ad34-d91ff1e86d4c', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:41:55 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-3fc0cfa8-a74c-4753-9995-7df32c94681f tempest-ProjectReaderTests-1988360028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b4b336b-8c6d-4cc2-988e-787a68d74f89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:41:55 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-3fc0cfa8-a74c-4753-9995-7df32c94681f tempest-ProjectReaderTests-1988360028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b4b336b-8c6d-4cc2-988e-787a68d74f89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:41:55 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-3fc0cfa8-a74c-4753-9995-7df32c94681f tempest-ProjectReaderTests-1988360028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f4115ae-15d9-4828-9830-cdadea5dc498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:41:55 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-3fc0cfa8-a74c-4753-9995-7df32c94681f tempest-ProjectReaderTests-1988360028 None] Volume 612d2291-b312-4251-ad34-d91ff1e86d4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-612d2291-b312-4251-ad34-d91ff1e86d4c', 'volume_size': 1}
Jul 30 20:41:55 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-3fc0cfa8-a74c-4753-9995-7df32c94681f tempest-ProjectReaderTests-1988360028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:41:55 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-3fc0cfa8-a74c-4753-9995-7df32c94681f tempest-ProjectReaderTests-1988360028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:41:55 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-3fc0cfa8-a74c-4753-9995-7df32c94681f tempest-ProjectReaderTests-1988360028 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:41:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1121183446',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=612d2291-b312-4251-ad34-d91ff1e86d4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7b0c78c72fa4b7da70731a275a24f3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:41:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:41:56Z,use_quota=True,user_id='66f5ff347f4541e383a978346a7ec5a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:41:55 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-3fc0cfa8-a74c-4753-9995-7df32c94681f tempest-ProjectReaderTests-1988360028 None] Creating volume 612d2291-b312-4251-ad34-d91ff1e86d4c {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:41:55 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-3fc0cfa8-a74c-4753-9995-7df32c94681f tempest-ProjectReaderTests-1988360028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:41:55 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-3fc0cfa8-a74c-4753-9995-7df32c94681f tempest-ProjectReaderTests-1988360028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:41:55 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-3fc0cfa8-a74c-4753-9995-7df32c94681f tempest-ProjectReaderTests-1988360028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:41:55 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-3fc0cfa8-a74c-4753-9995-7df32c94681f tempest-ProjectReaderTests-1988360028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:41:55 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-3fc0cfa8-a74c-4753-9995-7df32c94681f tempest-ProjectReaderTests-1988360028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:41:55 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-3fc0cfa8-a74c-4753-9995-7df32c94681f tempest-ProjectReaderTests-1988360028 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:41:55 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-3fc0cfa8-a74c-4753-9995-7df32c94681f tempest-ProjectReaderTests-1988360028 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:41:55 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3fc0cfa8-a74c-4753-9995-7df32c94681f tempest-ProjectReaderTests-1988360028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-612d2291-b312-4251-ad34-d91ff1e86d4c 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:55 devstack sudo[108521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-612d2291-b312-4251-ad34-d91ff1e86d4c 1073741824
Jul 30 20:41:55 devstack sudo[108521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:56 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-978f148c-2103-482e-9b44-94bd161c064b tempest-ProjectMemberTests-47051868 None] Acquiring lock "cinder-0145ba93-e7c2-4d1f-95f1-3dd5968bdfe4-delete_snapshot" by "delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:41:56 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-978f148c-2103-482e-9b44-94bd161c064b tempest-ProjectMemberTests-47051868 None] Lock "cinder-0145ba93-e7c2-4d1f-95f1-3dd5968bdfe4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:41:56 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-978f148c-2103-482e-9b44-94bd161c064b tempest-ProjectMemberTests-47051868 None] Acquiring lock "cinder-quobyte-1d2df796-83ad-451b-9ed2-8c1f49f10f70" by "delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:41:56 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-978f148c-2103-482e-9b44-94bd161c064b tempest-ProjectMemberTests-47051868 None] Lock "cinder-quobyte-1d2df796-83ad-451b-9ed2-8c1f49f10f70" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:41:56 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-978f148c-2103-482e-9b44-94bd161c064b tempest-ProjectMemberTests-47051868 None] Acquiring lock "cinder-quobyte-0145ba93-e7c2-4d1f-95f1-3dd5968bdfe4" by "_delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:41:56 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-978f148c-2103-482e-9b44-94bd161c064b tempest-ProjectMemberTests-47051868 None] Lock "cinder-quobyte-0145ba93-e7c2-4d1f-95f1-3dd5968bdfe4" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:41:56 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-978f148c-2103-482e-9b44-94bd161c064b tempest-ProjectMemberTests-47051868 None] Deleting offline snapshot 0145ba93-e7c2-4d1f-95f1-3dd5968bdfe4 of volume 1d2df796-83ad-451b-9ed2-8c1f49f10f70 {{(pid=88719) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 30 20:41:56 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-978f148c-2103-482e-9b44-94bd161c064b tempest-ProjectMemberTests-47051868 None] snapshot_file for this snap is: volume-1d2df796-83ad-451b-9ed2-8c1f49f10f70.0145ba93-e7c2-4d1f-95f1-3dd5968bdfe4 {{(pid=88719) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 30 20:41:56 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[7905b837-2a67-4d1c-8fe1-810950274704]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:41:56 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-978f148c-2103-482e-9b44-94bd161c064b tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1d2df796-83ad-451b-9ed2-8c1f49f10f70.0145ba93-e7c2-4d1f-95f1-3dd5968bdfe4 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:56 devstack sudo[108526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1d2df796-83ad-451b-9ed2-8c1f49f10f70.0145ba93-e7c2-4d1f-95f1-3dd5968bdfe4
Jul 30 20:41:56 devstack sudo[108526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:56 devstack sudo[108521]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:56 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3fc0cfa8-a74c-4753-9995-7df32c94681f tempest-ProjectReaderTests-1988360028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-612d2291-b312-4251-ad34-d91ff1e86d4c 1073741824" returned: 0 in 0.456s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:56 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3fc0cfa8-a74c-4753-9995-7df32c94681f tempest-ProjectReaderTests-1988360028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-612d2291-b312-4251-ad34-d91ff1e86d4c {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:56 devstack sudo[108528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-612d2291-b312-4251-ad34-d91ff1e86d4c
Jul 30 20:41:56 devstack sudo[108528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:56 devstack sudo[108526]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:56 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-978f148c-2103-482e-9b44-94bd161c064b tempest-ProjectMemberTests-47051868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1d2df796-83ad-451b-9ed2-8c1f49f10f70.0145ba93-e7c2-4d1f-95f1-3dd5968bdfe4" returned: 0 in 0.378s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:56 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-978f148c-2103-482e-9b44-94bd161c064b tempest-ProjectMemberTests-47051868 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d2df796-83ad-451b-9ed2-8c1f49f10f70(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88719) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 30 20:41:56 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e41069d-8fb3-4f2d-abee-75a8406b1354]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:41:56 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-978f148c-2103-482e-9b44-94bd161c064b tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1d2df796-83ad-451b-9ed2-8c1f49f10f70 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:56 devstack sudo[108528]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:56 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3fc0cfa8-a74c-4753-9995-7df32c94681f tempest-ProjectReaderTests-1988360028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-612d2291-b312-4251-ad34-d91ff1e86d4c" returned: 0 in 0.262s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:56 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-3fc0cfa8-a74c-4753-9995-7df32c94681f tempest-ProjectReaderTests-1988360028 None] <== create_volume: return (757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:41:56 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-3fc0cfa8-a74c-4753-9995-7df32c94681f tempest-ProjectReaderTests-1988360028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.759s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:41:56 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-3fc0cfa8-a74c-4753-9995-7df32c94681f tempest-ProjectReaderTests-1988360028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f4115ae-15d9-4828-9830-cdadea5dc498) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-612d2291-b312-4251-ad34-d91ff1e86d4c', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:41:56 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-3fc0cfa8-a74c-4753-9995-7df32c94681f tempest-ProjectReaderTests-1988360028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09cf9520-5de3-4e82-a3bb-601eefd59ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:41:56 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-3fc0cfa8-a74c-4753-9995-7df32c94681f tempest-ProjectReaderTests-1988360028 None] Volume volume-612d2291-b312-4251-ad34-d91ff1e86d4c (612d2291-b312-4251-ad34-d91ff1e86d4c): created successfully
Jul 30 20:41:56 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-3fc0cfa8-a74c-4753-9995-7df32c94681f tempest-ProjectReaderTests-1988360028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09cf9520-5de3-4e82-a3bb-601eefd59ac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:41:56 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-3fc0cfa8-a74c-4753-9995-7df32c94681f tempest-ProjectReaderTests-1988360028 None] Flow 'volume_create_manager' (6d296910-32ab-49ff-b89a-b273da60c51b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:41:56 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-3fc0cfa8-a74c-4753-9995-7df32c94681f tempest-ProjectReaderTests-1988360028 None] Created volume successfully.
Jul 30 20:41:56 devstack sudo[108534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1d2df796-83ad-451b-9ed2-8c1f49f10f70
Jul 30 20:41:56 devstack sudo[108534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:56 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-55594814-789d-4335-80c1-335141856e22 tempest-ProjectReaderTests-1988360028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:41:56 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-55594814-789d-4335-80c1-335141856e22 tempest-ProjectReaderTests-1988360028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:41:56 devstack sudo[108534]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:56 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-55594814-789d-4335-80c1-335141856e22 tempest-ProjectReaderTests-1988360028 None] Creating offline snapshot 8cd6dba9-4d38-43c1-9d87-48c581f5c76b of volume 612d2291-b312-4251-ad34-d91ff1e86d4c {{(pid=88719) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 30 20:41:56 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-978f148c-2103-482e-9b44-94bd161c064b tempest-ProjectMemberTests-47051868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1d2df796-83ad-451b-9ed2-8c1f49f10f70" returned: 0 in 0.403s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:56 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-978f148c-2103-482e-9b44-94bd161c064b tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1d2df796-83ad-451b-9ed2-8c1f49f10f70.0145ba93-e7c2-4d1f-95f1-3dd5968bdfe4 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:56 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[5358c375-e7d0-4419-b896-d570d979f770]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:41:56 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-55594814-789d-4335-80c1-335141856e22 tempest-ProjectReaderTests-1988360028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-612d2291-b312-4251-ad34-d91ff1e86d4c {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:56 devstack sudo[108539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1d2df796-83ad-451b-9ed2-8c1f49f10f70.0145ba93-e7c2-4d1f-95f1-3dd5968bdfe4
Jul 30 20:41:56 devstack sudo[108539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:57 devstack sudo[108540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-612d2291-b312-4251-ad34-d91ff1e86d4c
Jul 30 20:41:57 devstack sudo[108540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:57 devstack sudo[108539]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:57 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-978f148c-2103-482e-9b44-94bd161c064b tempest-ProjectMemberTests-47051868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1d2df796-83ad-451b-9ed2-8c1f49f10f70.0145ba93-e7c2-4d1f-95f1-3dd5968bdfe4" returned: 0 in 0.348s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:57 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-978f148c-2103-482e-9b44-94bd161c064b tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1d2df796-83ad-451b-9ed2-8c1f49f10f70.0145ba93-e7c2-4d1f-95f1-3dd5968bdfe4 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:57 devstack sudo[108549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1d2df796-83ad-451b-9ed2-8c1f49f10f70.0145ba93-e7c2-4d1f-95f1-3dd5968bdfe4
Jul 30 20:41:57 devstack sudo[108549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:57 devstack sudo[108540]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:57 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-55594814-789d-4335-80c1-335141856e22 tempest-ProjectReaderTests-1988360028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-612d2291-b312-4251-ad34-d91ff1e86d4c" returned: 0 in 0.376s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:57 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-55594814-789d-4335-80c1-335141856e22 tempest-ProjectReaderTests-1988360028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-612d2291-b312-4251-ad34-d91ff1e86d4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-612d2291-b312-4251-ad34-d91ff1e86d4c.8cd6dba9-4d38-43c1-9d87-48c581f5c76b 1G {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:57 devstack sudo[108551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-612d2291-b312-4251-ad34-d91ff1e86d4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-612d2291-b312-4251-ad34-d91ff1e86d4c.8cd6dba9-4d38-43c1-9d87-48c581f5c76b 1G
Jul 30 20:41:57 devstack sudo[108551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:57 devstack sudo[108549]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:57 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-978f148c-2103-482e-9b44-94bd161c064b tempest-ProjectMemberTests-47051868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1d2df796-83ad-451b-9ed2-8c1f49f10f70.0145ba93-e7c2-4d1f-95f1-3dd5968bdfe4" returned: 0 in 0.265s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:57 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-978f148c-2103-482e-9b44-94bd161c064b tempest-ProjectMemberTests-47051868 None] Lock "cinder-quobyte-0145ba93-e7c2-4d1f-95f1-3dd5968bdfe4" released by "_delete_snapshot" :: held 1.492s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:41:57 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-978f148c-2103-482e-9b44-94bd161c064b tempest-ProjectMemberTests-47051868 None] Lock "cinder-quobyte-1d2df796-83ad-451b-9ed2-8c1f49f10f70" released by "delete_snapshot" :: held 1.518s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:41:57 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-978f148c-2103-482e-9b44-94bd161c064b tempest-ProjectMemberTests-47051868 None] Created reservations ['fc7516e1-85e9-4ff3-b60a-3775a3707056', '45acf1a4-76b9-4ba6-8b0f-cd9c6965b5b5', '008bf873-2531-4314-b8a1-21181f2ac6f8', '2aad622e-383b-401c-af6a-2fd27b0e694d'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:41:57 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-978f148c-2103-482e-9b44-94bd161c064b tempest-ProjectMemberTests-47051868 None] Delete snapshot completed successfully.
Jul 30 20:41:57 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-978f148c-2103-482e-9b44-94bd161c064b tempest-ProjectMemberTests-47051868 None] Lock "cinder-0145ba93-e7c2-4d1f-95f1-3dd5968bdfe4-delete_snapshot" released by "delete_snapshot" :: held 1.656s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:41:57 devstack sudo[108551]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:57 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-55594814-789d-4335-80c1-335141856e22 tempest-ProjectReaderTests-1988360028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-612d2291-b312-4251-ad34-d91ff1e86d4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-612d2291-b312-4251-ad34-d91ff1e86d4c.8cd6dba9-4d38-43c1-9d87-48c581f5c76b 1G" returned: 0 in 0.413s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:57 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-55594814-789d-4335-80c1-335141856e22 tempest-ProjectReaderTests-1988360028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-612d2291-b312-4251-ad34-d91ff1e86d4c -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-612d2291-b312-4251-ad34-d91ff1e86d4c.8cd6dba9-4d38-43c1-9d87-48c581f5c76b {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:57 devstack sudo[108558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-612d2291-b312-4251-ad34-d91ff1e86d4c -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-612d2291-b312-4251-ad34-d91ff1e86d4c.8cd6dba9-4d38-43c1-9d87-48c581f5c76b
Jul 30 20:41:57 devstack sudo[108558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:58 devstack sudo[108558]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-55594814-789d-4335-80c1-335141856e22 tempest-ProjectReaderTests-1988360028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-612d2291-b312-4251-ad34-d91ff1e86d4c -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-612d2291-b312-4251-ad34-d91ff1e86d4c.8cd6dba9-4d38-43c1-9d87-48c581f5c76b" returned: 0 in 0.280s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:58 devstack cinder-volume[88719]: WARNING cinder.volume.drivers.remotefs [None req-55594814-789d-4335-80c1-335141856e22 tempest-ProjectReaderTests-1988360028 None] /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-612d2291-b312-4251-ad34-d91ff1e86d4c.8cd6dba9-4d38-43c1-9d87-48c581f5c76b is being set with open permissions: ugo+rw
Jul 30 20:41:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-55594814-789d-4335-80c1-335141856e22 tempest-ProjectReaderTests-1988360028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-612d2291-b312-4251-ad34-d91ff1e86d4c.8cd6dba9-4d38-43c1-9d87-48c581f5c76b {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:58 devstack sudo[108563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-612d2291-b312-4251-ad34-d91ff1e86d4c.8cd6dba9-4d38-43c1-9d87-48c581f5c76b
Jul 30 20:41:58 devstack sudo[108563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:58 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-1daf2f61-5575-4deb-901d-53fec1b99134 tempest-ProjectMemberTests-47051868 None] Acquiring lock "cinder-1d2df796-83ad-451b-9ed2-8c1f49f10f70-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:41:58 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-1daf2f61-5575-4deb-901d-53fec1b99134 tempest-ProjectMemberTests-47051868 None] Lock "cinder-1d2df796-83ad-451b-9ed2-8c1f49f10f70-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:41:58 devstack sudo[108563]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-55594814-789d-4335-80c1-335141856e22 tempest-ProjectReaderTests-1988360028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-612d2291-b312-4251-ad34-d91ff1e86d4c.8cd6dba9-4d38-43c1-9d87-48c581f5c76b" returned: 0 in 0.265s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:58 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-1daf2f61-5575-4deb-901d-53fec1b99134 tempest-ProjectMemberTests-47051868 None] Acquiring lock "cinder-quobyte-1d2df796-83ad-451b-9ed2-8c1f49f10f70" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:41:58 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-1daf2f61-5575-4deb-901d-53fec1b99134 tempest-ProjectMemberTests-47051868 None] Lock "cinder-quobyte-1d2df796-83ad-451b-9ed2-8c1f49f10f70" acquired by "delete_volume" :: waited 0.019s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:41:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-55594814-789d-4335-80c1-335141856e22 tempest-ProjectReaderTests-1988360028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-612d2291-b312-4251-ad34-d91ff1e86d4c.info {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:58 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc3789c7-c2be-48d0-894a-e21a8b4a5b60]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:41:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-1daf2f61-5575-4deb-901d-53fec1b99134 tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1d2df796-83ad-451b-9ed2-8c1f49f10f70 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:58 devstack sudo[108566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-612d2291-b312-4251-ad34-d91ff1e86d4c.info
Jul 30 20:41:58 devstack sudo[108566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:58 devstack sudo[108567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1d2df796-83ad-451b-9ed2-8c1f49f10f70
Jul 30 20:41:58 devstack sudo[108567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:58 devstack sudo[108566]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-55594814-789d-4335-80c1-335141856e22 tempest-ProjectReaderTests-1988360028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-612d2291-b312-4251-ad34-d91ff1e86d4c.info" returned: 0 in 0.250s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:58 devstack cinder-volume[88719]: WARNING cinder.volume.drivers.remotefs [None req-55594814-789d-4335-80c1-335141856e22 tempest-ProjectReaderTests-1988360028 None] /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-612d2291-b312-4251-ad34-d91ff1e86d4c.info is being set with open permissions: ugo+rw
Jul 30 20:41:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-55594814-789d-4335-80c1-335141856e22 tempest-ProjectReaderTests-1988360028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-612d2291-b312-4251-ad34-d91ff1e86d4c.info {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:58 devstack sudo[108571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-612d2291-b312-4251-ad34-d91ff1e86d4c.info
Jul 30 20:41:58 devstack sudo[108571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:58 devstack sudo[108567]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-1daf2f61-5575-4deb-901d-53fec1b99134 tempest-ProjectMemberTests-47051868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1d2df796-83ad-451b-9ed2-8c1f49f10f70" returned: 0 in 0.377s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-1daf2f61-5575-4deb-901d-53fec1b99134 tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1d2df796-83ad-451b-9ed2-8c1f49f10f70 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:58 devstack sudo[108576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1d2df796-83ad-451b-9ed2-8c1f49f10f70
Jul 30 20:41:58 devstack sudo[108576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:58 devstack sudo[108571]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-55594814-789d-4335-80c1-335141856e22 tempest-ProjectReaderTests-1988360028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-612d2291-b312-4251-ad34-d91ff1e86d4c.info" returned: 0 in 0.278s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-55594814-789d-4335-80c1-335141856e22 tempest-ProjectReaderTests-1988360028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.976s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:41:58 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-55594814-789d-4335-80c1-335141856e22 tempest-ProjectReaderTests-1988360028 None] Create snapshot completed successfully
Jul 30 20:41:59 devstack sudo[108576]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:59 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-1daf2f61-5575-4deb-901d-53fec1b99134 tempest-ProjectMemberTests-47051868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-1d2df796-83ad-451b-9ed2-8c1f49f10f70" returned: 0 in 0.260s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:59 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-1daf2f61-5575-4deb-901d-53fec1b99134 tempest-ProjectMemberTests-47051868 None] Lock "cinder-quobyte-1d2df796-83ad-451b-9ed2-8c1f49f10f70" released by "delete_volume" :: held 0.701s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:41:59 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-1daf2f61-5575-4deb-901d-53fec1b99134 tempest-ProjectMemberTests-47051868 None] Created reservations ['229e39ce-f7d1-4727-9965-d04e93cb4867', '68a39a91-f11e-40fc-906f-2a4cc1e039b5', 'a0ad7de4-605e-4b2a-a82c-ebffed4719fa', '5be0359d-60b7-4207-940e-3d0389b46a9f'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:41:59 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-989a9981-3d2f-4a56-b7b6-e8aeae8535ee tempest-ProjectReaderTests-1988360028 None] Acquiring lock "cinder-8cd6dba9-4d38-43c1-9d87-48c581f5c76b-delete_snapshot" by "delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:41:59 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-989a9981-3d2f-4a56-b7b6-e8aeae8535ee tempest-ProjectReaderTests-1988360028 None] Lock "cinder-8cd6dba9-4d38-43c1-9d87-48c581f5c76b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:41:59 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-989a9981-3d2f-4a56-b7b6-e8aeae8535ee tempest-ProjectReaderTests-1988360028 None] Acquiring lock "cinder-quobyte-612d2291-b312-4251-ad34-d91ff1e86d4c" by "delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:41:59 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-989a9981-3d2f-4a56-b7b6-e8aeae8535ee tempest-ProjectReaderTests-1988360028 None] Lock "cinder-quobyte-612d2291-b312-4251-ad34-d91ff1e86d4c" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:41:59 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-989a9981-3d2f-4a56-b7b6-e8aeae8535ee tempest-ProjectReaderTests-1988360028 None] Acquiring lock "cinder-quobyte-8cd6dba9-4d38-43c1-9d87-48c581f5c76b" by "_delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:41:59 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-989a9981-3d2f-4a56-b7b6-e8aeae8535ee tempest-ProjectReaderTests-1988360028 None] Lock "cinder-quobyte-8cd6dba9-4d38-43c1-9d87-48c581f5c76b" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:41:59 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-989a9981-3d2f-4a56-b7b6-e8aeae8535ee tempest-ProjectReaderTests-1988360028 None] Deleting offline snapshot 8cd6dba9-4d38-43c1-9d87-48c581f5c76b of volume 612d2291-b312-4251-ad34-d91ff1e86d4c {{(pid=88719) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 30 20:41:59 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-989a9981-3d2f-4a56-b7b6-e8aeae8535ee tempest-ProjectReaderTests-1988360028 None] snapshot_file for this snap is: volume-612d2291-b312-4251-ad34-d91ff1e86d4c.8cd6dba9-4d38-43c1-9d87-48c581f5c76b {{(pid=88719) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 30 20:41:59 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e585c0a-7cf4-4b89-8ee5-5411afb6d18d]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:41:59 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-989a9981-3d2f-4a56-b7b6-e8aeae8535ee tempest-ProjectReaderTests-1988360028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-612d2291-b312-4251-ad34-d91ff1e86d4c.8cd6dba9-4d38-43c1-9d87-48c581f5c76b {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:59 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-1daf2f61-5575-4deb-901d-53fec1b99134 tempest-ProjectMemberTests-47051868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:41:59 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-1daf2f61-5575-4deb-901d-53fec1b99134 tempest-ProjectMemberTests-47051868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:41:59 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-1daf2f61-5575-4deb-901d-53fec1b99134 tempest-ProjectMemberTests-47051868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:41:59 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-1daf2f61-5575-4deb-901d-53fec1b99134 tempest-ProjectMemberTests-47051868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:41:59 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-1daf2f61-5575-4deb-901d-53fec1b99134 tempest-ProjectMemberTests-47051868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:41:59 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-1daf2f61-5575-4deb-901d-53fec1b99134 tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:59 devstack sudo[108581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:41:59 devstack sudo[108581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:59 devstack sudo[108580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-612d2291-b312-4251-ad34-d91ff1e86d4c.8cd6dba9-4d38-43c1-9d87-48c581f5c76b
Jul 30 20:41:59 devstack sudo[108580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:59 devstack sudo[108581]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:59 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-1daf2f61-5575-4deb-901d-53fec1b99134 tempest-ProjectMemberTests-47051868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.280s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:59 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-1daf2f61-5575-4deb-901d-53fec1b99134 tempest-ProjectMemberTests-47051868 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:41:59 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-1daf2f61-5575-4deb-901d-53fec1b99134 tempest-ProjectMemberTests-47051868 None] Deleted volume successfully.
Jul 30 20:41:59 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-1daf2f61-5575-4deb-901d-53fec1b99134 tempest-ProjectMemberTests-47051868 None] Lock "cinder-1d2df796-83ad-451b-9ed2-8c1f49f10f70-delete_volume" released by "delete_volume" :: held 1.287s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:41:59 devstack sudo[108580]: pam_unix(sudo:session): session closed for user root
Jul 30 20:41:59 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-989a9981-3d2f-4a56-b7b6-e8aeae8535ee tempest-ProjectReaderTests-1988360028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-612d2291-b312-4251-ad34-d91ff1e86d4c.8cd6dba9-4d38-43c1-9d87-48c581f5c76b" returned: 0 in 0.403s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:41:59 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-989a9981-3d2f-4a56-b7b6-e8aeae8535ee tempest-ProjectReaderTests-1988360028 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-612d2291-b312-4251-ad34-d91ff1e86d4c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88719) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 30 20:41:59 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[eab5bd65-692c-421f-b12c-f2525afdfbd5]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:41:59 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-989a9981-3d2f-4a56-b7b6-e8aeae8535ee tempest-ProjectReaderTests-1988360028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-612d2291-b312-4251-ad34-d91ff1e86d4c {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:41:59 devstack sudo[108588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-612d2291-b312-4251-ad34-d91ff1e86d4c
Jul 30 20:41:59 devstack sudo[108588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:41:59 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-86758ba7-5a2d-449b-936d-3c3d9a822c54 tempest-ProjectMemberTests-47051868 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:41:59 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-86758ba7-5a2d-449b-936d-3c3d9a822c54 tempest-ProjectMemberTests-47051868 None] Flow 'volume_create_manager' (0b3e1f99-49d4-492c-829e-b1cd2772e751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:41:59 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-86758ba7-5a2d-449b-936d-3c3d9a822c54 tempest-ProjectMemberTests-47051868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c437397c-7e2d-4d6c-bdc8-23c167c55e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:41:59 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-86758ba7-5a2d-449b-936d-3c3d9a822c54 tempest-ProjectMemberTests-47051868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c437397c-7e2d-4d6c-bdc8-23c167c55e12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:42:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-798980451',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73c61ab6-cec4-4dd5-b300-e57dbc5f2181,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c483f66aa6ec477e9cb0547f0f04f6d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:42:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:42:00Z,use_quota=True,user_id='59a41c24b76545b79b09f90cd8c36728',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:41:59 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-86758ba7-5a2d-449b-936d-3c3d9a822c54 tempest-ProjectMemberTests-47051868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0acfc0d-3f60-427f-88d0-b73d79d0200b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:41:59 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-86758ba7-5a2d-449b-936d-3c3d9a822c54 tempest-ProjectMemberTests-47051868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0acfc0d-3f60-427f-88d0-b73d79d0200b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:41:59 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-86758ba7-5a2d-449b-936d-3c3d9a822c54 tempest-ProjectMemberTests-47051868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc4bc7b6-0da5-4d77-a4e6-e594c10f81a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:41:59 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-86758ba7-5a2d-449b-936d-3c3d9a822c54 tempest-ProjectMemberTests-47051868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc4bc7b6-0da5-4d77-a4e6-e594c10f81a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73c61ab6-cec4-4dd5-b300-e57dbc5f2181', 'volume_name': 'volume-73c61ab6-cec4-4dd5-b300-e57dbc5f2181', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:41:59 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-86758ba7-5a2d-449b-936d-3c3d9a822c54 tempest-ProjectMemberTests-47051868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5ef07af-046d-439e-a5bc-157ae151a827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:41:59 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-86758ba7-5a2d-449b-936d-3c3d9a822c54 tempest-ProjectMemberTests-47051868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5ef07af-046d-439e-a5bc-157ae151a827) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:41:59 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-86758ba7-5a2d-449b-936d-3c3d9a822c54 tempest-ProjectMemberTests-47051868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc9afa9a-f2c5-4a74-8405-f4f6c20c4cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:41:59 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-86758ba7-5a2d-449b-936d-3c3d9a822c54 tempest-ProjectMemberTests-47051868 None] Volume 73c61ab6-cec4-4dd5-b300-e57dbc5f2181: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73c61ab6-cec4-4dd5-b300-e57dbc5f2181', 'volume_size': 1}
Jul 30 20:41:59 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-86758ba7-5a2d-449b-936d-3c3d9a822c54 tempest-ProjectMemberTests-47051868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:41:59 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-86758ba7-5a2d-449b-936d-3c3d9a822c54 tempest-ProjectMemberTests-47051868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:41:59 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-86758ba7-5a2d-449b-936d-3c3d9a822c54 tempest-ProjectMemberTests-47051868 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:42:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-798980451',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73c61ab6-cec4-4dd5-b300-e57dbc5f2181,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c483f66aa6ec477e9cb0547f0f04f6d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:42:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:42:00Z,use_quota=True,user_id='59a41c24b76545b79b09f90cd8c36728',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:41:59 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-86758ba7-5a2d-449b-936d-3c3d9a822c54 tempest-ProjectMemberTests-47051868 None] Creating volume 73c61ab6-cec4-4dd5-b300-e57dbc5f2181 {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:41:59 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-86758ba7-5a2d-449b-936d-3c3d9a822c54 tempest-ProjectMemberTests-47051868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:41:59 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-86758ba7-5a2d-449b-936d-3c3d9a822c54 tempest-ProjectMemberTests-47051868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:41:59 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-86758ba7-5a2d-449b-936d-3c3d9a822c54 tempest-ProjectMemberTests-47051868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:41:59 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-86758ba7-5a2d-449b-936d-3c3d9a822c54 tempest-ProjectMemberTests-47051868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:41:59 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-86758ba7-5a2d-449b-936d-3c3d9a822c54 tempest-ProjectMemberTests-47051868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:41:59 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-86758ba7-5a2d-449b-936d-3c3d9a822c54 tempest-ProjectMemberTests-47051868 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:41:59 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-86758ba7-5a2d-449b-936d-3c3d9a822c54 tempest-ProjectMemberTests-47051868 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:41:59 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-86758ba7-5a2d-449b-936d-3c3d9a822c54 tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-73c61ab6-cec4-4dd5-b300-e57dbc5f2181 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:42:00 devstack sudo[108593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-73c61ab6-cec4-4dd5-b300-e57dbc5f2181 1073741824
Jul 30 20:42:00 devstack sudo[108593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:42:00 devstack sudo[108588]: pam_unix(sudo:session): session closed for user root
Jul 30 20:42:00 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-989a9981-3d2f-4a56-b7b6-e8aeae8535ee tempest-ProjectReaderTests-1988360028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-612d2291-b312-4251-ad34-d91ff1e86d4c" returned: 0 in 0.398s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:42:00 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-989a9981-3d2f-4a56-b7b6-e8aeae8535ee tempest-ProjectReaderTests-1988360028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-612d2291-b312-4251-ad34-d91ff1e86d4c.8cd6dba9-4d38-43c1-9d87-48c581f5c76b {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:42:00 devstack sudo[108595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-612d2291-b312-4251-ad34-d91ff1e86d4c.8cd6dba9-4d38-43c1-9d87-48c581f5c76b
Jul 30 20:42:00 devstack sudo[108595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:42:00 devstack sudo[108595]: pam_unix(sudo:session): session closed for user root
Jul 30 20:42:00 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-989a9981-3d2f-4a56-b7b6-e8aeae8535ee tempest-ProjectReaderTests-1988360028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-612d2291-b312-4251-ad34-d91ff1e86d4c.8cd6dba9-4d38-43c1-9d87-48c581f5c76b" returned: 0 in 0.358s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:42:00 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-989a9981-3d2f-4a56-b7b6-e8aeae8535ee tempest-ProjectReaderTests-1988360028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-612d2291-b312-4251-ad34-d91ff1e86d4c.8cd6dba9-4d38-43c1-9d87-48c581f5c76b {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:42:00 devstack sudo[108593]: pam_unix(sudo:session): session closed for user root
Jul 30 20:42:00 devstack sudo[108605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-612d2291-b312-4251-ad34-d91ff1e86d4c.8cd6dba9-4d38-43c1-9d87-48c581f5c76b
Jul 30 20:42:00 devstack sudo[108605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:42:00 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-86758ba7-5a2d-449b-936d-3c3d9a822c54 tempest-ProjectMemberTests-47051868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-73c61ab6-cec4-4dd5-b300-e57dbc5f2181 1073741824" returned: 0 in 0.436s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:42:00 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-86758ba7-5a2d-449b-936d-3c3d9a822c54 tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-73c61ab6-cec4-4dd5-b300-e57dbc5f2181 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:42:00 devstack sudo[108607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-73c61ab6-cec4-4dd5-b300-e57dbc5f2181
Jul 30 20:42:00 devstack sudo[108607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:42:00 devstack sudo[108605]: pam_unix(sudo:session): session closed for user root
Jul 30 20:42:00 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-989a9981-3d2f-4a56-b7b6-e8aeae8535ee tempest-ProjectReaderTests-1988360028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-612d2291-b312-4251-ad34-d91ff1e86d4c.8cd6dba9-4d38-43c1-9d87-48c581f5c76b" returned: 0 in 0.263s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:42:00 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-989a9981-3d2f-4a56-b7b6-e8aeae8535ee tempest-ProjectReaderTests-1988360028 None] Lock "cinder-quobyte-8cd6dba9-4d38-43c1-9d87-48c581f5c76b" released by "_delete_snapshot" :: held 1.528s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:42:00 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-989a9981-3d2f-4a56-b7b6-e8aeae8535ee tempest-ProjectReaderTests-1988360028 None] Lock "cinder-quobyte-612d2291-b312-4251-ad34-d91ff1e86d4c" released by "delete_snapshot" :: held 1.556s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:42:00 devstack sudo[108607]: pam_unix(sudo:session): session closed for user root
Jul 30 20:42:00 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-86758ba7-5a2d-449b-936d-3c3d9a822c54 tempest-ProjectMemberTests-47051868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-73c61ab6-cec4-4dd5-b300-e57dbc5f2181" returned: 0 in 0.272s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:42:00 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-86758ba7-5a2d-449b-936d-3c3d9a822c54 tempest-ProjectMemberTests-47051868 None] <== create_volume: return (748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:42:00 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-86758ba7-5a2d-449b-936d-3c3d9a822c54 tempest-ProjectMemberTests-47051868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.753s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:42:00 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-86758ba7-5a2d-449b-936d-3c3d9a822c54 tempest-ProjectMemberTests-47051868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc9afa9a-f2c5-4a74-8405-f4f6c20c4cec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73c61ab6-cec4-4dd5-b300-e57dbc5f2181', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:42:00 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-86758ba7-5a2d-449b-936d-3c3d9a822c54 tempest-ProjectMemberTests-47051868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4052758-142f-482f-83a7-82b6d2e58496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:42:00 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-86758ba7-5a2d-449b-936d-3c3d9a822c54 tempest-ProjectMemberTests-47051868 None] Volume volume-73c61ab6-cec4-4dd5-b300-e57dbc5f2181 (73c61ab6-cec4-4dd5-b300-e57dbc5f2181): created successfully
Jul 30 20:42:00 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-86758ba7-5a2d-449b-936d-3c3d9a822c54 tempest-ProjectMemberTests-47051868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4052758-142f-482f-83a7-82b6d2e58496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:42:00 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-86758ba7-5a2d-449b-936d-3c3d9a822c54 tempest-ProjectMemberTests-47051868 None] Flow 'volume_create_manager' (0b3e1f99-49d4-492c-829e-b1cd2772e751) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:42:00 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-989a9981-3d2f-4a56-b7b6-e8aeae8535ee tempest-ProjectReaderTests-1988360028 None] Created reservations ['be2cccf6-26a3-4dfe-82c6-47aeedaf2178', 'cb6559f6-1f7d-42a0-8c2d-9349e1aa3b0b', '063564fd-0a47-4e04-8ae5-2bf9fd87e435', '069c29a8-3f25-4d7d-82d8-63dbb0abef6b'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:42:00 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-86758ba7-5a2d-449b-936d-3c3d9a822c54 tempest-ProjectMemberTests-47051868 None] Created volume successfully.
Jul 30 20:42:00 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-989a9981-3d2f-4a56-b7b6-e8aeae8535ee tempest-ProjectReaderTests-1988360028 None] Delete snapshot completed successfully.
Jul 30 20:42:00 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-989a9981-3d2f-4a56-b7b6-e8aeae8535ee tempest-ProjectReaderTests-1988360028 None] Lock "cinder-8cd6dba9-4d38-43c1-9d87-48c581f5c76b-delete_snapshot" released by "delete_snapshot" :: held 1.764s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:42:01 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-eb778d5b-b33a-4fb3-8bb6-be8e33e1585c tempest-ProjectMemberTests-47051868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:42:01 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-eb778d5b-b33a-4fb3-8bb6-be8e33e1585c tempest-ProjectMemberTests-47051868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:42:01 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-eb778d5b-b33a-4fb3-8bb6-be8e33e1585c tempest-ProjectMemberTests-47051868 None] Creating offline snapshot 68ef10b0-2c99-4a95-9ef0-4bfc7afd9618 of volume 73c61ab6-cec4-4dd5-b300-e57dbc5f2181 {{(pid=88719) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 30 20:42:01 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[cea6e003-5e4a-4cec-b1b4-1e5cde680ac2]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:42:01 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-eb778d5b-b33a-4fb3-8bb6-be8e33e1585c tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-73c61ab6-cec4-4dd5-b300-e57dbc5f2181 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:42:01 devstack sudo[108611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-73c61ab6-cec4-4dd5-b300-e57dbc5f2181
Jul 30 20:42:01 devstack sudo[108611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:42:01 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-4f1404a2-4788-4d9d-8e35-c670a1ec9faa tempest-ProjectReaderTests-1988360028 None] Acquiring lock "cinder-612d2291-b312-4251-ad34-d91ff1e86d4c-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:42:01 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-4f1404a2-4788-4d9d-8e35-c670a1ec9faa tempest-ProjectReaderTests-1988360028 None] Lock "cinder-612d2291-b312-4251-ad34-d91ff1e86d4c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:42:01 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-4f1404a2-4788-4d9d-8e35-c670a1ec9faa tempest-ProjectReaderTests-1988360028 None] Acquiring lock "cinder-quobyte-612d2291-b312-4251-ad34-d91ff1e86d4c" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:42:01 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-4f1404a2-4788-4d9d-8e35-c670a1ec9faa tempest-ProjectReaderTests-1988360028 None] Lock "cinder-quobyte-612d2291-b312-4251-ad34-d91ff1e86d4c" acquired by "delete_volume" :: waited 0.022s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:42:01 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a01f66d-ff0e-4766-8b02-3ef27ddd339e]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:42:01 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-4f1404a2-4788-4d9d-8e35-c670a1ec9faa tempest-ProjectReaderTests-1988360028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-612d2291-b312-4251-ad34-d91ff1e86d4c {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:42:01 devstack sudo[108611]: pam_unix(sudo:session): session closed for user root
Jul 30 20:42:01 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-eb778d5b-b33a-4fb3-8bb6-be8e33e1585c tempest-ProjectMemberTests-47051868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-73c61ab6-cec4-4dd5-b300-e57dbc5f2181" returned: 0 in 0.412s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:42:01 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-eb778d5b-b33a-4fb3-8bb6-be8e33e1585c tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-73c61ab6-cec4-4dd5-b300-e57dbc5f2181,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-73c61ab6-cec4-4dd5-b300-e57dbc5f2181.68ef10b0-2c99-4a95-9ef0-4bfc7afd9618 1G {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:42:01 devstack sudo[108613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-612d2291-b312-4251-ad34-d91ff1e86d4c
Jul 30 20:42:01 devstack sudo[108617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-73c61ab6-cec4-4dd5-b300-e57dbc5f2181,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-73c61ab6-cec4-4dd5-b300-e57dbc5f2181.68ef10b0-2c99-4a95-9ef0-4bfc7afd9618 1G
Jul 30 20:42:01 devstack sudo[108613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:42:01 devstack sudo[108617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:42:01 devstack sudo[108613]: pam_unix(sudo:session): session closed for user root
Jul 30 20:42:01 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-4f1404a2-4788-4d9d-8e35-c670a1ec9faa tempest-ProjectReaderTests-1988360028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-612d2291-b312-4251-ad34-d91ff1e86d4c" returned: 0 in 0.363s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:42:01 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-4f1404a2-4788-4d9d-8e35-c670a1ec9faa tempest-ProjectReaderTests-1988360028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-612d2291-b312-4251-ad34-d91ff1e86d4c {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:42:01 devstack sudo[108626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-612d2291-b312-4251-ad34-d91ff1e86d4c
Jul 30 20:42:01 devstack sudo[108626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:42:01 devstack sudo[108617]: pam_unix(sudo:session): session closed for user root
Jul 30 20:42:01 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-eb778d5b-b33a-4fb3-8bb6-be8e33e1585c tempest-ProjectMemberTests-47051868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-73c61ab6-cec4-4dd5-b300-e57dbc5f2181,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-73c61ab6-cec4-4dd5-b300-e57dbc5f2181.68ef10b0-2c99-4a95-9ef0-4bfc7afd9618 1G" returned: 0 in 0.411s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:42:01 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-eb778d5b-b33a-4fb3-8bb6-be8e33e1585c tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73c61ab6-cec4-4dd5-b300-e57dbc5f2181 -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-73c61ab6-cec4-4dd5-b300-e57dbc5f2181.68ef10b0-2c99-4a95-9ef0-4bfc7afd9618 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:42:01 devstack sudo[108629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73c61ab6-cec4-4dd5-b300-e57dbc5f2181 -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-73c61ab6-cec4-4dd5-b300-e57dbc5f2181.68ef10b0-2c99-4a95-9ef0-4bfc7afd9618
Jul 30 20:42:01 devstack sudo[108629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:42:02 devstack sudo[108626]: pam_unix(sudo:session): session closed for user root
Jul 30 20:42:02 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-4f1404a2-4788-4d9d-8e35-c670a1ec9faa tempest-ProjectReaderTests-1988360028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-612d2291-b312-4251-ad34-d91ff1e86d4c" returned: 0 in 0.257s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:42:02 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-4f1404a2-4788-4d9d-8e35-c670a1ec9faa tempest-ProjectReaderTests-1988360028 None] Lock "cinder-quobyte-612d2291-b312-4251-ad34-d91ff1e86d4c" released by "delete_volume" :: held 0.683s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:42:02 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-4f1404a2-4788-4d9d-8e35-c670a1ec9faa tempest-ProjectReaderTests-1988360028 None] Created reservations ['94fa1a9c-b0f7-4d33-9d39-d307f7e04607', '293abb36-dd9d-49a3-b17a-e8821dfce1ef', 'c5b2c33e-eed3-43bf-8f42-d4bbc6f1fac9', 'fc30b2d0-4c9c-4913-9b69-873de422e0ea'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:42:02 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-4f1404a2-4788-4d9d-8e35-c670a1ec9faa tempest-ProjectReaderTests-1988360028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:42:02 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-4f1404a2-4788-4d9d-8e35-c670a1ec9faa tempest-ProjectReaderTests-1988360028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:42:02 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-4f1404a2-4788-4d9d-8e35-c670a1ec9faa tempest-ProjectReaderTests-1988360028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:42:02 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-4f1404a2-4788-4d9d-8e35-c670a1ec9faa tempest-ProjectReaderTests-1988360028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:42:02 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-4f1404a2-4788-4d9d-8e35-c670a1ec9faa tempest-ProjectReaderTests-1988360028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:42:02 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-4f1404a2-4788-4d9d-8e35-c670a1ec9faa tempest-ProjectReaderTests-1988360028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:42:02 devstack sudo[108629]: pam_unix(sudo:session): session closed for user root
Jul 30 20:42:02 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-eb778d5b-b33a-4fb3-8bb6-be8e33e1585c tempest-ProjectMemberTests-47051868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73c61ab6-cec4-4dd5-b300-e57dbc5f2181 -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-73c61ab6-cec4-4dd5-b300-e57dbc5f2181.68ef10b0-2c99-4a95-9ef0-4bfc7afd9618" returned: 0 in 0.306s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:42:02 devstack cinder-volume[88719]: WARNING cinder.volume.drivers.remotefs [None req-eb778d5b-b33a-4fb3-8bb6-be8e33e1585c tempest-ProjectMemberTests-47051868 None] /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-73c61ab6-cec4-4dd5-b300-e57dbc5f2181.68ef10b0-2c99-4a95-9ef0-4bfc7afd9618 is being set with open permissions: ugo+rw
Jul 30 20:42:02 devstack sudo[108635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:42:02 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-eb778d5b-b33a-4fb3-8bb6-be8e33e1585c tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-73c61ab6-cec4-4dd5-b300-e57dbc5f2181.68ef10b0-2c99-4a95-9ef0-4bfc7afd9618 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:42:02 devstack sudo[108635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:42:02 devstack sudo[108637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-73c61ab6-cec4-4dd5-b300-e57dbc5f2181.68ef10b0-2c99-4a95-9ef0-4bfc7afd9618
Jul 30 20:42:02 devstack sudo[108637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:42:02 devstack sudo[108635]: pam_unix(sudo:session): session closed for user root
Jul 30 20:42:02 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-4f1404a2-4788-4d9d-8e35-c670a1ec9faa tempest-ProjectReaderTests-1988360028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.271s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:42:02 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-4f1404a2-4788-4d9d-8e35-c670a1ec9faa tempest-ProjectReaderTests-1988360028 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:42:02 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-4f1404a2-4788-4d9d-8e35-c670a1ec9faa tempest-ProjectReaderTests-1988360028 None] Deleted volume successfully.
Jul 30 20:42:02 devstack sudo[108637]: pam_unix(sudo:session): session closed for user root
Jul 30 20:42:02 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-eb778d5b-b33a-4fb3-8bb6-be8e33e1585c tempest-ProjectMemberTests-47051868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-73c61ab6-cec4-4dd5-b300-e57dbc5f2181.68ef10b0-2c99-4a95-9ef0-4bfc7afd9618" returned: 0 in 0.271s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:42:02 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-4f1404a2-4788-4d9d-8e35-c670a1ec9faa tempest-ProjectReaderTests-1988360028 None] Lock "cinder-612d2291-b312-4251-ad34-d91ff1e86d4c-delete_volume" released by "delete_volume" :: held 1.211s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:42:02 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-eb778d5b-b33a-4fb3-8bb6-be8e33e1585c tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-73c61ab6-cec4-4dd5-b300-e57dbc5f2181.info {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:42:02 devstack sudo[108641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-73c61ab6-cec4-4dd5-b300-e57dbc5f2181.info
Jul 30 20:42:02 devstack sudo[108641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:42:02 devstack sudo[108641]: pam_unix(sudo:session): session closed for user root
Jul 30 20:42:02 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-eb778d5b-b33a-4fb3-8bb6-be8e33e1585c tempest-ProjectMemberTests-47051868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-73c61ab6-cec4-4dd5-b300-e57dbc5f2181.info" returned: 0 in 0.262s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:42:02 devstack cinder-volume[88719]: WARNING cinder.volume.drivers.remotefs [None req-eb778d5b-b33a-4fb3-8bb6-be8e33e1585c tempest-ProjectMemberTests-47051868 None] /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-73c61ab6-cec4-4dd5-b300-e57dbc5f2181.info is being set with open permissions: ugo+rw
Jul 30 20:42:02 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-eb778d5b-b33a-4fb3-8bb6-be8e33e1585c tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-73c61ab6-cec4-4dd5-b300-e57dbc5f2181.info {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:42:02 devstack sudo[108644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-73c61ab6-cec4-4dd5-b300-e57dbc5f2181.info
Jul 30 20:42:02 devstack sudo[108644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:42:02 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-4234d8e7-7690-4065-8e68-03445864b0d1 tempest-ProjectReaderTests-1988360028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:42:02 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-4234d8e7-7690-4065-8e68-03445864b0d1 tempest-ProjectReaderTests-1988360028 None] Flow 'volume_create_manager' (fa6b8675-ea09-49f6-88ea-3e4685aafde7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:42:02 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-4234d8e7-7690-4065-8e68-03445864b0d1 tempest-ProjectReaderTests-1988360028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2043198-ff44-4dc4-945a-8db411263864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:42:02 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-4234d8e7-7690-4065-8e68-03445864b0d1 tempest-ProjectReaderTests-1988360028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2043198-ff44-4dc4-945a-8db411263864) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:42:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1203767180',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3836a65-e521-402f-825d-956a3207eb23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7b0c78c72fa4b7da70731a275a24f3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:42:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:42:03Z,use_quota=True,user_id='66f5ff347f4541e383a978346a7ec5a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:42:02 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-4234d8e7-7690-4065-8e68-03445864b0d1 tempest-ProjectReaderTests-1988360028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e3bc25e-aa9c-42c4-b0a0-11f1705dd098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:42:02 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-4234d8e7-7690-4065-8e68-03445864b0d1 tempest-ProjectReaderTests-1988360028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e3bc25e-aa9c-42c4-b0a0-11f1705dd098) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:42:02 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-4234d8e7-7690-4065-8e68-03445864b0d1 tempest-ProjectReaderTests-1988360028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e441e4ff-da1a-4b0e-a0fc-cd6e0e88e5a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:42:02 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-4234d8e7-7690-4065-8e68-03445864b0d1 tempest-ProjectReaderTests-1988360028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e441e4ff-da1a-4b0e-a0fc-cd6e0e88e5a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3836a65-e521-402f-825d-956a3207eb23', 'volume_name': 'volume-f3836a65-e521-402f-825d-956a3207eb23', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:42:02 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-4234d8e7-7690-4065-8e68-03445864b0d1 tempest-ProjectReaderTests-1988360028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ecdf24a-f030-4506-9f58-d8bd70166e80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:42:02 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-4234d8e7-7690-4065-8e68-03445864b0d1 tempest-ProjectReaderTests-1988360028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ecdf24a-f030-4506-9f58-d8bd70166e80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:42:02 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-4234d8e7-7690-4065-8e68-03445864b0d1 tempest-ProjectReaderTests-1988360028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c4b5137-615f-4db7-819a-5b9449588bd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:42:02 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-4234d8e7-7690-4065-8e68-03445864b0d1 tempest-ProjectReaderTests-1988360028 None] Volume f3836a65-e521-402f-825d-956a3207eb23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3836a65-e521-402f-825d-956a3207eb23', 'volume_size': 1}
Jul 30 20:42:02 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-4234d8e7-7690-4065-8e68-03445864b0d1 tempest-ProjectReaderTests-1988360028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:42:03 devstack sudo[108644]: pam_unix(sudo:session): session closed for user root
Jul 30 20:42:03 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-eb778d5b-b33a-4fb3-8bb6-be8e33e1585c tempest-ProjectMemberTests-47051868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-73c61ab6-cec4-4dd5-b300-e57dbc5f2181.info" returned: 0 in 0.239s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:42:03 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-eb778d5b-b33a-4fb3-8bb6-be8e33e1585c tempest-ProjectMemberTests-47051868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.978s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:42:03 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-4234d8e7-7690-4065-8e68-03445864b0d1 tempest-ProjectReaderTests-1988360028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.061s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:42:03 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-4234d8e7-7690-4065-8e68-03445864b0d1 tempest-ProjectReaderTests-1988360028 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:42:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1203767180',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3836a65-e521-402f-825d-956a3207eb23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7b0c78c72fa4b7da70731a275a24f3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:42:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:42:03Z,use_quota=True,user_id='66f5ff347f4541e383a978346a7ec5a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:42:03 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-4234d8e7-7690-4065-8e68-03445864b0d1 tempest-ProjectReaderTests-1988360028 None] Creating volume f3836a65-e521-402f-825d-956a3207eb23 {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:42:03 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-4234d8e7-7690-4065-8e68-03445864b0d1 tempest-ProjectReaderTests-1988360028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:42:03 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-4234d8e7-7690-4065-8e68-03445864b0d1 tempest-ProjectReaderTests-1988360028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:42:03 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-4234d8e7-7690-4065-8e68-03445864b0d1 tempest-ProjectReaderTests-1988360028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:42:03 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-4234d8e7-7690-4065-8e68-03445864b0d1 tempest-ProjectReaderTests-1988360028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:42:03 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-4234d8e7-7690-4065-8e68-03445864b0d1 tempest-ProjectReaderTests-1988360028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:42:03 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-4234d8e7-7690-4065-8e68-03445864b0d1 tempest-ProjectReaderTests-1988360028 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:42:03 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-4234d8e7-7690-4065-8e68-03445864b0d1 tempest-ProjectReaderTests-1988360028 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:42:03 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-4234d8e7-7690-4065-8e68-03445864b0d1 tempest-ProjectReaderTests-1988360028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f3836a65-e521-402f-825d-956a3207eb23 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:42:03 devstack sudo[108647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f3836a65-e521-402f-825d-956a3207eb23 1073741824
Jul 30 20:42:03 devstack sudo[108647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:42:03 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-eb778d5b-b33a-4fb3-8bb6-be8e33e1585c tempest-ProjectMemberTests-47051868 None] Create snapshot completed successfully
Jul 30 20:42:03 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-9eb67de9-089e-4ff6-83ad-a1cbd8725125 tempest-ProjectMemberTests-47051868 None] Acquiring lock "cinder-68ef10b0-2c99-4a95-9ef0-4bfc7afd9618-delete_snapshot" by "delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:42:03 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-9eb67de9-089e-4ff6-83ad-a1cbd8725125 tempest-ProjectMemberTests-47051868 None] Lock "cinder-68ef10b0-2c99-4a95-9ef0-4bfc7afd9618-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:42:03 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-9eb67de9-089e-4ff6-83ad-a1cbd8725125 tempest-ProjectMemberTests-47051868 None] Acquiring lock "cinder-quobyte-73c61ab6-cec4-4dd5-b300-e57dbc5f2181" by "delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:42:03 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-9eb67de9-089e-4ff6-83ad-a1cbd8725125 tempest-ProjectMemberTests-47051868 None] Lock "cinder-quobyte-73c61ab6-cec4-4dd5-b300-e57dbc5f2181" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:42:03 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-9eb67de9-089e-4ff6-83ad-a1cbd8725125 tempest-ProjectMemberTests-47051868 None] Acquiring lock "cinder-quobyte-68ef10b0-2c99-4a95-9ef0-4bfc7afd9618" by "_delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:42:03 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-9eb67de9-089e-4ff6-83ad-a1cbd8725125 tempest-ProjectMemberTests-47051868 None] Lock "cinder-quobyte-68ef10b0-2c99-4a95-9ef0-4bfc7afd9618" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:42:03 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-9eb67de9-089e-4ff6-83ad-a1cbd8725125 tempest-ProjectMemberTests-47051868 None] Deleting offline snapshot 68ef10b0-2c99-4a95-9ef0-4bfc7afd9618 of volume 73c61ab6-cec4-4dd5-b300-e57dbc5f2181 {{(pid=88719) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 30 20:42:03 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-9eb67de9-089e-4ff6-83ad-a1cbd8725125 tempest-ProjectMemberTests-47051868 None] snapshot_file for this snap is: volume-73c61ab6-cec4-4dd5-b300-e57dbc5f2181.68ef10b0-2c99-4a95-9ef0-4bfc7afd9618 {{(pid=88719) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 30 20:42:03 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bd85f32-0488-4cdd-9a8b-3a63171de660]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:42:03 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-9eb67de9-089e-4ff6-83ad-a1cbd8725125 tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-73c61ab6-cec4-4dd5-b300-e57dbc5f2181.68ef10b0-2c99-4a95-9ef0-4bfc7afd9618 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:42:03 devstack sudo[108652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-73c61ab6-cec4-4dd5-b300-e57dbc5f2181.68ef10b0-2c99-4a95-9ef0-4bfc7afd9618
Jul 30 20:42:03 devstack sudo[108652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:42:03 devstack sudo[108647]: pam_unix(sudo:session): session closed for user root
Jul 30 20:42:03 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-4234d8e7-7690-4065-8e68-03445864b0d1 tempest-ProjectReaderTests-1988360028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f3836a65-e521-402f-825d-956a3207eb23 1073741824" returned: 0 in 0.456s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:42:03 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-4234d8e7-7690-4065-8e68-03445864b0d1 tempest-ProjectReaderTests-1988360028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f3836a65-e521-402f-825d-956a3207eb23 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:42:03 devstack sudo[108654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f3836a65-e521-402f-825d-956a3207eb23
Jul 30 20:42:03 devstack sudo[108654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:42:03 devstack sudo[108652]: pam_unix(sudo:session): session closed for user root
Jul 30 20:42:03 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-9eb67de9-089e-4ff6-83ad-a1cbd8725125 tempest-ProjectMemberTests-47051868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-73c61ab6-cec4-4dd5-b300-e57dbc5f2181.68ef10b0-2c99-4a95-9ef0-4bfc7afd9618" returned: 0 in 0.393s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:42:03 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-9eb67de9-089e-4ff6-83ad-a1cbd8725125 tempest-ProjectMemberTests-47051868 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-73c61ab6-cec4-4dd5-b300-e57dbc5f2181(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88719) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 30 20:42:03 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4a84620-cc75-4308-b3fb-c8407dadd453]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:42:03 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-9eb67de9-089e-4ff6-83ad-a1cbd8725125 tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-73c61ab6-cec4-4dd5-b300-e57dbc5f2181 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:42:03 devstack sudo[108654]: pam_unix(sudo:session): session closed for user root
Jul 30 20:42:03 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-4234d8e7-7690-4065-8e68-03445864b0d1 tempest-ProjectReaderTests-1988360028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f3836a65-e521-402f-825d-956a3207eb23" returned: 0 in 0.244s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:42:03 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-4234d8e7-7690-4065-8e68-03445864b0d1 tempest-ProjectReaderTests-1988360028 None] <== create_volume: return (742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:42:03 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-4234d8e7-7690-4065-8e68-03445864b0d1 tempest-ProjectReaderTests-1988360028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.745s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:42:03 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-4234d8e7-7690-4065-8e68-03445864b0d1 tempest-ProjectReaderTests-1988360028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c4b5137-615f-4db7-819a-5b9449588bd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3836a65-e521-402f-825d-956a3207eb23', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:42:03 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-4234d8e7-7690-4065-8e68-03445864b0d1 tempest-ProjectReaderTests-1988360028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a7f24a4-fb76-47a8-b7d2-fea19816df02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:42:03 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-4234d8e7-7690-4065-8e68-03445864b0d1 tempest-ProjectReaderTests-1988360028 None] Volume volume-f3836a65-e521-402f-825d-956a3207eb23 (f3836a65-e521-402f-825d-956a3207eb23): created successfully
Jul 30 20:42:03 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-4234d8e7-7690-4065-8e68-03445864b0d1 tempest-ProjectReaderTests-1988360028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a7f24a4-fb76-47a8-b7d2-fea19816df02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:42:03 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-4234d8e7-7690-4065-8e68-03445864b0d1 tempest-ProjectReaderTests-1988360028 None] Flow 'volume_create_manager' (fa6b8675-ea09-49f6-88ea-3e4685aafde7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:42:03 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-4234d8e7-7690-4065-8e68-03445864b0d1 tempest-ProjectReaderTests-1988360028 None] Created volume successfully.
Jul 30 20:42:03 devstack sudo[108660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-73c61ab6-cec4-4dd5-b300-e57dbc5f2181
Jul 30 20:42:03 devstack sudo[108660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:42:04 devstack sudo[108660]: pam_unix(sudo:session): session closed for user root
Jul 30 20:42:04 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-9eb67de9-089e-4ff6-83ad-a1cbd8725125 tempest-ProjectMemberTests-47051868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-73c61ab6-cec4-4dd5-b300-e57dbc5f2181" returned: 0 in 0.357s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:42:04 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-9eb67de9-089e-4ff6-83ad-a1cbd8725125 tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-73c61ab6-cec4-4dd5-b300-e57dbc5f2181.68ef10b0-2c99-4a95-9ef0-4bfc7afd9618 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:42:04 devstack sudo[108665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-73c61ab6-cec4-4dd5-b300-e57dbc5f2181.68ef10b0-2c99-4a95-9ef0-4bfc7afd9618
Jul 30 20:42:04 devstack sudo[108665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:42:04 devstack sudo[108665]: pam_unix(sudo:session): session closed for user root
Jul 30 20:42:04 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-9eb67de9-089e-4ff6-83ad-a1cbd8725125 tempest-ProjectMemberTests-47051868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-73c61ab6-cec4-4dd5-b300-e57dbc5f2181.68ef10b0-2c99-4a95-9ef0-4bfc7afd9618" returned: 0 in 0.320s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:42:04 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-9eb67de9-089e-4ff6-83ad-a1cbd8725125 tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-73c61ab6-cec4-4dd5-b300-e57dbc5f2181.68ef10b0-2c99-4a95-9ef0-4bfc7afd9618 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:42:04 devstack sudo[108671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-73c61ab6-cec4-4dd5-b300-e57dbc5f2181.68ef10b0-2c99-4a95-9ef0-4bfc7afd9618
Jul 30 20:42:04 devstack sudo[108671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:42:04 devstack sudo[108671]: pam_unix(sudo:session): session closed for user root
Jul 30 20:42:04 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-9eb67de9-089e-4ff6-83ad-a1cbd8725125 tempest-ProjectMemberTests-47051868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-73c61ab6-cec4-4dd5-b300-e57dbc5f2181.68ef10b0-2c99-4a95-9ef0-4bfc7afd9618" returned: 0 in 0.241s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:42:04 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-9eb67de9-089e-4ff6-83ad-a1cbd8725125 tempest-ProjectMemberTests-47051868 None] Lock "cinder-quobyte-68ef10b0-2c99-4a95-9ef0-4bfc7afd9618" released by "_delete_snapshot" :: held 1.397s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:42:04 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-9eb67de9-089e-4ff6-83ad-a1cbd8725125 tempest-ProjectMemberTests-47051868 None] Lock "cinder-quobyte-73c61ab6-cec4-4dd5-b300-e57dbc5f2181" released by "delete_snapshot" :: held 1.420s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:42:04 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-9eb67de9-089e-4ff6-83ad-a1cbd8725125 tempest-ProjectMemberTests-47051868 None] Created reservations ['ee96b14d-266c-4476-a955-181c332ee170', '3ee16b47-e137-49d8-8ea8-35f3df83d5ea', '71cc92ee-30f2-47de-afae-14f5817c4a39', '99d727c5-02b2-4026-b5cd-0413815e3987'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:42:04 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-9eb67de9-089e-4ff6-83ad-a1cbd8725125 tempest-ProjectMemberTests-47051868 None] Delete snapshot completed successfully.
Jul 30 20:42:04 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-9eb67de9-089e-4ff6-83ad-a1cbd8725125 tempest-ProjectMemberTests-47051868 None] Lock "cinder-68ef10b0-2c99-4a95-9ef0-4bfc7afd9618-delete_snapshot" released by "delete_snapshot" :: held 1.548s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:42:05 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-f2310194-f706-4283-bd03-a849fe203d78 tempest-ProjectReaderTests-1988360028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:42:05 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-f2310194-f706-4283-bd03-a849fe203d78 tempest-ProjectReaderTests-1988360028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:42:05 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-f2310194-f706-4283-bd03-a849fe203d78 tempest-ProjectReaderTests-1988360028 None] Creating offline snapshot d92614f9-e4b1-4320-811f-693372f6a4fd of volume f3836a65-e521-402f-825d-956a3207eb23 {{(pid=88719) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 30 20:42:05 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[d129a7ec-adcd-4ae7-96c0-0fbc77f101b7]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:42:05 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f2310194-f706-4283-bd03-a849fe203d78 tempest-ProjectReaderTests-1988360028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f3836a65-e521-402f-825d-956a3207eb23 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:42:05 devstack sudo[108674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f3836a65-e521-402f-825d-956a3207eb23
Jul 30 20:42:05 devstack sudo[108674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:42:05 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-529e3f1b-7b5b-4010-8c60-5419b6454476 tempest-ProjectMemberTests-47051868 None] Acquiring lock "cinder-73c61ab6-cec4-4dd5-b300-e57dbc5f2181-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:42:05 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-529e3f1b-7b5b-4010-8c60-5419b6454476 tempest-ProjectMemberTests-47051868 None] Lock "cinder-73c61ab6-cec4-4dd5-b300-e57dbc5f2181-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:42:05 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-529e3f1b-7b5b-4010-8c60-5419b6454476 tempest-ProjectMemberTests-47051868 None] Acquiring lock "cinder-quobyte-73c61ab6-cec4-4dd5-b300-e57dbc5f2181" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:42:05 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-529e3f1b-7b5b-4010-8c60-5419b6454476 tempest-ProjectMemberTests-47051868 None] Lock "cinder-quobyte-73c61ab6-cec4-4dd5-b300-e57dbc5f2181" acquired by "delete_volume" :: waited 0.019s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:42:05 devstack sudo[108674]: pam_unix(sudo:session): session closed for user root
Jul 30 20:42:05 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f2310194-f706-4283-bd03-a849fe203d78 tempest-ProjectReaderTests-1988360028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f3836a65-e521-402f-825d-956a3207eb23" returned: 0 in 0.392s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:42:05 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f2310194-f706-4283-bd03-a849fe203d78 tempest-ProjectReaderTests-1988360028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f3836a65-e521-402f-825d-956a3207eb23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f3836a65-e521-402f-825d-956a3207eb23.d92614f9-e4b1-4320-811f-693372f6a4fd 1G {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:42:05 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a1c962c-56ef-4d82-b2d9-1982f1bd2c88]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:42:05 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-529e3f1b-7b5b-4010-8c60-5419b6454476 tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-73c61ab6-cec4-4dd5-b300-e57dbc5f2181 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:42:05 devstack sudo[108680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f3836a65-e521-402f-825d-956a3207eb23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f3836a65-e521-402f-825d-956a3207eb23.d92614f9-e4b1-4320-811f-693372f6a4fd 1G
Jul 30 20:42:05 devstack sudo[108680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:42:05 devstack sudo[108681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-73c61ab6-cec4-4dd5-b300-e57dbc5f2181
Jul 30 20:42:05 devstack sudo[108681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:42:05 devstack sudo[108681]: pam_unix(sudo:session): session closed for user root
Jul 30 20:42:05 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-529e3f1b-7b5b-4010-8c60-5419b6454476 tempest-ProjectMemberTests-47051868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-73c61ab6-cec4-4dd5-b300-e57dbc5f2181" returned: 0 in 0.423s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:42:05 devstack sudo[108680]: pam_unix(sudo:session): session closed for user root
Jul 30 20:42:05 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-529e3f1b-7b5b-4010-8c60-5419b6454476 tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-73c61ab6-cec4-4dd5-b300-e57dbc5f2181 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:42:05 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f2310194-f706-4283-bd03-a849fe203d78 tempest-ProjectReaderTests-1988360028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f3836a65-e521-402f-825d-956a3207eb23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f3836a65-e521-402f-825d-956a3207eb23.d92614f9-e4b1-4320-811f-693372f6a4fd 1G" returned: 0 in 0.454s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:42:05 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f2310194-f706-4283-bd03-a849fe203d78 tempest-ProjectReaderTests-1988360028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3836a65-e521-402f-825d-956a3207eb23 -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f3836a65-e521-402f-825d-956a3207eb23.d92614f9-e4b1-4320-811f-693372f6a4fd {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:42:05 devstack sudo[108727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-73c61ab6-cec4-4dd5-b300-e57dbc5f2181
Jul 30 20:42:05 devstack sudo[108727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:42:06 devstack sudo[108728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3836a65-e521-402f-825d-956a3207eb23 -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f3836a65-e521-402f-825d-956a3207eb23.d92614f9-e4b1-4320-811f-693372f6a4fd
Jul 30 20:42:06 devstack sudo[108728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:42:06 devstack sudo[108727]: pam_unix(sudo:session): session closed for user root
Jul 30 20:42:06 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-529e3f1b-7b5b-4010-8c60-5419b6454476 tempest-ProjectMemberTests-47051868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-73c61ab6-cec4-4dd5-b300-e57dbc5f2181" returned: 0 in 0.309s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:42:06 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-529e3f1b-7b5b-4010-8c60-5419b6454476 tempest-ProjectMemberTests-47051868 None] Lock "cinder-quobyte-73c61ab6-cec4-4dd5-b300-e57dbc5f2181" released by "delete_volume" :: held 0.800s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:42:06 devstack sudo[108728]: pam_unix(sudo:session): session closed for user root
Jul 30 20:42:06 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f2310194-f706-4283-bd03-a849fe203d78 tempest-ProjectReaderTests-1988360028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3836a65-e521-402f-825d-956a3207eb23 -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f3836a65-e521-402f-825d-956a3207eb23.d92614f9-e4b1-4320-811f-693372f6a4fd" returned: 0 in 0.345s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:42:06 devstack cinder-volume[88719]: WARNING cinder.volume.drivers.remotefs [None req-f2310194-f706-4283-bd03-a849fe203d78 tempest-ProjectReaderTests-1988360028 None] /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f3836a65-e521-402f-825d-956a3207eb23.d92614f9-e4b1-4320-811f-693372f6a4fd is being set with open permissions: ugo+rw
Jul 30 20:42:06 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f2310194-f706-4283-bd03-a849fe203d78 tempest-ProjectReaderTests-1988360028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f3836a65-e521-402f-825d-956a3207eb23.d92614f9-e4b1-4320-811f-693372f6a4fd {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:42:06 devstack sudo[108736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f3836a65-e521-402f-825d-956a3207eb23.d92614f9-e4b1-4320-811f-693372f6a4fd
Jul 30 20:42:06 devstack sudo[108736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:42:06 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-529e3f1b-7b5b-4010-8c60-5419b6454476 tempest-ProjectMemberTests-47051868 None] Created reservations ['edb71c2b-542c-4bfd-9c85-b88236ab5b49', 'b58f418c-1b9b-4ac9-ac61-6c0cbbf1830b', '7f14066e-269a-4a7c-afa4-7db91eaec1b9', '5766756b-3a64-45c4-81e8-66b74e647e48'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:42:06 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-529e3f1b-7b5b-4010-8c60-5419b6454476 tempest-ProjectMemberTests-47051868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:42:06 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-529e3f1b-7b5b-4010-8c60-5419b6454476 tempest-ProjectMemberTests-47051868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:42:06 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-529e3f1b-7b5b-4010-8c60-5419b6454476 tempest-ProjectMemberTests-47051868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:42:06 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-529e3f1b-7b5b-4010-8c60-5419b6454476 tempest-ProjectMemberTests-47051868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:42:06 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-529e3f1b-7b5b-4010-8c60-5419b6454476 tempest-ProjectMemberTests-47051868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:42:06 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-529e3f1b-7b5b-4010-8c60-5419b6454476 tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:42:06 devstack sudo[108738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:42:06 devstack sudo[108738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:42:06 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f2310194-f706-4283-bd03-a849fe203d78 tempest-ProjectReaderTests-1988360028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f3836a65-e521-402f-825d-956a3207eb23.d92614f9-e4b1-4320-811f-693372f6a4fd" returned: 0 in 0.302s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:42:06 devstack sudo[108736]: pam_unix(sudo:session): session closed for user root
Jul 30 20:42:06 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f2310194-f706-4283-bd03-a849fe203d78 tempest-ProjectReaderTests-1988360028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f3836a65-e521-402f-825d-956a3207eb23.info {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:42:06 devstack sudo[108743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f3836a65-e521-402f-825d-956a3207eb23.info
Jul 30 20:42:06 devstack sudo[108743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:42:06 devstack sudo[108738]: pam_unix(sudo:session): session closed for user root
Jul 30 20:42:06 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-529e3f1b-7b5b-4010-8c60-5419b6454476 tempest-ProjectMemberTests-47051868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.301s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:42:06 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-529e3f1b-7b5b-4010-8c60-5419b6454476 tempest-ProjectMemberTests-47051868 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:42:06 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-529e3f1b-7b5b-4010-8c60-5419b6454476 tempest-ProjectMemberTests-47051868 None] Deleted volume successfully.
Jul 30 20:42:06 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-529e3f1b-7b5b-4010-8c60-5419b6454476 tempest-ProjectMemberTests-47051868 None] Lock "cinder-73c61ab6-cec4-4dd5-b300-e57dbc5f2181-delete_volume" released by "delete_volume" :: held 1.377s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:42:06 devstack sudo[108743]: pam_unix(sudo:session): session closed for user root
Jul 30 20:42:06 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f2310194-f706-4283-bd03-a849fe203d78 tempest-ProjectReaderTests-1988360028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f3836a65-e521-402f-825d-956a3207eb23.info" returned: 0 in 0.323s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:42:06 devstack cinder-volume[88719]: WARNING cinder.volume.drivers.remotefs [None req-f2310194-f706-4283-bd03-a849fe203d78 tempest-ProjectReaderTests-1988360028 None] /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f3836a65-e521-402f-825d-956a3207eb23.info is being set with open permissions: ugo+rw
Jul 30 20:42:06 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f2310194-f706-4283-bd03-a849fe203d78 tempest-ProjectReaderTests-1988360028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f3836a65-e521-402f-825d-956a3207eb23.info {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:42:07 devstack sudo[108747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f3836a65-e521-402f-825d-956a3207eb23.info
Jul 30 20:42:07 devstack sudo[108747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:42:07 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-d06bb162-8975-40c7-a39b-de03bd3593d2 tempest-ProjectMemberTests-47051868 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:42:07 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-d06bb162-8975-40c7-a39b-de03bd3593d2 tempest-ProjectMemberTests-47051868 None] Flow 'volume_create_manager' (bfa62aa9-d78d-4ece-b0e2-c83f3684dbbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:42:07 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-d06bb162-8975-40c7-a39b-de03bd3593d2 tempest-ProjectMemberTests-47051868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f7eae45-ec41-48b1-9060-503945c167da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:42:07 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-d06bb162-8975-40c7-a39b-de03bd3593d2 tempest-ProjectMemberTests-47051868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f7eae45-ec41-48b1-9060-503945c167da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:42:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1974213539',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=252dc343-a43a-4f11-a45b-141873410735,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c483f66aa6ec477e9cb0547f0f04f6d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:42:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:42:07Z,use_quota=True,user_id='59a41c24b76545b79b09f90cd8c36728',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:42:07 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-d06bb162-8975-40c7-a39b-de03bd3593d2 tempest-ProjectMemberTests-47051868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e7f7644-e4dc-4294-b8f3-cc805c391481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:42:07 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-d06bb162-8975-40c7-a39b-de03bd3593d2 tempest-ProjectMemberTests-47051868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e7f7644-e4dc-4294-b8f3-cc805c391481) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:42:07 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-d06bb162-8975-40c7-a39b-de03bd3593d2 tempest-ProjectMemberTests-47051868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b477ce5-df6f-42f3-a1fa-189b411dd8c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:42:07 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-d06bb162-8975-40c7-a39b-de03bd3593d2 tempest-ProjectMemberTests-47051868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b477ce5-df6f-42f3-a1fa-189b411dd8c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '252dc343-a43a-4f11-a45b-141873410735', 'volume_name': 'volume-252dc343-a43a-4f11-a45b-141873410735', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:42:07 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-d06bb162-8975-40c7-a39b-de03bd3593d2 tempest-ProjectMemberTests-47051868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80757e6a-61bd-4d87-8c5f-931fcf0f4fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:42:07 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-d06bb162-8975-40c7-a39b-de03bd3593d2 tempest-ProjectMemberTests-47051868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80757e6a-61bd-4d87-8c5f-931fcf0f4fd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:42:07 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-d06bb162-8975-40c7-a39b-de03bd3593d2 tempest-ProjectMemberTests-47051868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba221e8c-9b4b-48ce-a9e0-281f5fa18e82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:42:07 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-d06bb162-8975-40c7-a39b-de03bd3593d2 tempest-ProjectMemberTests-47051868 None] Volume 252dc343-a43a-4f11-a45b-141873410735: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-252dc343-a43a-4f11-a45b-141873410735', 'volume_size': 1}
Jul 30 20:42:07 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-d06bb162-8975-40c7-a39b-de03bd3593d2 tempest-ProjectMemberTests-47051868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:42:07 devstack sudo[108747]: pam_unix(sudo:session): session closed for user root
Jul 30 20:42:07 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-f2310194-f706-4283-bd03-a849fe203d78 tempest-ProjectReaderTests-1988360028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f3836a65-e521-402f-825d-956a3207eb23.info" returned: 0 in 0.262s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:42:07 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-f2310194-f706-4283-bd03-a849fe203d78 tempest-ProjectReaderTests-1988360028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.161s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:42:07 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-d06bb162-8975-40c7-a39b-de03bd3593d2 tempest-ProjectMemberTests-47051868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.093s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:42:07 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-d06bb162-8975-40c7-a39b-de03bd3593d2 tempest-ProjectMemberTests-47051868 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:42:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1974213539',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=252dc343-a43a-4f11-a45b-141873410735,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c483f66aa6ec477e9cb0547f0f04f6d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:42:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:42:07Z,use_quota=True,user_id='59a41c24b76545b79b09f90cd8c36728',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:42:07 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-d06bb162-8975-40c7-a39b-de03bd3593d2 tempest-ProjectMemberTests-47051868 None] Creating volume 252dc343-a43a-4f11-a45b-141873410735 {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:42:07 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-d06bb162-8975-40c7-a39b-de03bd3593d2 tempest-ProjectMemberTests-47051868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:42:07 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-d06bb162-8975-40c7-a39b-de03bd3593d2 tempest-ProjectMemberTests-47051868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:42:07 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-d06bb162-8975-40c7-a39b-de03bd3593d2 tempest-ProjectMemberTests-47051868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:42:07 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-d06bb162-8975-40c7-a39b-de03bd3593d2 tempest-ProjectMemberTests-47051868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:42:07 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-d06bb162-8975-40c7-a39b-de03bd3593d2 tempest-ProjectMemberTests-47051868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:42:07 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-d06bb162-8975-40c7-a39b-de03bd3593d2 tempest-ProjectMemberTests-47051868 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:42:07 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-d06bb162-8975-40c7-a39b-de03bd3593d2 tempest-ProjectMemberTests-47051868 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:42:07 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-d06bb162-8975-40c7-a39b-de03bd3593d2 tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-252dc343-a43a-4f11-a45b-141873410735 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:42:07 devstack sudo[108750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-252dc343-a43a-4f11-a45b-141873410735 1073741824
Jul 30 20:42:07 devstack sudo[108750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:42:07 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-f2310194-f706-4283-bd03-a849fe203d78 tempest-ProjectReaderTests-1988360028 None] Create snapshot completed successfully
Jul 30 20:42:07 devstack sudo[108750]: pam_unix(sudo:session): session closed for user root
Jul 30 20:42:07 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-d06bb162-8975-40c7-a39b-de03bd3593d2 tempest-ProjectMemberTests-47051868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-252dc343-a43a-4f11-a45b-141873410735 1073741824" returned: 0 in 0.409s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:42:07 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-d06bb162-8975-40c7-a39b-de03bd3593d2 tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-252dc343-a43a-4f11-a45b-141873410735 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:42:07 devstack sudo[108762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-252dc343-a43a-4f11-a45b-141873410735
Jul 30 20:42:07 devstack sudo[108762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:42:07 devstack sudo[108762]: pam_unix(sudo:session): session closed for user root
Jul 30 20:42:07 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-d06bb162-8975-40c7-a39b-de03bd3593d2 tempest-ProjectMemberTests-47051868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-252dc343-a43a-4f11-a45b-141873410735" returned: 0 in 0.246s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:42:07 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-d06bb162-8975-40c7-a39b-de03bd3593d2 tempest-ProjectMemberTests-47051868 None] <== create_volume: return (691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:42:07 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-d06bb162-8975-40c7-a39b-de03bd3593d2 tempest-ProjectMemberTests-47051868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.694s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:42:07 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-d06bb162-8975-40c7-a39b-de03bd3593d2 tempest-ProjectMemberTests-47051868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba221e8c-9b4b-48ce-a9e0-281f5fa18e82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-252dc343-a43a-4f11-a45b-141873410735', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:42:07 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-d06bb162-8975-40c7-a39b-de03bd3593d2 tempest-ProjectMemberTests-47051868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2589831-fa66-4ba9-8677-b125130ca24a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:42:07 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-d06bb162-8975-40c7-a39b-de03bd3593d2 tempest-ProjectMemberTests-47051868 None] Volume volume-252dc343-a43a-4f11-a45b-141873410735 (252dc343-a43a-4f11-a45b-141873410735): created successfully
Jul 30 20:42:07 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-d06bb162-8975-40c7-a39b-de03bd3593d2 tempest-ProjectMemberTests-47051868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2589831-fa66-4ba9-8677-b125130ca24a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:42:07 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-d06bb162-8975-40c7-a39b-de03bd3593d2 tempest-ProjectMemberTests-47051868 None] Flow 'volume_create_manager' (bfa62aa9-d78d-4ece-b0e2-c83f3684dbbd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:42:08 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-d06bb162-8975-40c7-a39b-de03bd3593d2 tempest-ProjectMemberTests-47051868 None] Created volume successfully.
Jul 30 20:42:08 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-5dfb55a8-936a-4cb9-a05d-ec682e37eca4 tempest-ProjectReaderTests-1988360028 None] Acquiring lock "cinder-d92614f9-e4b1-4320-811f-693372f6a4fd-delete_snapshot" by "delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:42:08 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-5dfb55a8-936a-4cb9-a05d-ec682e37eca4 tempest-ProjectReaderTests-1988360028 None] Lock "cinder-d92614f9-e4b1-4320-811f-693372f6a4fd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:42:08 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-5dfb55a8-936a-4cb9-a05d-ec682e37eca4 tempest-ProjectReaderTests-1988360028 None] Acquiring lock "cinder-quobyte-f3836a65-e521-402f-825d-956a3207eb23" by "delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:42:08 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-5dfb55a8-936a-4cb9-a05d-ec682e37eca4 tempest-ProjectReaderTests-1988360028 None] Lock "cinder-quobyte-f3836a65-e521-402f-825d-956a3207eb23" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:42:08 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-5dfb55a8-936a-4cb9-a05d-ec682e37eca4 tempest-ProjectReaderTests-1988360028 None] Acquiring lock "cinder-quobyte-d92614f9-e4b1-4320-811f-693372f6a4fd" by "_delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:42:08 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-5dfb55a8-936a-4cb9-a05d-ec682e37eca4 tempest-ProjectReaderTests-1988360028 None] Lock "cinder-quobyte-d92614f9-e4b1-4320-811f-693372f6a4fd" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:42:08 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-5dfb55a8-936a-4cb9-a05d-ec682e37eca4 tempest-ProjectReaderTests-1988360028 None] Deleting offline snapshot d92614f9-e4b1-4320-811f-693372f6a4fd of volume f3836a65-e521-402f-825d-956a3207eb23 {{(pid=88719) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 30 20:42:08 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-5dfb55a8-936a-4cb9-a05d-ec682e37eca4 tempest-ProjectReaderTests-1988360028 None] snapshot_file for this snap is: volume-f3836a65-e521-402f-825d-956a3207eb23.d92614f9-e4b1-4320-811f-693372f6a4fd {{(pid=88719) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 30 20:42:08 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed02bd4e-025b-4b43-a415-368240e6482a]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:42:08 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-5dfb55a8-936a-4cb9-a05d-ec682e37eca4 tempest-ProjectReaderTests-1988360028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f3836a65-e521-402f-825d-956a3207eb23.d92614f9-e4b1-4320-811f-693372f6a4fd {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:42:08 devstack sudo[108765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f3836a65-e521-402f-825d-956a3207eb23.d92614f9-e4b1-4320-811f-693372f6a4fd
Jul 30 20:42:08 devstack sudo[108765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:42:08 devstack sudo[108765]: pam_unix(sudo:session): session closed for user root
Jul 30 20:42:08 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-5dfb55a8-936a-4cb9-a05d-ec682e37eca4 tempest-ProjectReaderTests-1988360028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f3836a65-e521-402f-825d-956a3207eb23.d92614f9-e4b1-4320-811f-693372f6a4fd" returned: 0 in 0.351s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:42:08 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-5dfb55a8-936a-4cb9-a05d-ec682e37eca4 tempest-ProjectReaderTests-1988360028 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f3836a65-e521-402f-825d-956a3207eb23(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88719) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 30 20:42:08 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[74b454ca-9c53-4192-825d-0d6a48522098]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:42:08 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-5dfb55a8-936a-4cb9-a05d-ec682e37eca4 tempest-ProjectReaderTests-1988360028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f3836a65-e521-402f-825d-956a3207eb23 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:42:08 devstack sudo[108770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f3836a65-e521-402f-825d-956a3207eb23
Jul 30 20:42:08 devstack sudo[108770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:42:09 devstack sudo[108770]: pam_unix(sudo:session): session closed for user root
Jul 30 20:42:09 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-5dfb55a8-936a-4cb9-a05d-ec682e37eca4 tempest-ProjectReaderTests-1988360028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f3836a65-e521-402f-825d-956a3207eb23" returned: 0 in 0.366s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:42:09 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-5dfb55a8-936a-4cb9-a05d-ec682e37eca4 tempest-ProjectReaderTests-1988360028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f3836a65-e521-402f-825d-956a3207eb23.d92614f9-e4b1-4320-811f-693372f6a4fd {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:42:09 devstack sudo[108775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f3836a65-e521-402f-825d-956a3207eb23.d92614f9-e4b1-4320-811f-693372f6a4fd
Jul 30 20:42:09 devstack sudo[108775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:42:09 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-5623e5a1-2b0f-4ec2-af03-9fb6dc037e43 tempest-ProjectMemberTests-47051868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:42:09 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-5623e5a1-2b0f-4ec2-af03-9fb6dc037e43 tempest-ProjectMemberTests-47051868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:42:09 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-5623e5a1-2b0f-4ec2-af03-9fb6dc037e43 tempest-ProjectMemberTests-47051868 None] Creating offline snapshot f38684d3-9d08-495a-89ec-d5125a893fe3 of volume 252dc343-a43a-4f11-a45b-141873410735 {{(pid=88719) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 30 20:42:09 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[2de309a4-bdee-441f-b609-6ec9cabbc345]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:42:09 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-5623e5a1-2b0f-4ec2-af03-9fb6dc037e43 tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-252dc343-a43a-4f11-a45b-141873410735 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:42:09 devstack sudo[108777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-252dc343-a43a-4f11-a45b-141873410735
Jul 30 20:42:09 devstack sudo[108777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:42:09 devstack sudo[108775]: pam_unix(sudo:session): session closed for user root
Jul 30 20:42:09 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-5dfb55a8-936a-4cb9-a05d-ec682e37eca4 tempest-ProjectReaderTests-1988360028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f3836a65-e521-402f-825d-956a3207eb23.d92614f9-e4b1-4320-811f-693372f6a4fd" returned: 0 in 0.365s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:42:09 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-5dfb55a8-936a-4cb9-a05d-ec682e37eca4 tempest-ProjectReaderTests-1988360028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f3836a65-e521-402f-825d-956a3207eb23.d92614f9-e4b1-4320-811f-693372f6a4fd {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:42:09 devstack sudo[108782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f3836a65-e521-402f-825d-956a3207eb23.d92614f9-e4b1-4320-811f-693372f6a4fd
Jul 30 20:42:09 devstack sudo[108782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:42:09 devstack sudo[108777]: pam_unix(sudo:session): session closed for user root
Jul 30 20:42:09 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-5623e5a1-2b0f-4ec2-af03-9fb6dc037e43 tempest-ProjectMemberTests-47051868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-252dc343-a43a-4f11-a45b-141873410735" returned: 0 in 0.373s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:42:09 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-5623e5a1-2b0f-4ec2-af03-9fb6dc037e43 tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-252dc343-a43a-4f11-a45b-141873410735,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-252dc343-a43a-4f11-a45b-141873410735.f38684d3-9d08-495a-89ec-d5125a893fe3 1G {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:42:09 devstack sudo[108788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-252dc343-a43a-4f11-a45b-141873410735,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-252dc343-a43a-4f11-a45b-141873410735.f38684d3-9d08-495a-89ec-d5125a893fe3 1G
Jul 30 20:42:09 devstack sudo[108788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:42:09 devstack sudo[108782]: pam_unix(sudo:session): session closed for user root
Jul 30 20:42:09 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-5dfb55a8-936a-4cb9-a05d-ec682e37eca4 tempest-ProjectReaderTests-1988360028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f3836a65-e521-402f-825d-956a3207eb23.d92614f9-e4b1-4320-811f-693372f6a4fd" returned: 0 in 0.248s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:42:09 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-5dfb55a8-936a-4cb9-a05d-ec682e37eca4 tempest-ProjectReaderTests-1988360028 None] Lock "cinder-quobyte-d92614f9-e4b1-4320-811f-693372f6a4fd" released by "_delete_snapshot" :: held 1.423s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:42:09 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-5dfb55a8-936a-4cb9-a05d-ec682e37eca4 tempest-ProjectReaderTests-1988360028 None] Lock "cinder-quobyte-f3836a65-e521-402f-825d-956a3207eb23" released by "delete_snapshot" :: held 1.450s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:42:09 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-5dfb55a8-936a-4cb9-a05d-ec682e37eca4 tempest-ProjectReaderTests-1988360028 None] Created reservations ['a41c8a3b-cda6-4b50-9703-a8a66222bc07', '79d26bbc-f9e8-4f95-959f-7b385efa71ca', '868b1a7e-9d6b-41a8-8b20-15a30f4386bb', 'fb649867-25ec-4c9a-af96-bb2282200a9a'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:42:09 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-5dfb55a8-936a-4cb9-a05d-ec682e37eca4 tempest-ProjectReaderTests-1988360028 None] Delete snapshot completed successfully.
Jul 30 20:42:09 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-5dfb55a8-936a-4cb9-a05d-ec682e37eca4 tempest-ProjectReaderTests-1988360028 None] Lock "cinder-d92614f9-e4b1-4320-811f-693372f6a4fd-delete_snapshot" released by "delete_snapshot" :: held 1.614s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:42:10 devstack sudo[108788]: pam_unix(sudo:session): session closed for user root
Jul 30 20:42:10 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-5623e5a1-2b0f-4ec2-af03-9fb6dc037e43 tempest-ProjectMemberTests-47051868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-252dc343-a43a-4f11-a45b-141873410735,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-252dc343-a43a-4f11-a45b-141873410735.f38684d3-9d08-495a-89ec-d5125a893fe3 1G" returned: 0 in 0.407s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:42:10 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-5623e5a1-2b0f-4ec2-af03-9fb6dc037e43 tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-252dc343-a43a-4f11-a45b-141873410735 -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-252dc343-a43a-4f11-a45b-141873410735.f38684d3-9d08-495a-89ec-d5125a893fe3 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:42:10 devstack sudo[108793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-252dc343-a43a-4f11-a45b-141873410735 -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-252dc343-a43a-4f11-a45b-141873410735.f38684d3-9d08-495a-89ec-d5125a893fe3
Jul 30 20:42:10 devstack sudo[108793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:42:10 devstack sudo[108793]: pam_unix(sudo:session): session closed for user root
Jul 30 20:42:10 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-5623e5a1-2b0f-4ec2-af03-9fb6dc037e43 tempest-ProjectMemberTests-47051868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-252dc343-a43a-4f11-a45b-141873410735 -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-252dc343-a43a-4f11-a45b-141873410735.f38684d3-9d08-495a-89ec-d5125a893fe3" returned: 0 in 0.289s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:42:10 devstack cinder-volume[88719]: WARNING cinder.volume.drivers.remotefs [None req-5623e5a1-2b0f-4ec2-af03-9fb6dc037e43 tempest-ProjectMemberTests-47051868 None] /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-252dc343-a43a-4f11-a45b-141873410735.f38684d3-9d08-495a-89ec-d5125a893fe3 is being set with open permissions: ugo+rw
Jul 30 20:42:10 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-5623e5a1-2b0f-4ec2-af03-9fb6dc037e43 tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-252dc343-a43a-4f11-a45b-141873410735.f38684d3-9d08-495a-89ec-d5125a893fe3 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:42:10 devstack sudo[108798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-252dc343-a43a-4f11-a45b-141873410735.f38684d3-9d08-495a-89ec-d5125a893fe3
Jul 30 20:42:10 devstack sudo[108798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:42:10 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-d664f082-c986-41aa-a56e-c4e2aaf0c442 tempest-ProjectReaderTests-1988360028 None] Acquiring lock "cinder-f3836a65-e521-402f-825d-956a3207eb23-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:42:10 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-d664f082-c986-41aa-a56e-c4e2aaf0c442 tempest-ProjectReaderTests-1988360028 None] Lock "cinder-f3836a65-e521-402f-825d-956a3207eb23-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:42:10 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-d664f082-c986-41aa-a56e-c4e2aaf0c442 tempest-ProjectReaderTests-1988360028 None] Acquiring lock "cinder-quobyte-f3836a65-e521-402f-825d-956a3207eb23" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:42:10 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-d664f082-c986-41aa-a56e-c4e2aaf0c442 tempest-ProjectReaderTests-1988360028 None] Lock "cinder-quobyte-f3836a65-e521-402f-825d-956a3207eb23" acquired by "delete_volume" :: waited 0.020s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:42:10 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7b1d4a8-31a9-48b3-8a7e-3953e5cd092d]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:42:10 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-d664f082-c986-41aa-a56e-c4e2aaf0c442 tempest-ProjectReaderTests-1988360028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f3836a65-e521-402f-825d-956a3207eb23 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:42:10 devstack sudo[108798]: pam_unix(sudo:session): session closed for user root
Jul 30 20:42:10 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-5623e5a1-2b0f-4ec2-af03-9fb6dc037e43 tempest-ProjectMemberTests-47051868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-252dc343-a43a-4f11-a45b-141873410735.f38684d3-9d08-495a-89ec-d5125a893fe3" returned: 0 in 0.251s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:42:10 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-5623e5a1-2b0f-4ec2-af03-9fb6dc037e43 tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-252dc343-a43a-4f11-a45b-141873410735.info {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:42:10 devstack sudo[108800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f3836a65-e521-402f-825d-956a3207eb23
Jul 30 20:42:10 devstack sudo[108800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:42:10 devstack sudo[108802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-252dc343-a43a-4f11-a45b-141873410735.info
Jul 30 20:42:10 devstack sudo[108802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:42:10 devstack sudo[108802]: pam_unix(sudo:session): session closed for user root
Jul 30 20:42:10 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-5623e5a1-2b0f-4ec2-af03-9fb6dc037e43 tempest-ProjectMemberTests-47051868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-252dc343-a43a-4f11-a45b-141873410735.info" returned: 0 in 0.251s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:42:10 devstack cinder-volume[88719]: WARNING cinder.volume.drivers.remotefs [None req-5623e5a1-2b0f-4ec2-af03-9fb6dc037e43 tempest-ProjectMemberTests-47051868 None] /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-252dc343-a43a-4f11-a45b-141873410735.info is being set with open permissions: ugo+rw
Jul 30 20:42:10 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-5623e5a1-2b0f-4ec2-af03-9fb6dc037e43 tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-252dc343-a43a-4f11-a45b-141873410735.info {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:42:10 devstack sudo[108800]: pam_unix(sudo:session): session closed for user root
Jul 30 20:42:10 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-d664f082-c986-41aa-a56e-c4e2aaf0c442 tempest-ProjectReaderTests-1988360028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f3836a65-e521-402f-825d-956a3207eb23" returned: 0 in 0.362s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:42:10 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-d664f082-c986-41aa-a56e-c4e2aaf0c442 tempest-ProjectReaderTests-1988360028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f3836a65-e521-402f-825d-956a3207eb23 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:42:10 devstack sudo[108809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-252dc343-a43a-4f11-a45b-141873410735.info
Jul 30 20:42:10 devstack sudo[108809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:42:10 devstack sudo[108810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f3836a65-e521-402f-825d-956a3207eb23
Jul 30 20:42:11 devstack sudo[108810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:42:11 devstack sudo[108809]: pam_unix(sudo:session): session closed for user root
Jul 30 20:42:11 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-5623e5a1-2b0f-4ec2-af03-9fb6dc037e43 tempest-ProjectMemberTests-47051868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-252dc343-a43a-4f11-a45b-141873410735.info" returned: 0 in 0.246s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:42:11 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-5623e5a1-2b0f-4ec2-af03-9fb6dc037e43 tempest-ProjectMemberTests-47051868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.904s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:42:11 devstack sudo[108810]: pam_unix(sudo:session): session closed for user root
Jul 30 20:42:11 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-d664f082-c986-41aa-a56e-c4e2aaf0c442 tempest-ProjectReaderTests-1988360028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-f3836a65-e521-402f-825d-956a3207eb23" returned: 0 in 0.256s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:42:11 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-d664f082-c986-41aa-a56e-c4e2aaf0c442 tempest-ProjectReaderTests-1988360028 None] Lock "cinder-quobyte-f3836a65-e521-402f-825d-956a3207eb23" released by "delete_volume" :: held 0.682s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:42:11 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-5623e5a1-2b0f-4ec2-af03-9fb6dc037e43 tempest-ProjectMemberTests-47051868 None] Create snapshot completed successfully
Jul 30 20:42:11 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-d664f082-c986-41aa-a56e-c4e2aaf0c442 tempest-ProjectReaderTests-1988360028 None] Created reservations ['55f580bf-9083-4065-a83a-64228ab3efb7', '418d4b6b-3ccd-4dad-a36d-0c55c93bfda9', '2f8c72d1-c26b-465c-bc32-50b1d014e2c6', 'f8316153-2d24-4043-ac5c-14a131586723'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:42:11 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-d664f082-c986-41aa-a56e-c4e2aaf0c442 tempest-ProjectReaderTests-1988360028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:42:11 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-d664f082-c986-41aa-a56e-c4e2aaf0c442 tempest-ProjectReaderTests-1988360028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:42:11 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-d664f082-c986-41aa-a56e-c4e2aaf0c442 tempest-ProjectReaderTests-1988360028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:42:11 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-d664f082-c986-41aa-a56e-c4e2aaf0c442 tempest-ProjectReaderTests-1988360028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:42:11 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-d664f082-c986-41aa-a56e-c4e2aaf0c442 tempest-ProjectReaderTests-1988360028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:42:11 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-d664f082-c986-41aa-a56e-c4e2aaf0c442 tempest-ProjectReaderTests-1988360028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:42:11 devstack sudo[108815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:42:11 devstack sudo[108815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:42:11 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-e5b25fb9-3d6d-46e1-ae8a-f9fb44631d2e tempest-ProjectMemberTests-47051868 None] Acquiring lock "cinder-f38684d3-9d08-495a-89ec-d5125a893fe3-delete_snapshot" by "delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:42:11 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-e5b25fb9-3d6d-46e1-ae8a-f9fb44631d2e tempest-ProjectMemberTests-47051868 None] Lock "cinder-f38684d3-9d08-495a-89ec-d5125a893fe3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:42:11 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-e5b25fb9-3d6d-46e1-ae8a-f9fb44631d2e tempest-ProjectMemberTests-47051868 None] Acquiring lock "cinder-quobyte-252dc343-a43a-4f11-a45b-141873410735" by "delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:42:11 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-e5b25fb9-3d6d-46e1-ae8a-f9fb44631d2e tempest-ProjectMemberTests-47051868 None] Lock "cinder-quobyte-252dc343-a43a-4f11-a45b-141873410735" acquired by "delete_snapshot" :: waited 0.014s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:42:11 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-e5b25fb9-3d6d-46e1-ae8a-f9fb44631d2e tempest-ProjectMemberTests-47051868 None] Acquiring lock "cinder-quobyte-f38684d3-9d08-495a-89ec-d5125a893fe3" by "_delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:42:11 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-e5b25fb9-3d6d-46e1-ae8a-f9fb44631d2e tempest-ProjectMemberTests-47051868 None] Lock "cinder-quobyte-f38684d3-9d08-495a-89ec-d5125a893fe3" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:42:11 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-e5b25fb9-3d6d-46e1-ae8a-f9fb44631d2e tempest-ProjectMemberTests-47051868 None] Deleting offline snapshot f38684d3-9d08-495a-89ec-d5125a893fe3 of volume 252dc343-a43a-4f11-a45b-141873410735 {{(pid=88719) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 30 20:42:11 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-e5b25fb9-3d6d-46e1-ae8a-f9fb44631d2e tempest-ProjectMemberTests-47051868 None] snapshot_file for this snap is: volume-252dc343-a43a-4f11-a45b-141873410735.f38684d3-9d08-495a-89ec-d5125a893fe3 {{(pid=88719) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 30 20:42:11 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[849956b8-a5f7-4dc4-a461-1d81dba7b93c]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:42:11 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-e5b25fb9-3d6d-46e1-ae8a-f9fb44631d2e tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-252dc343-a43a-4f11-a45b-141873410735.f38684d3-9d08-495a-89ec-d5125a893fe3 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:42:11 devstack sudo[108815]: pam_unix(sudo:session): session closed for user root
Jul 30 20:42:11 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-d664f082-c986-41aa-a56e-c4e2aaf0c442 tempest-ProjectReaderTests-1988360028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.268s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:42:11 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-d664f082-c986-41aa-a56e-c4e2aaf0c442 tempest-ProjectReaderTests-1988360028 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:42:11 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-d664f082-c986-41aa-a56e-c4e2aaf0c442 tempest-ProjectReaderTests-1988360028 None] Deleted volume successfully.
Jul 30 20:42:11 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-d664f082-c986-41aa-a56e-c4e2aaf0c442 tempest-ProjectReaderTests-1988360028 None] Lock "cinder-f3836a65-e521-402f-825d-956a3207eb23-delete_volume" released by "delete_volume" :: held 1.164s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:42:11 devstack sudo[108818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-252dc343-a43a-4f11-a45b-141873410735.f38684d3-9d08-495a-89ec-d5125a893fe3
Jul 30 20:42:11 devstack sudo[108818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:42:12 devstack sudo[108818]: pam_unix(sudo:session): session closed for user root
Jul 30 20:42:12 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-e5b25fb9-3d6d-46e1-ae8a-f9fb44631d2e tempest-ProjectMemberTests-47051868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-252dc343-a43a-4f11-a45b-141873410735.f38684d3-9d08-495a-89ec-d5125a893fe3" returned: 0 in 0.409s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:42:12 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-e5b25fb9-3d6d-46e1-ae8a-f9fb44631d2e tempest-ProjectMemberTests-47051868 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-252dc343-a43a-4f11-a45b-141873410735(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88719) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 30 20:42:12 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c5e7d88-64a3-4e0b-bca9-a55e6d729839]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:42:12 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-e5b25fb9-3d6d-46e1-ae8a-f9fb44631d2e tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-252dc343-a43a-4f11-a45b-141873410735 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:42:12 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-561ffa1f-57d4-4ef0-b1a4-ae120f6037f2 tempest-ProjectReaderTests-1988360028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:42:12 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-561ffa1f-57d4-4ef0-b1a4-ae120f6037f2 tempest-ProjectReaderTests-1988360028 None] Flow 'volume_create_manager' (8c3ad054-0b2d-4bfd-bf08-44d9d647c57a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:42:12 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-561ffa1f-57d4-4ef0-b1a4-ae120f6037f2 tempest-ProjectReaderTests-1988360028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (749cd63b-89b7-48a4-ae2c-650f8ee643e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:42:12 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-561ffa1f-57d4-4ef0-b1a4-ae120f6037f2 tempest-ProjectReaderTests-1988360028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (749cd63b-89b7-48a4-ae2c-650f8ee643e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:42:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1464030548',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e32d4be-e41b-41b7-b660-c6a659662023,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7b0c78c72fa4b7da70731a275a24f3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:42:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:42:12Z,use_quota=True,user_id='66f5ff347f4541e383a978346a7ec5a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:42:12 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-561ffa1f-57d4-4ef0-b1a4-ae120f6037f2 tempest-ProjectReaderTests-1988360028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd1cbff9-728a-46c2-9de8-3a1d913499fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:42:12 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-561ffa1f-57d4-4ef0-b1a4-ae120f6037f2 tempest-ProjectReaderTests-1988360028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd1cbff9-728a-46c2-9de8-3a1d913499fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:42:12 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-561ffa1f-57d4-4ef0-b1a4-ae120f6037f2 tempest-ProjectReaderTests-1988360028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (872cecb8-000c-4448-9e4a-b39e65bd4bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:42:12 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-561ffa1f-57d4-4ef0-b1a4-ae120f6037f2 tempest-ProjectReaderTests-1988360028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (872cecb8-000c-4448-9e4a-b39e65bd4bd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e32d4be-e41b-41b7-b660-c6a659662023', 'volume_name': 'volume-9e32d4be-e41b-41b7-b660-c6a659662023', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:42:12 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-561ffa1f-57d4-4ef0-b1a4-ae120f6037f2 tempest-ProjectReaderTests-1988360028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7f5b7e4-f25f-495e-86b5-de295ba30768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:42:12 devstack sudo[108823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-252dc343-a43a-4f11-a45b-141873410735
Jul 30 20:42:12 devstack sudo[108823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:42:12 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-561ffa1f-57d4-4ef0-b1a4-ae120f6037f2 tempest-ProjectReaderTests-1988360028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7f5b7e4-f25f-495e-86b5-de295ba30768) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:42:12 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-561ffa1f-57d4-4ef0-b1a4-ae120f6037f2 tempest-ProjectReaderTests-1988360028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69a2b11f-d6cc-4e04-9217-8f0873aefc7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:42:12 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-561ffa1f-57d4-4ef0-b1a4-ae120f6037f2 tempest-ProjectReaderTests-1988360028 None] Volume 9e32d4be-e41b-41b7-b660-c6a659662023: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e32d4be-e41b-41b7-b660-c6a659662023', 'volume_size': 1}
Jul 30 20:42:12 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-561ffa1f-57d4-4ef0-b1a4-ae120f6037f2 tempest-ProjectReaderTests-1988360028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:42:12 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-561ffa1f-57d4-4ef0-b1a4-ae120f6037f2 tempest-ProjectReaderTests-1988360028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:42:12 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-561ffa1f-57d4-4ef0-b1a4-ae120f6037f2 tempest-ProjectReaderTests-1988360028 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:42:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1464030548',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e32d4be-e41b-41b7-b660-c6a659662023,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7b0c78c72fa4b7da70731a275a24f3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:42:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:42:12Z,use_quota=True,user_id='66f5ff347f4541e383a978346a7ec5a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:42:12 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-561ffa1f-57d4-4ef0-b1a4-ae120f6037f2 tempest-ProjectReaderTests-1988360028 None] Creating volume 9e32d4be-e41b-41b7-b660-c6a659662023 {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:42:12 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-561ffa1f-57d4-4ef0-b1a4-ae120f6037f2 tempest-ProjectReaderTests-1988360028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:42:12 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-561ffa1f-57d4-4ef0-b1a4-ae120f6037f2 tempest-ProjectReaderTests-1988360028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:42:12 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-561ffa1f-57d4-4ef0-b1a4-ae120f6037f2 tempest-ProjectReaderTests-1988360028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:42:12 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-561ffa1f-57d4-4ef0-b1a4-ae120f6037f2 tempest-ProjectReaderTests-1988360028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:42:12 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-561ffa1f-57d4-4ef0-b1a4-ae120f6037f2 tempest-ProjectReaderTests-1988360028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:42:12 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-561ffa1f-57d4-4ef0-b1a4-ae120f6037f2 tempest-ProjectReaderTests-1988360028 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:42:12 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-561ffa1f-57d4-4ef0-b1a4-ae120f6037f2 tempest-ProjectReaderTests-1988360028 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:42:12 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-561ffa1f-57d4-4ef0-b1a4-ae120f6037f2 tempest-ProjectReaderTests-1988360028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-9e32d4be-e41b-41b7-b660-c6a659662023 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:42:12 devstack sudo[108825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-9e32d4be-e41b-41b7-b660-c6a659662023 1073741824
Jul 30 20:42:12 devstack sudo[108825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:42:12 devstack sudo[108823]: pam_unix(sudo:session): session closed for user root
Jul 30 20:42:12 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-e5b25fb9-3d6d-46e1-ae8a-f9fb44631d2e tempest-ProjectMemberTests-47051868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-252dc343-a43a-4f11-a45b-141873410735" returned: 0 in 0.375s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:42:12 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-e5b25fb9-3d6d-46e1-ae8a-f9fb44631d2e tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-252dc343-a43a-4f11-a45b-141873410735.f38684d3-9d08-495a-89ec-d5125a893fe3 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:42:12 devstack sudo[108833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-252dc343-a43a-4f11-a45b-141873410735.f38684d3-9d08-495a-89ec-d5125a893fe3
Jul 30 20:42:12 devstack sudo[108833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:42:12 devstack sudo[108825]: pam_unix(sudo:session): session closed for user root
Jul 30 20:42:12 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-561ffa1f-57d4-4ef0-b1a4-ae120f6037f2 tempest-ProjectReaderTests-1988360028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-9e32d4be-e41b-41b7-b660-c6a659662023 1073741824" returned: 0 in 0.430s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:42:12 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-561ffa1f-57d4-4ef0-b1a4-ae120f6037f2 tempest-ProjectReaderTests-1988360028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-9e32d4be-e41b-41b7-b660-c6a659662023 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:42:12 devstack sudo[108839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-9e32d4be-e41b-41b7-b660-c6a659662023
Jul 30 20:42:12 devstack sudo[108839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:42:12 devstack sudo[108833]: pam_unix(sudo:session): session closed for user root
Jul 30 20:42:12 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-e5b25fb9-3d6d-46e1-ae8a-f9fb44631d2e tempest-ProjectMemberTests-47051868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-252dc343-a43a-4f11-a45b-141873410735.f38684d3-9d08-495a-89ec-d5125a893fe3" returned: 0 in 0.352s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:42:12 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-e5b25fb9-3d6d-46e1-ae8a-f9fb44631d2e tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-252dc343-a43a-4f11-a45b-141873410735.f38684d3-9d08-495a-89ec-d5125a893fe3 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:42:12 devstack sudo[108842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-252dc343-a43a-4f11-a45b-141873410735.f38684d3-9d08-495a-89ec-d5125a893fe3
Jul 30 20:42:12 devstack sudo[108842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:42:12 devstack sudo[108839]: pam_unix(sudo:session): session closed for user root
Jul 30 20:42:12 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-561ffa1f-57d4-4ef0-b1a4-ae120f6037f2 tempest-ProjectReaderTests-1988360028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-9e32d4be-e41b-41b7-b660-c6a659662023" returned: 0 in 0.262s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:42:12 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-561ffa1f-57d4-4ef0-b1a4-ae120f6037f2 tempest-ProjectReaderTests-1988360028 None] <== create_volume: return (737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:42:12 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-561ffa1f-57d4-4ef0-b1a4-ae120f6037f2 tempest-ProjectReaderTests-1988360028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.741s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:42:12 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-561ffa1f-57d4-4ef0-b1a4-ae120f6037f2 tempest-ProjectReaderTests-1988360028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69a2b11f-d6cc-4e04-9217-8f0873aefc7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e32d4be-e41b-41b7-b660-c6a659662023', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:42:12 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-561ffa1f-57d4-4ef0-b1a4-ae120f6037f2 tempest-ProjectReaderTests-1988360028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80e409b3-4707-455b-a9ba-c60822d1add7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:42:12 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-561ffa1f-57d4-4ef0-b1a4-ae120f6037f2 tempest-ProjectReaderTests-1988360028 None] Volume volume-9e32d4be-e41b-41b7-b660-c6a659662023 (9e32d4be-e41b-41b7-b660-c6a659662023): created successfully
Jul 30 20:42:12 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-561ffa1f-57d4-4ef0-b1a4-ae120f6037f2 tempest-ProjectReaderTests-1988360028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80e409b3-4707-455b-a9ba-c60822d1add7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:42:12 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-561ffa1f-57d4-4ef0-b1a4-ae120f6037f2 tempest-ProjectReaderTests-1988360028 None] Flow 'volume_create_manager' (8c3ad054-0b2d-4bfd-bf08-44d9d647c57a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:42:12 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-561ffa1f-57d4-4ef0-b1a4-ae120f6037f2 tempest-ProjectReaderTests-1988360028 None] Created volume successfully.
Jul 30 20:42:13 devstack sudo[108842]: pam_unix(sudo:session): session closed for user root
Jul 30 20:42:13 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-e5b25fb9-3d6d-46e1-ae8a-f9fb44631d2e tempest-ProjectMemberTests-47051868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-252dc343-a43a-4f11-a45b-141873410735.f38684d3-9d08-495a-89ec-d5125a893fe3" returned: 0 in 0.260s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:42:13 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-e5b25fb9-3d6d-46e1-ae8a-f9fb44631d2e tempest-ProjectMemberTests-47051868 None] Lock "cinder-quobyte-f38684d3-9d08-495a-89ec-d5125a893fe3" released by "_delete_snapshot" :: held 1.504s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:42:13 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-e5b25fb9-3d6d-46e1-ae8a-f9fb44631d2e tempest-ProjectMemberTests-47051868 None] Lock "cinder-quobyte-252dc343-a43a-4f11-a45b-141873410735" released by "delete_snapshot" :: held 1.530s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:42:13 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-e5b25fb9-3d6d-46e1-ae8a-f9fb44631d2e tempest-ProjectMemberTests-47051868 None] Created reservations ['6674d707-7e8b-4174-ab7d-d1f0984637a5', 'd45a6700-3936-477b-97dd-dafef4792f87', '176f3416-69db-47cd-a6c5-c8347b46726e', 'c6087847-b90b-4272-a5c9-372feec29a85'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:42:13 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-e5b25fb9-3d6d-46e1-ae8a-f9fb44631d2e tempest-ProjectMemberTests-47051868 None] Delete snapshot completed successfully.
Jul 30 20:42:13 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-e5b25fb9-3d6d-46e1-ae8a-f9fb44631d2e tempest-ProjectMemberTests-47051868 None] Lock "cinder-f38684d3-9d08-495a-89ec-d5125a893fe3-delete_snapshot" released by "delete_snapshot" :: held 1.669s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:42:13 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-c94b9b58-0bfd-491e-8fa2-20b9f8dd59ca tempest-ProjectReaderTests-1988360028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:42:13 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-c94b9b58-0bfd-491e-8fa2-20b9f8dd59ca tempest-ProjectReaderTests-1988360028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:42:13 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-c94b9b58-0bfd-491e-8fa2-20b9f8dd59ca tempest-ProjectReaderTests-1988360028 None] Creating offline snapshot 2a867677-d364-4a14-ab3f-289e2df2c1f4 of volume 9e32d4be-e41b-41b7-b660-c6a659662023 {{(pid=88719) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 30 20:42:13 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f486174-c2ff-41db-8e7a-f2ac4c3168be]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:42:13 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-c94b9b58-0bfd-491e-8fa2-20b9f8dd59ca tempest-ProjectReaderTests-1988360028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-9e32d4be-e41b-41b7-b660-c6a659662023 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:42:13 devstack sudo[108846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-9e32d4be-e41b-41b7-b660-c6a659662023
Jul 30 20:42:13 devstack sudo[108846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:42:13 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-7a4b3598-94b7-41a1-b2e9-41cad345f693 tempest-ProjectMemberTests-47051868 None] Acquiring lock "cinder-252dc343-a43a-4f11-a45b-141873410735-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:42:13 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-7a4b3598-94b7-41a1-b2e9-41cad345f693 tempest-ProjectMemberTests-47051868 None] Lock "cinder-252dc343-a43a-4f11-a45b-141873410735-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:42:13 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-7a4b3598-94b7-41a1-b2e9-41cad345f693 tempest-ProjectMemberTests-47051868 None] Acquiring lock "cinder-quobyte-252dc343-a43a-4f11-a45b-141873410735" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:42:13 devstack sudo[108846]: pam_unix(sudo:session): session closed for user root
Jul 30 20:42:13 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-c94b9b58-0bfd-491e-8fa2-20b9f8dd59ca tempest-ProjectReaderTests-1988360028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-9e32d4be-e41b-41b7-b660-c6a659662023" returned: 0 in 0.383s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:42:13 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-c94b9b58-0bfd-491e-8fa2-20b9f8dd59ca tempest-ProjectReaderTests-1988360028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-9e32d4be-e41b-41b7-b660-c6a659662023,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-9e32d4be-e41b-41b7-b660-c6a659662023.2a867677-d364-4a14-ab3f-289e2df2c1f4 1G {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:42:13 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-7a4b3598-94b7-41a1-b2e9-41cad345f693 tempest-ProjectMemberTests-47051868 None] Lock "cinder-quobyte-252dc343-a43a-4f11-a45b-141873410735" acquired by "delete_volume" :: waited 0.028s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:42:13 devstack sudo[108851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-9e32d4be-e41b-41b7-b660-c6a659662023,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-9e32d4be-e41b-41b7-b660-c6a659662023.2a867677-d364-4a14-ab3f-289e2df2c1f4 1G
Jul 30 20:42:13 devstack sudo[108851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:42:13 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b07288f-b368-4d09-8618-50dd8ad5e9d7]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:42:13 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-7a4b3598-94b7-41a1-b2e9-41cad345f693 tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-252dc343-a43a-4f11-a45b-141873410735 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:42:13 devstack sudo[108853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-252dc343-a43a-4f11-a45b-141873410735
Jul 30 20:42:13 devstack sudo[108853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:42:14 devstack sudo[108851]: pam_unix(sudo:session): session closed for user root
Jul 30 20:42:14 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-c94b9b58-0bfd-491e-8fa2-20b9f8dd59ca tempest-ProjectReaderTests-1988360028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-9e32d4be-e41b-41b7-b660-c6a659662023,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-9e32d4be-e41b-41b7-b660-c6a659662023.2a867677-d364-4a14-ab3f-289e2df2c1f4 1G" returned: 0 in 0.417s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:42:14 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-c94b9b58-0bfd-491e-8fa2-20b9f8dd59ca tempest-ProjectReaderTests-1988360028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e32d4be-e41b-41b7-b660-c6a659662023 -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-9e32d4be-e41b-41b7-b660-c6a659662023.2a867677-d364-4a14-ab3f-289e2df2c1f4 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:42:14 devstack sudo[108853]: pam_unix(sudo:session): session closed for user root
Jul 30 20:42:14 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-7a4b3598-94b7-41a1-b2e9-41cad345f693 tempest-ProjectMemberTests-47051868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-252dc343-a43a-4f11-a45b-141873410735" returned: 0 in 0.370s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:42:14 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-7a4b3598-94b7-41a1-b2e9-41cad345f693 tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-252dc343-a43a-4f11-a45b-141873410735 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:42:14 devstack sudo[108862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e32d4be-e41b-41b7-b660-c6a659662023 -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-9e32d4be-e41b-41b7-b660-c6a659662023.2a867677-d364-4a14-ab3f-289e2df2c1f4
Jul 30 20:42:14 devstack sudo[108862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:42:14 devstack sudo[108863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-252dc343-a43a-4f11-a45b-141873410735
Jul 30 20:42:14 devstack sudo[108863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:42:14 devstack sudo[108863]: pam_unix(sudo:session): session closed for user root
Jul 30 20:42:14 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-7a4b3598-94b7-41a1-b2e9-41cad345f693 tempest-ProjectMemberTests-47051868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-252dc343-a43a-4f11-a45b-141873410735" returned: 0 in 0.265s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:42:14 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-7a4b3598-94b7-41a1-b2e9-41cad345f693 tempest-ProjectMemberTests-47051868 None] Lock "cinder-quobyte-252dc343-a43a-4f11-a45b-141873410735" released by "delete_volume" :: held 0.704s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:42:14 devstack sudo[108862]: pam_unix(sudo:session): session closed for user root
Jul 30 20:42:14 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-c94b9b58-0bfd-491e-8fa2-20b9f8dd59ca tempest-ProjectReaderTests-1988360028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e32d4be-e41b-41b7-b660-c6a659662023 -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-9e32d4be-e41b-41b7-b660-c6a659662023.2a867677-d364-4a14-ab3f-289e2df2c1f4" returned: 0 in 0.308s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:42:14 devstack cinder-volume[88719]: WARNING cinder.volume.drivers.remotefs [None req-c94b9b58-0bfd-491e-8fa2-20b9f8dd59ca tempest-ProjectReaderTests-1988360028 None] /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-9e32d4be-e41b-41b7-b660-c6a659662023.2a867677-d364-4a14-ab3f-289e2df2c1f4 is being set with open permissions: ugo+rw
Jul 30 20:42:14 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-c94b9b58-0bfd-491e-8fa2-20b9f8dd59ca tempest-ProjectReaderTests-1988360028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-9e32d4be-e41b-41b7-b660-c6a659662023.2a867677-d364-4a14-ab3f-289e2df2c1f4 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:42:14 devstack sudo[108870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-9e32d4be-e41b-41b7-b660-c6a659662023.2a867677-d364-4a14-ab3f-289e2df2c1f4
Jul 30 20:42:14 devstack sudo[108870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:42:14 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-7a4b3598-94b7-41a1-b2e9-41cad345f693 tempest-ProjectMemberTests-47051868 None] Created reservations ['be0676c9-8df0-45e0-b177-980256a042cd', '3079e942-30b9-46d5-be15-59dc13996e27', 'b69ae399-c572-4bae-9e57-795b2a5d7e08', '839d7704-f77e-432b-9ae3-755cbea6e17f'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:42:14 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-7a4b3598-94b7-41a1-b2e9-41cad345f693 tempest-ProjectMemberTests-47051868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:42:14 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-7a4b3598-94b7-41a1-b2e9-41cad345f693 tempest-ProjectMemberTests-47051868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:42:14 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-7a4b3598-94b7-41a1-b2e9-41cad345f693 tempest-ProjectMemberTests-47051868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:42:14 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-7a4b3598-94b7-41a1-b2e9-41cad345f693 tempest-ProjectMemberTests-47051868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:42:14 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-7a4b3598-94b7-41a1-b2e9-41cad345f693 tempest-ProjectMemberTests-47051868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:42:14 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-7a4b3598-94b7-41a1-b2e9-41cad345f693 tempest-ProjectMemberTests-47051868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:42:14 devstack sudo[108872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:42:14 devstack sudo[108872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:42:14 devstack sudo[108870]: pam_unix(sudo:session): session closed for user root
Jul 30 20:42:14 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-c94b9b58-0bfd-491e-8fa2-20b9f8dd59ca tempest-ProjectReaderTests-1988360028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-9e32d4be-e41b-41b7-b660-c6a659662023.2a867677-d364-4a14-ab3f-289e2df2c1f4" returned: 0 in 0.247s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:42:14 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-c94b9b58-0bfd-491e-8fa2-20b9f8dd59ca tempest-ProjectReaderTests-1988360028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-9e32d4be-e41b-41b7-b660-c6a659662023.info {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:42:14 devstack sudo[108875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-9e32d4be-e41b-41b7-b660-c6a659662023.info
Jul 30 20:42:14 devstack sudo[108875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:42:14 devstack sudo[108872]: pam_unix(sudo:session): session closed for user root
Jul 30 20:42:14 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-7a4b3598-94b7-41a1-b2e9-41cad345f693 tempest-ProjectMemberTests-47051868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.257s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:42:14 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-7a4b3598-94b7-41a1-b2e9-41cad345f693 tempest-ProjectMemberTests-47051868 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:42:14 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-7a4b3598-94b7-41a1-b2e9-41cad345f693 tempest-ProjectMemberTests-47051868 None] Deleted volume successfully.
Jul 30 20:42:14 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-7a4b3598-94b7-41a1-b2e9-41cad345f693 tempest-ProjectMemberTests-47051868 None] Lock "cinder-252dc343-a43a-4f11-a45b-141873410735-delete_volume" released by "delete_volume" :: held 1.184s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:42:15 devstack sudo[108875]: pam_unix(sudo:session): session closed for user root
Jul 30 20:42:15 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-c94b9b58-0bfd-491e-8fa2-20b9f8dd59ca tempest-ProjectReaderTests-1988360028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-9e32d4be-e41b-41b7-b660-c6a659662023.info" returned: 0 in 0.258s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:42:15 devstack cinder-volume[88719]: WARNING cinder.volume.drivers.remotefs [None req-c94b9b58-0bfd-491e-8fa2-20b9f8dd59ca tempest-ProjectReaderTests-1988360028 None] /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-9e32d4be-e41b-41b7-b660-c6a659662023.info is being set with open permissions: ugo+rw
Jul 30 20:42:15 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-c94b9b58-0bfd-491e-8fa2-20b9f8dd59ca tempest-ProjectReaderTests-1988360028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-9e32d4be-e41b-41b7-b660-c6a659662023.info {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:42:15 devstack sudo[108879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-9e32d4be-e41b-41b7-b660-c6a659662023.info
Jul 30 20:42:15 devstack sudo[108879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:42:15 devstack sudo[108879]: pam_unix(sudo:session): session closed for user root
Jul 30 20:42:15 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-c94b9b58-0bfd-491e-8fa2-20b9f8dd59ca tempest-ProjectReaderTests-1988360028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-9e32d4be-e41b-41b7-b660-c6a659662023.info" returned: 0 in 0.248s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:42:15 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-c94b9b58-0bfd-491e-8fa2-20b9f8dd59ca tempest-ProjectReaderTests-1988360028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.989s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:42:15 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-c94b9b58-0bfd-491e-8fa2-20b9f8dd59ca tempest-ProjectReaderTests-1988360028 None] Create snapshot completed successfully
Jul 30 20:42:15 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-dd94d043-1f54-415f-98a8-f13a0d002eff tempest-ProjectReaderTests-1988360028 None] Acquiring lock "cinder-2a867677-d364-4a14-ab3f-289e2df2c1f4-delete_snapshot" by "delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:42:15 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-dd94d043-1f54-415f-98a8-f13a0d002eff tempest-ProjectReaderTests-1988360028 None] Lock "cinder-2a867677-d364-4a14-ab3f-289e2df2c1f4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:42:15 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-dd94d043-1f54-415f-98a8-f13a0d002eff tempest-ProjectReaderTests-1988360028 None] Acquiring lock "cinder-quobyte-9e32d4be-e41b-41b7-b660-c6a659662023" by "delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:42:15 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-dd94d043-1f54-415f-98a8-f13a0d002eff tempest-ProjectReaderTests-1988360028 None] Lock "cinder-quobyte-9e32d4be-e41b-41b7-b660-c6a659662023" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:42:15 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-dd94d043-1f54-415f-98a8-f13a0d002eff tempest-ProjectReaderTests-1988360028 None] Acquiring lock "cinder-quobyte-2a867677-d364-4a14-ab3f-289e2df2c1f4" by "_delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:42:15 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-dd94d043-1f54-415f-98a8-f13a0d002eff tempest-ProjectReaderTests-1988360028 None] Lock "cinder-quobyte-2a867677-d364-4a14-ab3f-289e2df2c1f4" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:42:15 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-dd94d043-1f54-415f-98a8-f13a0d002eff tempest-ProjectReaderTests-1988360028 None] Deleting offline snapshot 2a867677-d364-4a14-ab3f-289e2df2c1f4 of volume 9e32d4be-e41b-41b7-b660-c6a659662023 {{(pid=88719) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 30 20:42:15 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-dd94d043-1f54-415f-98a8-f13a0d002eff tempest-ProjectReaderTests-1988360028 None] snapshot_file for this snap is: volume-9e32d4be-e41b-41b7-b660-c6a659662023.2a867677-d364-4a14-ab3f-289e2df2c1f4 {{(pid=88719) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 30 20:42:15 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[407c0aba-b6b5-4dda-8194-9c0a3dc7fb0d]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:42:15 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-dd94d043-1f54-415f-98a8-f13a0d002eff tempest-ProjectReaderTests-1988360028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-9e32d4be-e41b-41b7-b660-c6a659662023.2a867677-d364-4a14-ab3f-289e2df2c1f4 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:42:15 devstack sudo[108883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-9e32d4be-e41b-41b7-b660-c6a659662023.2a867677-d364-4a14-ab3f-289e2df2c1f4
Jul 30 20:42:15 devstack sudo[108883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:42:15 devstack sudo[108883]: pam_unix(sudo:session): session closed for user root
Jul 30 20:42:15 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-dd94d043-1f54-415f-98a8-f13a0d002eff tempest-ProjectReaderTests-1988360028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-9e32d4be-e41b-41b7-b660-c6a659662023.2a867677-d364-4a14-ab3f-289e2df2c1f4" returned: 0 in 0.403s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:42:15 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-dd94d043-1f54-415f-98a8-f13a0d002eff tempest-ProjectReaderTests-1988360028 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e32d4be-e41b-41b7-b660-c6a659662023(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88719) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 30 20:42:15 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef400df3-d4c1-4d60-b6cf-864cb59ca151]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:42:15 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-dd94d043-1f54-415f-98a8-f13a0d002eff tempest-ProjectReaderTests-1988360028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-9e32d4be-e41b-41b7-b660-c6a659662023 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:42:16 devstack sudo[108888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-9e32d4be-e41b-41b7-b660-c6a659662023
Jul 30 20:42:16 devstack sudo[108888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:42:16 devstack sudo[108888]: pam_unix(sudo:session): session closed for user root
Jul 30 20:42:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-dd94d043-1f54-415f-98a8-f13a0d002eff tempest-ProjectReaderTests-1988360028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-9e32d4be-e41b-41b7-b660-c6a659662023" returned: 0 in 0.415s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:42:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-dd94d043-1f54-415f-98a8-f13a0d002eff tempest-ProjectReaderTests-1988360028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-9e32d4be-e41b-41b7-b660-c6a659662023.2a867677-d364-4a14-ab3f-289e2df2c1f4 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:42:16 devstack sudo[108894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-9e32d4be-e41b-41b7-b660-c6a659662023.2a867677-d364-4a14-ab3f-289e2df2c1f4
Jul 30 20:42:16 devstack sudo[108894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:42:16 devstack cinder-volume[88719]: DEBUG oslo_service.periodic_task [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88719) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 30 20:42:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:42:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:42:16 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:42:16 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:42:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:42:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:42:16 devstack sudo[108896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:42:16 devstack sudo[108896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:42:16 devstack sudo[108894]: pam_unix(sudo:session): session closed for user root
Jul 30 20:42:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-dd94d043-1f54-415f-98a8-f13a0d002eff tempest-ProjectReaderTests-1988360028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-9e32d4be-e41b-41b7-b660-c6a659662023.2a867677-d364-4a14-ab3f-289e2df2c1f4" returned: 0 in 0.391s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:42:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-dd94d043-1f54-415f-98a8-f13a0d002eff tempest-ProjectReaderTests-1988360028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-9e32d4be-e41b-41b7-b660-c6a659662023.2a867677-d364-4a14-ab3f-289e2df2c1f4 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:42:16 devstack sudo[108896]: pam_unix(sudo:session): session closed for user root
Jul 30 20:42:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.283s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:42:16 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:42:16 devstack cinder-volume[88719]: DEBUG oslo_service.periodic_task [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Running periodic task VolumeManager._thread_info {{(pid=88719) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 30 20:42:16 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] thread count: 28 {{(pid=88719) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 30 20:42:16 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] thread info: [<_MainThread(MainThread, started 132390416908416)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132390306497536)>, <Thread(Thread-3 (stat_writer), started daemon 132390304471680)>, <Thread(Rabbit-heartbeat, started daemon 132390303393408)>, <Thread(Thread-5 (_runner), started daemon 132390303543168)>, <Thread(Thread-7 (_runner), started daemon 132390303563392)>, <Thread(fd_logger, started daemon 132390301344640)>, <Thread(privsep_reader, started daemon 132390301560640)>, <Thread(tpool_thread_0, started daemon 132390291470016)>, <Thread(tpool_thread_1, started daemon 132390283077312)>, <Thread(tpool_thread_2, started daemon 132390274684608)>, <Thread(tpool_thread_3, started daemon 132390266291904)>, <Thread(tpool_thread_4, started daemon 132390257899200)>, <Thread(tpool_thread_5, started daemon 132390249506496)>, <Thread(tpool_thread_6, started daemon 132390241113792)>, <Thread(tpool_thread_7, started daemon 132390232721088)>, <Thread(tpool_thread_8, started daemon 132390224328384)>, <Thread(tpool_thread_9, started daemon 132390215919296)>, <Thread(tpool_thread_10, started daemon 132390207510208)>, <Thread(tpool_thread_11, started daemon 132390199101120)>, <Thread(tpool_thread_12, started daemon 132390190692032)>, <Thread(tpool_thread_13, started daemon 132390182282944)>, <Thread(tpool_thread_14, started daemon 132390173873856)>, <Thread(tpool_thread_15, started daemon 132390165464768)>, <Thread(tpool_thread_16, started daemon 132390157055680)>, <Thread(tpool_thread_17, started daemon 132390148646592)>, <Thread(tpool_thread_18, started daemon 132390140237504)>, <Thread(tpool_thread_19, started daemon 132390131828416)>] {{(pid=88719) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 30 20:42:16 devstack sudo[108903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-9e32d4be-e41b-41b7-b660-c6a659662023.2a867677-d364-4a14-ab3f-289e2df2c1f4
Jul 30 20:42:16 devstack sudo[108903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:42:17 devstack sudo[108903]: pam_unix(sudo:session): session closed for user root
Jul 30 20:42:17 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-dd94d043-1f54-415f-98a8-f13a0d002eff tempest-ProjectReaderTests-1988360028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-9e32d4be-e41b-41b7-b660-c6a659662023.2a867677-d364-4a14-ab3f-289e2df2c1f4" returned: 0 in 0.265s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:42:17 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-dd94d043-1f54-415f-98a8-f13a0d002eff tempest-ProjectReaderTests-1988360028 None] Lock "cinder-quobyte-2a867677-d364-4a14-ab3f-289e2df2c1f4" released by "_delete_snapshot" :: held 1.571s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:42:17 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-dd94d043-1f54-415f-98a8-f13a0d002eff tempest-ProjectReaderTests-1988360028 None] Lock "cinder-quobyte-9e32d4be-e41b-41b7-b660-c6a659662023" released by "delete_snapshot" :: held 1.598s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:42:17 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-dd94d043-1f54-415f-98a8-f13a0d002eff tempest-ProjectReaderTests-1988360028 None] Created reservations ['ef0c6418-bf1e-4216-b162-10ef70b98487', '6f00cdd4-a2a2-4b0c-bd1a-1603b1a48b96', '349fef5f-221b-47d4-b3de-10552f6d3811', 'cc386e4e-9943-4f9c-88eb-f3808cd58eeb'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:42:17 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-dd94d043-1f54-415f-98a8-f13a0d002eff tempest-ProjectReaderTests-1988360028 None] Delete snapshot completed successfully.
Jul 30 20:42:17 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-dd94d043-1f54-415f-98a8-f13a0d002eff tempest-ProjectReaderTests-1988360028 None] Lock "cinder-2a867677-d364-4a14-ab3f-289e2df2c1f4-delete_snapshot" released by "delete_snapshot" :: held 1.745s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:42:17 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-26320928-ec7e-4319-9b43-a9563a2836b1 tempest-ProjectReaderTests-1988360028 None] Acquiring lock "cinder-9e32d4be-e41b-41b7-b660-c6a659662023-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:42:17 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-26320928-ec7e-4319-9b43-a9563a2836b1 tempest-ProjectReaderTests-1988360028 None] Lock "cinder-9e32d4be-e41b-41b7-b660-c6a659662023-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:42:17 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-26320928-ec7e-4319-9b43-a9563a2836b1 tempest-ProjectReaderTests-1988360028 None] Acquiring lock "cinder-quobyte-9e32d4be-e41b-41b7-b660-c6a659662023" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:42:17 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-26320928-ec7e-4319-9b43-a9563a2836b1 tempest-ProjectReaderTests-1988360028 None] Lock "cinder-quobyte-9e32d4be-e41b-41b7-b660-c6a659662023" acquired by "delete_volume" :: waited 0.015s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:42:17 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[94694c73-6bc0-41ca-84fe-bb220adb20eb]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:42:17 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-26320928-ec7e-4319-9b43-a9563a2836b1 tempest-ProjectReaderTests-1988360028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-9e32d4be-e41b-41b7-b660-c6a659662023 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:42:17 devstack sudo[108906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-9e32d4be-e41b-41b7-b660-c6a659662023
Jul 30 20:42:17 devstack sudo[108906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:42:18 devstack sudo[108906]: pam_unix(sudo:session): session closed for user root
Jul 30 20:42:18 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-26320928-ec7e-4319-9b43-a9563a2836b1 tempest-ProjectReaderTests-1988360028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-9e32d4be-e41b-41b7-b660-c6a659662023" returned: 0 in 0.367s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:42:18 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-26320928-ec7e-4319-9b43-a9563a2836b1 tempest-ProjectReaderTests-1988360028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-9e32d4be-e41b-41b7-b660-c6a659662023 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:42:18 devstack sudo[108911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-9e32d4be-e41b-41b7-b660-c6a659662023
Jul 30 20:42:18 devstack sudo[108911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:42:18 devstack sudo[108911]: pam_unix(sudo:session): session closed for user root
Jul 30 20:42:18 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-26320928-ec7e-4319-9b43-a9563a2836b1 tempest-ProjectReaderTests-1988360028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-9e32d4be-e41b-41b7-b660-c6a659662023" returned: 0 in 0.270s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:42:18 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-26320928-ec7e-4319-9b43-a9563a2836b1 tempest-ProjectReaderTests-1988360028 None] Lock "cinder-quobyte-9e32d4be-e41b-41b7-b660-c6a659662023" released by "delete_volume" :: held 0.700s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:42:18 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-26320928-ec7e-4319-9b43-a9563a2836b1 tempest-ProjectReaderTests-1988360028 None] Created reservations ['7e54a326-6789-44a0-961b-b0e24aa06571', 'b9880628-1a1e-4caa-9e1d-4e4573d43ce4', '6d982006-2174-4532-9314-f85a857e14c0', '3d458e03-4d71-4fa6-8a61-6045fb143539'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:42:18 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-26320928-ec7e-4319-9b43-a9563a2836b1 tempest-ProjectReaderTests-1988360028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:42:18 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-26320928-ec7e-4319-9b43-a9563a2836b1 tempest-ProjectReaderTests-1988360028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:42:18 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-26320928-ec7e-4319-9b43-a9563a2836b1 tempest-ProjectReaderTests-1988360028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:42:18 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-26320928-ec7e-4319-9b43-a9563a2836b1 tempest-ProjectReaderTests-1988360028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:42:18 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-26320928-ec7e-4319-9b43-a9563a2836b1 tempest-ProjectReaderTests-1988360028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:42:18 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-26320928-ec7e-4319-9b43-a9563a2836b1 tempest-ProjectReaderTests-1988360028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:42:18 devstack sudo[108914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:42:18 devstack sudo[108914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:42:18 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ab3ce52-32a6-4910-9afd-d8de07f651e5 tempest-ProjectReaderTests-1285602872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:42:18 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-3ab3ce52-32a6-4910-9afd-d8de07f651e5 tempest-ProjectReaderTests-1285602872 None] Flow 'volume_create_manager' (213673d5-aa07-4428-8358-2ec49a9e6579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:42:18 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-3ab3ce52-32a6-4910-9afd-d8de07f651e5 tempest-ProjectReaderTests-1285602872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30c9e73e-44e7-4c81-8bbc-eff6c400c6bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:42:18 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-3ab3ce52-32a6-4910-9afd-d8de07f651e5 tempest-ProjectReaderTests-1285602872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30c9e73e-44e7-4c81-8bbc-eff6c400c6bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:42:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1762579456',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab6ccff2-16ef-41c0-9593-5bd6562715de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8057dd681c8e40409fc6de13408858bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:42:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:42:19Z,use_quota=True,user_id='5fe0aeed655b44899293a0c4729d4ad2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:42:18 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-3ab3ce52-32a6-4910-9afd-d8de07f651e5 tempest-ProjectReaderTests-1285602872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52ac98ce-57d1-41e2-9e87-eea964341205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:42:18 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-3ab3ce52-32a6-4910-9afd-d8de07f651e5 tempest-ProjectReaderTests-1285602872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52ac98ce-57d1-41e2-9e87-eea964341205) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:42:18 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-3ab3ce52-32a6-4910-9afd-d8de07f651e5 tempest-ProjectReaderTests-1285602872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3ac3d97-76c7-4c2c-aa3b-e89e8a4126e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:42:18 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-3ab3ce52-32a6-4910-9afd-d8de07f651e5 tempest-ProjectReaderTests-1285602872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3ac3d97-76c7-4c2c-aa3b-e89e8a4126e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab6ccff2-16ef-41c0-9593-5bd6562715de', 'volume_name': 'volume-ab6ccff2-16ef-41c0-9593-5bd6562715de', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:42:18 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-3ab3ce52-32a6-4910-9afd-d8de07f651e5 tempest-ProjectReaderTests-1285602872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9be222ef-fbb6-48a4-aa53-1088d5d90ed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:42:18 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-3ab3ce52-32a6-4910-9afd-d8de07f651e5 tempest-ProjectReaderTests-1285602872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9be222ef-fbb6-48a4-aa53-1088d5d90ed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:42:18 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-3ab3ce52-32a6-4910-9afd-d8de07f651e5 tempest-ProjectReaderTests-1285602872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9c2fe3c-87ec-4d8b-b170-9aca0de12125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:42:18 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-3ab3ce52-32a6-4910-9afd-d8de07f651e5 tempest-ProjectReaderTests-1285602872 None] Volume ab6ccff2-16ef-41c0-9593-5bd6562715de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab6ccff2-16ef-41c0-9593-5bd6562715de', 'volume_size': 1}
Jul 30 20:42:18 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-3ab3ce52-32a6-4910-9afd-d8de07f651e5 tempest-ProjectReaderTests-1285602872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:42:18 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-3ab3ce52-32a6-4910-9afd-d8de07f651e5 tempest-ProjectReaderTests-1285602872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:42:18 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-3ab3ce52-32a6-4910-9afd-d8de07f651e5 tempest-ProjectReaderTests-1285602872 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:42:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1762579456',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab6ccff2-16ef-41c0-9593-5bd6562715de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8057dd681c8e40409fc6de13408858bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:42:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:42:19Z,use_quota=True,user_id='5fe0aeed655b44899293a0c4729d4ad2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:42:18 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-3ab3ce52-32a6-4910-9afd-d8de07f651e5 tempest-ProjectReaderTests-1285602872 None] Creating volume ab6ccff2-16ef-41c0-9593-5bd6562715de {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:42:18 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-3ab3ce52-32a6-4910-9afd-d8de07f651e5 tempest-ProjectReaderTests-1285602872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:42:18 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-3ab3ce52-32a6-4910-9afd-d8de07f651e5 tempest-ProjectReaderTests-1285602872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:42:18 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-3ab3ce52-32a6-4910-9afd-d8de07f651e5 tempest-ProjectReaderTests-1285602872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:42:18 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-3ab3ce52-32a6-4910-9afd-d8de07f651e5 tempest-ProjectReaderTests-1285602872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:42:18 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-3ab3ce52-32a6-4910-9afd-d8de07f651e5 tempest-ProjectReaderTests-1285602872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:42:18 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-3ab3ce52-32a6-4910-9afd-d8de07f651e5 tempest-ProjectReaderTests-1285602872 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:42:18 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-3ab3ce52-32a6-4910-9afd-d8de07f651e5 tempest-ProjectReaderTests-1285602872 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:42:18 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3ab3ce52-32a6-4910-9afd-d8de07f651e5 tempest-ProjectReaderTests-1285602872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-ab6ccff2-16ef-41c0-9593-5bd6562715de 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:42:18 devstack sudo[108914]: pam_unix(sudo:session): session closed for user root
Jul 30 20:42:18 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-26320928-ec7e-4319-9b43-a9563a2836b1 tempest-ProjectReaderTests-1988360028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.268s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:42:18 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-26320928-ec7e-4319-9b43-a9563a2836b1 tempest-ProjectReaderTests-1988360028 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:42:18 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-26320928-ec7e-4319-9b43-a9563a2836b1 tempest-ProjectReaderTests-1988360028 None] Deleted volume successfully.
Jul 30 20:42:18 devstack sudo[108917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-ab6ccff2-16ef-41c0-9593-5bd6562715de 1073741824
Jul 30 20:42:18 devstack sudo[108917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:42:18 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-26320928-ec7e-4319-9b43-a9563a2836b1 tempest-ProjectReaderTests-1988360028 None] Lock "cinder-9e32d4be-e41b-41b7-b660-c6a659662023-delete_volume" released by "delete_volume" :: held 1.210s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:42:19 devstack sudo[108917]: pam_unix(sudo:session): session closed for user root
Jul 30 20:42:19 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3ab3ce52-32a6-4910-9afd-d8de07f651e5 tempest-ProjectReaderTests-1285602872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-ab6ccff2-16ef-41c0-9593-5bd6562715de 1073741824" returned: 0 in 0.469s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:42:19 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3ab3ce52-32a6-4910-9afd-d8de07f651e5 tempest-ProjectReaderTests-1285602872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-ab6ccff2-16ef-41c0-9593-5bd6562715de {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:42:19 devstack sudo[108923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-ab6ccff2-16ef-41c0-9593-5bd6562715de
Jul 30 20:42:19 devstack sudo[108923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:42:19 devstack sudo[108923]: pam_unix(sudo:session): session closed for user root
Jul 30 20:42:19 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-3ab3ce52-32a6-4910-9afd-d8de07f651e5 tempest-ProjectReaderTests-1285602872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-ab6ccff2-16ef-41c0-9593-5bd6562715de" returned: 0 in 0.256s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:42:19 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-3ab3ce52-32a6-4910-9afd-d8de07f651e5 tempest-ProjectReaderTests-1285602872 None] <== create_volume: return (766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:42:19 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-3ab3ce52-32a6-4910-9afd-d8de07f651e5 tempest-ProjectReaderTests-1285602872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:42:19 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-3ab3ce52-32a6-4910-9afd-d8de07f651e5 tempest-ProjectReaderTests-1285602872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9c2fe3c-87ec-4d8b-b170-9aca0de12125) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab6ccff2-16ef-41c0-9593-5bd6562715de', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:42:19 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-3ab3ce52-32a6-4910-9afd-d8de07f651e5 tempest-ProjectReaderTests-1285602872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2590a9eb-aed5-4639-bdfd-f4e1e571b39d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:42:19 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-3ab3ce52-32a6-4910-9afd-d8de07f651e5 tempest-ProjectReaderTests-1285602872 None] Volume volume-ab6ccff2-16ef-41c0-9593-5bd6562715de (ab6ccff2-16ef-41c0-9593-5bd6562715de): created successfully
Jul 30 20:42:19 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-3ab3ce52-32a6-4910-9afd-d8de07f651e5 tempest-ProjectReaderTests-1285602872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2590a9eb-aed5-4639-bdfd-f4e1e571b39d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:42:19 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-3ab3ce52-32a6-4910-9afd-d8de07f651e5 tempest-ProjectReaderTests-1285602872 None] Flow 'volume_create_manager' (213673d5-aa07-4428-8358-2ec49a9e6579) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:42:19 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-3ab3ce52-32a6-4910-9afd-d8de07f651e5 tempest-ProjectReaderTests-1285602872 None] Created volume successfully.
Jul 30 20:42:19 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-8434455e-d312-4ca3-8a6c-c99389707562 tempest-ProjectReaderTests-1285602872 None] Acquiring lock "cinder-ab6ccff2-16ef-41c0-9593-5bd6562715de-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:42:19 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-8434455e-d312-4ca3-8a6c-c99389707562 tempest-ProjectReaderTests-1285602872 None] Lock "cinder-ab6ccff2-16ef-41c0-9593-5bd6562715de-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:42:19 devstack cinder-volume[88719]: DEBUG dbcounter [-] [88719] Writing DB stats cinder:SELECT=217,cinder:INSERT=83,cinder:UPDATE=285,cinder:DELETE=22 {{(pid=88719) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 30 20:42:19 devstack cinder-volume[88719]: DEBUG dbcounter [-] [88719] Writing DB stats cinder:SELECT=205,cinder:UPDATE=280,cinder:INSERT=68,cinder:DELETE=24 {{(pid=88719) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 30 20:42:20 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-8434455e-d312-4ca3-8a6c-c99389707562 tempest-ProjectReaderTests-1285602872 None] Acquiring lock "cinder-quobyte-ab6ccff2-16ef-41c0-9593-5bd6562715de" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:42:20 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-8434455e-d312-4ca3-8a6c-c99389707562 tempest-ProjectReaderTests-1285602872 None] Lock "cinder-quobyte-ab6ccff2-16ef-41c0-9593-5bd6562715de" acquired by "delete_volume" :: waited 0.020s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:42:20 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[1df251fc-776f-4e38-920f-53b4068fcaf4]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:42:20 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8434455e-d312-4ca3-8a6c-c99389707562 tempest-ProjectReaderTests-1285602872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-ab6ccff2-16ef-41c0-9593-5bd6562715de {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:42:20 devstack sudo[108926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-ab6ccff2-16ef-41c0-9593-5bd6562715de
Jul 30 20:42:20 devstack sudo[108926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:42:20 devstack sudo[108926]: pam_unix(sudo:session): session closed for user root
Jul 30 20:42:20 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8434455e-d312-4ca3-8a6c-c99389707562 tempest-ProjectReaderTests-1285602872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-ab6ccff2-16ef-41c0-9593-5bd6562715de" returned: 0 in 0.399s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:42:20 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8434455e-d312-4ca3-8a6c-c99389707562 tempest-ProjectReaderTests-1285602872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-ab6ccff2-16ef-41c0-9593-5bd6562715de {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:42:20 devstack sudo[108931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-ab6ccff2-16ef-41c0-9593-5bd6562715de
Jul 30 20:42:20 devstack sudo[108931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:42:20 devstack sudo[108931]: pam_unix(sudo:session): session closed for user root
Jul 30 20:42:20 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8434455e-d312-4ca3-8a6c-c99389707562 tempest-ProjectReaderTests-1285602872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-ab6ccff2-16ef-41c0-9593-5bd6562715de" returned: 0 in 0.256s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:42:20 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-8434455e-d312-4ca3-8a6c-c99389707562 tempest-ProjectReaderTests-1285602872 None] Lock "cinder-quobyte-ab6ccff2-16ef-41c0-9593-5bd6562715de" released by "delete_volume" :: held 0.693s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:42:20 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-8434455e-d312-4ca3-8a6c-c99389707562 tempest-ProjectReaderTests-1285602872 None] Created reservations ['bd9fdb5f-0621-4dc9-b94d-03dba0bbf147', '6a5fa07a-7769-41e9-a7fe-a5675189450c', '91fcea61-5842-4cf4-a5e0-0d671cf893ff', 'be303638-4dc9-4bfa-8916-3b35e47f412c'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:42:20 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-8434455e-d312-4ca3-8a6c-c99389707562 tempest-ProjectReaderTests-1285602872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:42:20 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-8434455e-d312-4ca3-8a6c-c99389707562 tempest-ProjectReaderTests-1285602872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:42:20 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-8434455e-d312-4ca3-8a6c-c99389707562 tempest-ProjectReaderTests-1285602872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:42:20 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-8434455e-d312-4ca3-8a6c-c99389707562 tempest-ProjectReaderTests-1285602872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:42:20 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-8434455e-d312-4ca3-8a6c-c99389707562 tempest-ProjectReaderTests-1285602872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:42:20 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8434455e-d312-4ca3-8a6c-c99389707562 tempest-ProjectReaderTests-1285602872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:42:20 devstack sudo[108934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:42:20 devstack sudo[108934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:42:21 devstack sudo[108934]: pam_unix(sudo:session): session closed for user root
Jul 30 20:42:21 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-8434455e-d312-4ca3-8a6c-c99389707562 tempest-ProjectReaderTests-1285602872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.247s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:42:21 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-8434455e-d312-4ca3-8a6c-c99389707562 tempest-ProjectReaderTests-1285602872 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:42:21 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-8434455e-d312-4ca3-8a6c-c99389707562 tempest-ProjectReaderTests-1285602872 None] Deleted volume successfully.
Jul 30 20:42:21 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-8434455e-d312-4ca3-8a6c-c99389707562 tempest-ProjectReaderTests-1285602872 None] Lock "cinder-ab6ccff2-16ef-41c0-9593-5bd6562715de-delete_volume" released by "delete_volume" :: held 1.149s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:42:21 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-9aab7fac-32c9-45e5-b186-61dc5fe63e59 tempest-ProjectReaderTests-1285602872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:42:21 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-9aab7fac-32c9-45e5-b186-61dc5fe63e59 tempest-ProjectReaderTests-1285602872 None] Flow 'volume_create_manager' (5e48581b-dbea-4e50-9e69-d35becfe897a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:42:21 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-9aab7fac-32c9-45e5-b186-61dc5fe63e59 tempest-ProjectReaderTests-1285602872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96d77ecb-5bb3-4a96-b545-10ab3c2b41ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:42:21 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-9aab7fac-32c9-45e5-b186-61dc5fe63e59 tempest-ProjectReaderTests-1285602872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96d77ecb-5bb3-4a96-b545-10ab3c2b41ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:42:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1339612376',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c79e0ff5-cca5-4a17-9c87-7f865bad65ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8057dd681c8e40409fc6de13408858bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:42:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:42:22Z,use_quota=True,user_id='5fe0aeed655b44899293a0c4729d4ad2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:42:21 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-9aab7fac-32c9-45e5-b186-61dc5fe63e59 tempest-ProjectReaderTests-1285602872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc259f08-faf8-46a2-90fc-3f3411ecef52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:42:21 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-9aab7fac-32c9-45e5-b186-61dc5fe63e59 tempest-ProjectReaderTests-1285602872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc259f08-faf8-46a2-90fc-3f3411ecef52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:42:21 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-9aab7fac-32c9-45e5-b186-61dc5fe63e59 tempest-ProjectReaderTests-1285602872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17cde7f8-ca62-4a4d-b3b9-6affe1d07c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:42:21 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-9aab7fac-32c9-45e5-b186-61dc5fe63e59 tempest-ProjectReaderTests-1285602872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17cde7f8-ca62-4a4d-b3b9-6affe1d07c7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c79e0ff5-cca5-4a17-9c87-7f865bad65ad', 'volume_name': 'volume-c79e0ff5-cca5-4a17-9c87-7f865bad65ad', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:42:21 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-9aab7fac-32c9-45e5-b186-61dc5fe63e59 tempest-ProjectReaderTests-1285602872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4659770-f3aa-4947-b2b2-80b9d81f33bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:42:21 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-9aab7fac-32c9-45e5-b186-61dc5fe63e59 tempest-ProjectReaderTests-1285602872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4659770-f3aa-4947-b2b2-80b9d81f33bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:42:21 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-9aab7fac-32c9-45e5-b186-61dc5fe63e59 tempest-ProjectReaderTests-1285602872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (983b2212-81fc-4e9b-9509-c13db0fe0005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:42:21 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-9aab7fac-32c9-45e5-b186-61dc5fe63e59 tempest-ProjectReaderTests-1285602872 None] Volume c79e0ff5-cca5-4a17-9c87-7f865bad65ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c79e0ff5-cca5-4a17-9c87-7f865bad65ad', 'volume_size': 1}
Jul 30 20:42:21 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-9aab7fac-32c9-45e5-b186-61dc5fe63e59 tempest-ProjectReaderTests-1285602872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:42:21 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-9aab7fac-32c9-45e5-b186-61dc5fe63e59 tempest-ProjectReaderTests-1285602872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:42:21 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-9aab7fac-32c9-45e5-b186-61dc5fe63e59 tempest-ProjectReaderTests-1285602872 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:42:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1339612376',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c79e0ff5-cca5-4a17-9c87-7f865bad65ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8057dd681c8e40409fc6de13408858bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:42:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:42:22Z,use_quota=True,user_id='5fe0aeed655b44899293a0c4729d4ad2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:42:21 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-9aab7fac-32c9-45e5-b186-61dc5fe63e59 tempest-ProjectReaderTests-1285602872 None] Creating volume c79e0ff5-cca5-4a17-9c87-7f865bad65ad {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:42:21 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-9aab7fac-32c9-45e5-b186-61dc5fe63e59 tempest-ProjectReaderTests-1285602872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:42:21 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-9aab7fac-32c9-45e5-b186-61dc5fe63e59 tempest-ProjectReaderTests-1285602872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:42:21 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-9aab7fac-32c9-45e5-b186-61dc5fe63e59 tempest-ProjectReaderTests-1285602872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:42:21 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-9aab7fac-32c9-45e5-b186-61dc5fe63e59 tempest-ProjectReaderTests-1285602872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:42:21 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-9aab7fac-32c9-45e5-b186-61dc5fe63e59 tempest-ProjectReaderTests-1285602872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:42:21 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-9aab7fac-32c9-45e5-b186-61dc5fe63e59 tempest-ProjectReaderTests-1285602872 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:42:21 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-9aab7fac-32c9-45e5-b186-61dc5fe63e59 tempest-ProjectReaderTests-1285602872 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:42:21 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-9aab7fac-32c9-45e5-b186-61dc5fe63e59 tempest-ProjectReaderTests-1285602872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c79e0ff5-cca5-4a17-9c87-7f865bad65ad 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:42:21 devstack sudo[108937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c79e0ff5-cca5-4a17-9c87-7f865bad65ad 1073741824
Jul 30 20:42:21 devstack sudo[108937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:42:22 devstack sudo[108937]: pam_unix(sudo:session): session closed for user root
Jul 30 20:42:22 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-9aab7fac-32c9-45e5-b186-61dc5fe63e59 tempest-ProjectReaderTests-1285602872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c79e0ff5-cca5-4a17-9c87-7f865bad65ad 1073741824" returned: 0 in 0.469s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:42:22 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-9aab7fac-32c9-45e5-b186-61dc5fe63e59 tempest-ProjectReaderTests-1285602872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c79e0ff5-cca5-4a17-9c87-7f865bad65ad {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:42:22 devstack sudo[108943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c79e0ff5-cca5-4a17-9c87-7f865bad65ad
Jul 30 20:42:22 devstack sudo[108943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:42:22 devstack sudo[108943]: pam_unix(sudo:session): session closed for user root
Jul 30 20:42:22 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-9aab7fac-32c9-45e5-b186-61dc5fe63e59 tempest-ProjectReaderTests-1285602872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c79e0ff5-cca5-4a17-9c87-7f865bad65ad" returned: 0 in 0.261s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:42:22 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-9aab7fac-32c9-45e5-b186-61dc5fe63e59 tempest-ProjectReaderTests-1285602872 None] <== create_volume: return (775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:42:22 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-9aab7fac-32c9-45e5-b186-61dc5fe63e59 tempest-ProjectReaderTests-1285602872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:42:22 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-9aab7fac-32c9-45e5-b186-61dc5fe63e59 tempest-ProjectReaderTests-1285602872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (983b2212-81fc-4e9b-9509-c13db0fe0005) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c79e0ff5-cca5-4a17-9c87-7f865bad65ad', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:42:22 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-9aab7fac-32c9-45e5-b186-61dc5fe63e59 tempest-ProjectReaderTests-1285602872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d02bece-4600-4b93-907e-af380fcf4fc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:42:22 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-9aab7fac-32c9-45e5-b186-61dc5fe63e59 tempest-ProjectReaderTests-1285602872 None] Volume volume-c79e0ff5-cca5-4a17-9c87-7f865bad65ad (c79e0ff5-cca5-4a17-9c87-7f865bad65ad): created successfully
Jul 30 20:42:22 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-9aab7fac-32c9-45e5-b186-61dc5fe63e59 tempest-ProjectReaderTests-1285602872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d02bece-4600-4b93-907e-af380fcf4fc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:42:22 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-9aab7fac-32c9-45e5-b186-61dc5fe63e59 tempest-ProjectReaderTests-1285602872 None] Flow 'volume_create_manager' (5e48581b-dbea-4e50-9e69-d35becfe897a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:42:22 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-9aab7fac-32c9-45e5-b186-61dc5fe63e59 tempest-ProjectReaderTests-1285602872 None] Created volume successfully.
Jul 30 20:42:22 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-e30acaa3-484d-46ae-99e8-c1854fb35edd tempest-ProjectReaderTests-1285602872 None] Acquiring lock "cinder-c79e0ff5-cca5-4a17-9c87-7f865bad65ad-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:42:22 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-e30acaa3-484d-46ae-99e8-c1854fb35edd tempest-ProjectReaderTests-1285602872 None] Lock "cinder-c79e0ff5-cca5-4a17-9c87-7f865bad65ad-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:42:22 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-e30acaa3-484d-46ae-99e8-c1854fb35edd tempest-ProjectReaderTests-1285602872 None] Acquiring lock "cinder-quobyte-c79e0ff5-cca5-4a17-9c87-7f865bad65ad" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:42:22 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-e30acaa3-484d-46ae-99e8-c1854fb35edd tempest-ProjectReaderTests-1285602872 None] Lock "cinder-quobyte-c79e0ff5-cca5-4a17-9c87-7f865bad65ad" acquired by "delete_volume" :: waited 0.016s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:42:22 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[25a1ccdc-296f-4bbb-b240-f1eb71add4c9]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:42:22 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-e30acaa3-484d-46ae-99e8-c1854fb35edd tempest-ProjectReaderTests-1285602872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c79e0ff5-cca5-4a17-9c87-7f865bad65ad {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:42:22 devstack sudo[108946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c79e0ff5-cca5-4a17-9c87-7f865bad65ad
Jul 30 20:42:22 devstack sudo[108946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:42:23 devstack sudo[108946]: pam_unix(sudo:session): session closed for user root
Jul 30 20:42:23 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-e30acaa3-484d-46ae-99e8-c1854fb35edd tempest-ProjectReaderTests-1285602872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c79e0ff5-cca5-4a17-9c87-7f865bad65ad" returned: 0 in 0.350s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:42:23 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-e30acaa3-484d-46ae-99e8-c1854fb35edd tempest-ProjectReaderTests-1285602872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c79e0ff5-cca5-4a17-9c87-7f865bad65ad {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:42:23 devstack sudo[108951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c79e0ff5-cca5-4a17-9c87-7f865bad65ad
Jul 30 20:42:23 devstack sudo[108951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:42:23 devstack sudo[108951]: pam_unix(sudo:session): session closed for user root
Jul 30 20:42:23 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-e30acaa3-484d-46ae-99e8-c1854fb35edd tempest-ProjectReaderTests-1285602872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-c79e0ff5-cca5-4a17-9c87-7f865bad65ad" returned: 0 in 0.274s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:42:23 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-e30acaa3-484d-46ae-99e8-c1854fb35edd tempest-ProjectReaderTests-1285602872 None] Lock "cinder-quobyte-c79e0ff5-cca5-4a17-9c87-7f865bad65ad" released by "delete_volume" :: held 0.663s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:42:23 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-e30acaa3-484d-46ae-99e8-c1854fb35edd tempest-ProjectReaderTests-1285602872 None] Created reservations ['0d40bd9e-fb38-46ed-b646-10eeb6476c68', '433415e9-36f0-45cd-beb0-49c4de417e81', '3b2e6d25-e113-4e12-a1c5-69424f08c9df', '23484626-e657-4c16-8b05-e9251885526f'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:42:23 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-e30acaa3-484d-46ae-99e8-c1854fb35edd tempest-ProjectReaderTests-1285602872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:42:23 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-e30acaa3-484d-46ae-99e8-c1854fb35edd tempest-ProjectReaderTests-1285602872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:42:23 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-e30acaa3-484d-46ae-99e8-c1854fb35edd tempest-ProjectReaderTests-1285602872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:42:23 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-e30acaa3-484d-46ae-99e8-c1854fb35edd tempest-ProjectReaderTests-1285602872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:42:23 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-e30acaa3-484d-46ae-99e8-c1854fb35edd tempest-ProjectReaderTests-1285602872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:42:23 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-e30acaa3-484d-46ae-99e8-c1854fb35edd tempest-ProjectReaderTests-1285602872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:42:23 devstack sudo[108954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:42:23 devstack sudo[108954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:42:23 devstack sudo[108954]: pam_unix(sudo:session): session closed for user root
Jul 30 20:42:23 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-e30acaa3-484d-46ae-99e8-c1854fb35edd tempest-ProjectReaderTests-1285602872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.258s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:42:23 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-e30acaa3-484d-46ae-99e8-c1854fb35edd tempest-ProjectReaderTests-1285602872 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:42:23 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-e30acaa3-484d-46ae-99e8-c1854fb35edd tempest-ProjectReaderTests-1285602872 None] Deleted volume successfully.
Jul 30 20:42:23 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-e30acaa3-484d-46ae-99e8-c1854fb35edd tempest-ProjectReaderTests-1285602872 None] Lock "cinder-c79e0ff5-cca5-4a17-9c87-7f865bad65ad-delete_volume" released by "delete_volume" :: held 1.130s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:42:33 devstack cinder-volume[88719]: DEBUG dbcounter [-] [88719] Writing DB stats cinder:SELECT=12,cinder:INSERT=3,cinder:UPDATE=22 {{(pid=88719) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 30 20:42:33 devstack cinder-volume[88719]: DEBUG dbcounter [-] [88719] Writing DB stats cinder:SELECT=11,cinder:INSERT=6,cinder:UPDATE=15,cinder:DELETE=3 {{(pid=88719) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 30 20:42:49 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-396c1cfc-443d-4e31-a0c7-c73a126ba0a1 tempest-SnapshotDependencyTests-456084937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:42:49 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-396c1cfc-443d-4e31-a0c7-c73a126ba0a1 tempest-SnapshotDependencyTests-456084937 None] Flow 'volume_create_manager' (ca744d7c-8572-4e49-babb-5715680cfc39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:42:49 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-396c1cfc-443d-4e31-a0c7-c73a126ba0a1 tempest-SnapshotDependencyTests-456084937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61b024a7-1d4e-4dee-9fbb-cc4fc9a3106a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:42:49 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-396c1cfc-443d-4e31-a0c7-c73a126ba0a1 tempest-SnapshotDependencyTests-456084937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61b024a7-1d4e-4dee-9fbb-cc4fc9a3106a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:42:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1693870544',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bc67166-1d62-45a4-9a7e-99e9a234fd86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dadd36399d104e6293850a8187c0fca7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:42:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:42:49Z,use_quota=True,user_id='2407492b65ed4cfd85c88ecf4e7c6ec2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:42:49 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-396c1cfc-443d-4e31-a0c7-c73a126ba0a1 tempest-SnapshotDependencyTests-456084937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f4e2285-c019-4407-93c3-3262424fc933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:42:49 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-396c1cfc-443d-4e31-a0c7-c73a126ba0a1 tempest-SnapshotDependencyTests-456084937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f4e2285-c019-4407-93c3-3262424fc933) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:42:49 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-396c1cfc-443d-4e31-a0c7-c73a126ba0a1 tempest-SnapshotDependencyTests-456084937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dcb1712-d797-47a1-8544-b5552acb1e59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:42:49 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-396c1cfc-443d-4e31-a0c7-c73a126ba0a1 tempest-SnapshotDependencyTests-456084937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dcb1712-d797-47a1-8544-b5552acb1e59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bc67166-1d62-45a4-9a7e-99e9a234fd86', 'volume_name': 'volume-3bc67166-1d62-45a4-9a7e-99e9a234fd86', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:42:49 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-396c1cfc-443d-4e31-a0c7-c73a126ba0a1 tempest-SnapshotDependencyTests-456084937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bfd96b5-9b70-4298-be8f-c385d825a8f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:42:49 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-396c1cfc-443d-4e31-a0c7-c73a126ba0a1 tempest-SnapshotDependencyTests-456084937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bfd96b5-9b70-4298-be8f-c385d825a8f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:42:49 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-396c1cfc-443d-4e31-a0c7-c73a126ba0a1 tempest-SnapshotDependencyTests-456084937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cc5e883-0da1-453e-8221-2c07a9c88340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:42:49 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-396c1cfc-443d-4e31-a0c7-c73a126ba0a1 tempest-SnapshotDependencyTests-456084937 None] Volume 3bc67166-1d62-45a4-9a7e-99e9a234fd86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bc67166-1d62-45a4-9a7e-99e9a234fd86', 'volume_size': 1}
Jul 30 20:42:49 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-396c1cfc-443d-4e31-a0c7-c73a126ba0a1 tempest-SnapshotDependencyTests-456084937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:42:49 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-396c1cfc-443d-4e31-a0c7-c73a126ba0a1 tempest-SnapshotDependencyTests-456084937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:42:49 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-396c1cfc-443d-4e31-a0c7-c73a126ba0a1 tempest-SnapshotDependencyTests-456084937 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78688524e930>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:42:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1693870544',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bc67166-1d62-45a4-9a7e-99e9a234fd86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dadd36399d104e6293850a8187c0fca7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:42:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:42:49Z,use_quota=True,user_id='2407492b65ed4cfd85c88ecf4e7c6ec2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)}" {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 30 20:42:49 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-396c1cfc-443d-4e31-a0c7-c73a126ba0a1 tempest-SnapshotDependencyTests-456084937 None] Creating volume 3bc67166-1d62-45a4-9a7e-99e9a234fd86 {{(pid=88719) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 30 20:42:49 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-396c1cfc-443d-4e31-a0c7-c73a126ba0a1 tempest-SnapshotDependencyTests-456084937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:42:49 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-396c1cfc-443d-4e31-a0c7-c73a126ba0a1 tempest-SnapshotDependencyTests-456084937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:42:49 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-396c1cfc-443d-4e31-a0c7-c73a126ba0a1 tempest-SnapshotDependencyTests-456084937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:42:49 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-396c1cfc-443d-4e31-a0c7-c73a126ba0a1 tempest-SnapshotDependencyTests-456084937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:42:49 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-396c1cfc-443d-4e31-a0c7-c73a126ba0a1 tempest-SnapshotDependencyTests-456084937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:42:49 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-396c1cfc-443d-4e31-a0c7-c73a126ba0a1 tempest-SnapshotDependencyTests-456084937 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:42:49 devstack cinder-volume[88719]: INFO cinder.volume.drivers.remotefs [None req-396c1cfc-443d-4e31-a0c7-c73a126ba0a1 tempest-SnapshotDependencyTests-456084937 None] casted to osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5
Jul 30 20:42:49 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-396c1cfc-443d-4e31-a0c7-c73a126ba0a1 tempest-SnapshotDependencyTests-456084937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3bc67166-1d62-45a4-9a7e-99e9a234fd86 1073741824 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:42:49 devstack sudo[108964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3bc67166-1d62-45a4-9a7e-99e9a234fd86 1073741824
Jul 30 20:42:49 devstack sudo[108964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:42:49 devstack sudo[108964]: pam_unix(sudo:session): session closed for user root
Jul 30 20:42:49 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-396c1cfc-443d-4e31-a0c7-c73a126ba0a1 tempest-SnapshotDependencyTests-456084937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3bc67166-1d62-45a4-9a7e-99e9a234fd86 1073741824" returned: 0 in 0.391s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:42:49 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-396c1cfc-443d-4e31-a0c7-c73a126ba0a1 tempest-SnapshotDependencyTests-456084937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3bc67166-1d62-45a4-9a7e-99e9a234fd86 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:42:49 devstack sudo[108970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3bc67166-1d62-45a4-9a7e-99e9a234fd86
Jul 30 20:42:49 devstack sudo[108970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:42:49 devstack sudo[108970]: pam_unix(sudo:session): session closed for user root
Jul 30 20:42:49 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-396c1cfc-443d-4e31-a0c7-c73a126ba0a1 tempest-SnapshotDependencyTests-456084937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3bc67166-1d62-45a4-9a7e-99e9a234fd86" returned: 0 in 0.237s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:42:49 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-396c1cfc-443d-4e31-a0c7-c73a126ba0a1 tempest-SnapshotDependencyTests-456084937 None] <== create_volume: return (667ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'} {{(pid=88719) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 30 20:42:49 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-396c1cfc-443d-4e31-a0c7-c73a126ba0a1 tempest-SnapshotDependencyTests-456084937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.670s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:42:49 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-396c1cfc-443d-4e31-a0c7-c73a126ba0a1 tempest-SnapshotDependencyTests-456084937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cc5e883-0da1-453e-8221-2c07a9c88340) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bc67166-1d62-45a4-9a7e-99e9a234fd86', 'volume_size': 1}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:42:49 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-396c1cfc-443d-4e31-a0c7-c73a126ba0a1 tempest-SnapshotDependencyTests-456084937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8c24143-a4cc-42b0-9d11-0dcb0bf0a105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:42:49 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-396c1cfc-443d-4e31-a0c7-c73a126ba0a1 tempest-SnapshotDependencyTests-456084937 None] Volume volume-3bc67166-1d62-45a4-9a7e-99e9a234fd86 (3bc67166-1d62-45a4-9a7e-99e9a234fd86): created successfully
Jul 30 20:42:49 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-396c1cfc-443d-4e31-a0c7-c73a126ba0a1 tempest-SnapshotDependencyTests-456084937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8c24143-a4cc-42b0-9d11-0dcb0bf0a105) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:42:49 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-396c1cfc-443d-4e31-a0c7-c73a126ba0a1 tempest-SnapshotDependencyTests-456084937 None] Flow 'volume_create_manager' (ca744d7c-8572-4e49-babb-5715680cfc39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:42:49 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-396c1cfc-443d-4e31-a0c7-c73a126ba0a1 tempest-SnapshotDependencyTests-456084937 None] Created volume successfully.
Jul 30 20:42:50 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-4a5d725c-7b20-466a-b560-fe1abf7002b0 tempest-SnapshotDependencyTests-456084937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:42:50 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-4a5d725c-7b20-466a-b560-fe1abf7002b0 tempest-SnapshotDependencyTests-456084937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:42:50 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-4a5d725c-7b20-466a-b560-fe1abf7002b0 tempest-SnapshotDependencyTests-456084937 None] Creating offline snapshot 6048c2a2-06a3-4cfb-a457-46e40136ec88 of volume 3bc67166-1d62-45a4-9a7e-99e9a234fd86 {{(pid=88719) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 30 20:42:50 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[6761520b-6c6c-43f8-b7f4-4795fc303a1f]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:42:50 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-4a5d725c-7b20-466a-b560-fe1abf7002b0 tempest-SnapshotDependencyTests-456084937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3bc67166-1d62-45a4-9a7e-99e9a234fd86 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:42:50 devstack sudo[108973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3bc67166-1d62-45a4-9a7e-99e9a234fd86
Jul 30 20:42:50 devstack sudo[108973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:42:50 devstack sudo[108973]: pam_unix(sudo:session): session closed for user root
Jul 30 20:42:50 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-4a5d725c-7b20-466a-b560-fe1abf7002b0 tempest-SnapshotDependencyTests-456084937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3bc67166-1d62-45a4-9a7e-99e9a234fd86" returned: 0 in 0.347s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:42:50 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-4a5d725c-7b20-466a-b560-fe1abf7002b0 tempest-SnapshotDependencyTests-456084937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3bc67166-1d62-45a4-9a7e-99e9a234fd86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3bc67166-1d62-45a4-9a7e-99e9a234fd86.6048c2a2-06a3-4cfb-a457-46e40136ec88 1G {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:42:50 devstack sudo[108978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3bc67166-1d62-45a4-9a7e-99e9a234fd86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3bc67166-1d62-45a4-9a7e-99e9a234fd86.6048c2a2-06a3-4cfb-a457-46e40136ec88 1G
Jul 30 20:42:50 devstack sudo[108978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:42:51 devstack sudo[108978]: pam_unix(sudo:session): session closed for user root
Jul 30 20:42:51 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-4a5d725c-7b20-466a-b560-fe1abf7002b0 tempest-SnapshotDependencyTests-456084937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3bc67166-1d62-45a4-9a7e-99e9a234fd86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3bc67166-1d62-45a4-9a7e-99e9a234fd86.6048c2a2-06a3-4cfb-a457-46e40136ec88 1G" returned: 0 in 0.369s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:42:51 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-4a5d725c-7b20-466a-b560-fe1abf7002b0 tempest-SnapshotDependencyTests-456084937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3bc67166-1d62-45a4-9a7e-99e9a234fd86 -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3bc67166-1d62-45a4-9a7e-99e9a234fd86.6048c2a2-06a3-4cfb-a457-46e40136ec88 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:42:51 devstack sudo[108983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3bc67166-1d62-45a4-9a7e-99e9a234fd86 -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3bc67166-1d62-45a4-9a7e-99e9a234fd86.6048c2a2-06a3-4cfb-a457-46e40136ec88
Jul 30 20:42:51 devstack sudo[108983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:42:51 devstack sudo[108983]: pam_unix(sudo:session): session closed for user root
Jul 30 20:42:51 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-4a5d725c-7b20-466a-b560-fe1abf7002b0 tempest-SnapshotDependencyTests-456084937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3bc67166-1d62-45a4-9a7e-99e9a234fd86 -F qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3bc67166-1d62-45a4-9a7e-99e9a234fd86.6048c2a2-06a3-4cfb-a457-46e40136ec88" returned: 0 in 0.283s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:42:51 devstack cinder-volume[88719]: WARNING cinder.volume.drivers.remotefs [None req-4a5d725c-7b20-466a-b560-fe1abf7002b0 tempest-SnapshotDependencyTests-456084937 None] /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3bc67166-1d62-45a4-9a7e-99e9a234fd86.6048c2a2-06a3-4cfb-a457-46e40136ec88 is being set with open permissions: ugo+rw
Jul 30 20:42:51 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-4a5d725c-7b20-466a-b560-fe1abf7002b0 tempest-SnapshotDependencyTests-456084937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3bc67166-1d62-45a4-9a7e-99e9a234fd86.6048c2a2-06a3-4cfb-a457-46e40136ec88 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:42:51 devstack sudo[108993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3bc67166-1d62-45a4-9a7e-99e9a234fd86.6048c2a2-06a3-4cfb-a457-46e40136ec88
Jul 30 20:42:51 devstack sudo[108993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:42:51 devstack sudo[108993]: pam_unix(sudo:session): session closed for user root
Jul 30 20:42:51 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-4a5d725c-7b20-466a-b560-fe1abf7002b0 tempest-SnapshotDependencyTests-456084937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3bc67166-1d62-45a4-9a7e-99e9a234fd86.6048c2a2-06a3-4cfb-a457-46e40136ec88" returned: 0 in 0.245s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:42:51 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-4a5d725c-7b20-466a-b560-fe1abf7002b0 tempest-SnapshotDependencyTests-456084937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3bc67166-1d62-45a4-9a7e-99e9a234fd86.info {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:42:51 devstack sudo[108996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3bc67166-1d62-45a4-9a7e-99e9a234fd86.info
Jul 30 20:42:51 devstack sudo[108996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:42:51 devstack sudo[108996]: pam_unix(sudo:session): session closed for user root
Jul 30 20:42:51 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-4a5d725c-7b20-466a-b560-fe1abf7002b0 tempest-SnapshotDependencyTests-456084937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3bc67166-1d62-45a4-9a7e-99e9a234fd86.info" returned: 0 in 0.245s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:42:51 devstack cinder-volume[88719]: WARNING cinder.volume.drivers.remotefs [None req-4a5d725c-7b20-466a-b560-fe1abf7002b0 tempest-SnapshotDependencyTests-456084937 None] /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3bc67166-1d62-45a4-9a7e-99e9a234fd86.info is being set with open permissions: ugo+rw
Jul 30 20:42:51 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-4a5d725c-7b20-466a-b560-fe1abf7002b0 tempest-SnapshotDependencyTests-456084937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3bc67166-1d62-45a4-9a7e-99e9a234fd86.info {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:42:51 devstack sudo[108999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3bc67166-1d62-45a4-9a7e-99e9a234fd86.info
Jul 30 20:42:51 devstack sudo[108999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:42:52 devstack sudo[108999]: pam_unix(sudo:session): session closed for user root
Jul 30 20:42:52 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-4a5d725c-7b20-466a-b560-fe1abf7002b0 tempest-SnapshotDependencyTests-456084937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3bc67166-1d62-45a4-9a7e-99e9a234fd86.info" returned: 0 in 0.240s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:42:52 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-4a5d725c-7b20-466a-b560-fe1abf7002b0 tempest-SnapshotDependencyTests-456084937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.818s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:42:52 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-4a5d725c-7b20-466a-b560-fe1abf7002b0 tempest-SnapshotDependencyTests-456084937 None] Create snapshot completed successfully
Jul 30 20:42:52 devstack cinder-volume[88719]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5154f62-d553-4e59-a947-9c4c0199fe26 tempest-SnapshotDependencyTests-456084937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88719) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 30 20:42:52 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-c5154f62-d553-4e59-a947-9c4c0199fe26 tempest-SnapshotDependencyTests-456084937 None] Flow 'volume_create_manager' (079081ed-fcc6-4803-923c-5b1b5375f03e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:42:52 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-c5154f62-d553-4e59-a947-9c4c0199fe26 tempest-SnapshotDependencyTests-456084937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a319156-4839-4c60-a9ca-563442caa378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:42:52 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-c5154f62-d553-4e59-a947-9c4c0199fe26 tempest-SnapshotDependencyTests-456084937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a319156-4839-4c60-a9ca-563442caa378) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-30T18:42:53Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83a7c635-76e1-426b-8cd7-650e73617571,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dadd36399d104e6293850a8187c0fca7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T18:42:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=6048c2a2-06a3-4cfb-a457-46e40136ec88,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T18:42:53Z,use_quota=True,user_id='2407492b65ed4cfd85c88ecf4e7c6ec2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de527fa-949c-4f0f-bcb9-96d59faef475),volume_type_id=1de527fa-949c-4f0f-bcb9-96d59faef475)' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:42:52 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-c5154f62-d553-4e59-a947-9c4c0199fe26 tempest-SnapshotDependencyTests-456084937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a97e66a1-ef4e-415b-92da-3205b608a584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:42:52 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-c5154f62-d553-4e59-a947-9c4c0199fe26 tempest-SnapshotDependencyTests-456084937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a97e66a1-ef4e-415b-92da-3205b608a584) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:42:52 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-c5154f62-d553-4e59-a947-9c4c0199fe26 tempest-SnapshotDependencyTests-456084937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5c80a80-3675-4c95-9fd7-a0eabb86c902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:42:52 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-c5154f62-d553-4e59-a947-9c4c0199fe26 tempest-SnapshotDependencyTests-456084937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5c80a80-3675-4c95-9fd7-a0eabb86c902) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '83a7c635-76e1-426b-8cd7-650e73617571', 'volume_name': 'volume-83a7c635-76e1-426b-8cd7-650e73617571', 'volume_size': 1, 'snapshot_id': '6048c2a2-06a3-4cfb-a457-46e40136ec88'}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:42:52 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-c5154f62-d553-4e59-a947-9c4c0199fe26 tempest-SnapshotDependencyTests-456084937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1ab43ec-5a1c-4b6c-be0f-7680854f77df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:42:52 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-c5154f62-d553-4e59-a947-9c4c0199fe26 tempest-SnapshotDependencyTests-456084937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1ab43ec-5a1c-4b6c-be0f-7680854f77df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:42:52 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-c5154f62-d553-4e59-a947-9c4c0199fe26 tempest-SnapshotDependencyTests-456084937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5014db9c-2e6d-4a3b-8fbc-b52607970458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:42:52 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-c5154f62-d553-4e59-a947-9c4c0199fe26 tempest-SnapshotDependencyTests-456084937 None] Volume 83a7c635-76e1-426b-8cd7-650e73617571: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-83a7c635-76e1-426b-8cd7-650e73617571', 'volume_size': 1, 'snapshot_id': '6048c2a2-06a3-4cfb-a457-46e40136ec88'}
Jul 30 20:42:53 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-c5154f62-d553-4e59-a947-9c4c0199fe26 tempest-SnapshotDependencyTests-456084937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:42:53 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-c5154f62-d553-4e59-a947-9c4c0199fe26 tempest-SnapshotDependencyTests-456084937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:42:53 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-c5154f62-d553-4e59-a947-9c4c0199fe26 tempest-SnapshotDependencyTests-456084937 None] Acquiring lock "cinder-quobyte-6048c2a2-06a3-4cfb-a457-46e40136ec88-83a7c635-76e1-426b-8cd7-650e73617571" by "_create_volume_from_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:42:53 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-c5154f62-d553-4e59-a947-9c4c0199fe26 tempest-SnapshotDependencyTests-456084937 None] Lock "cinder-quobyte-6048c2a2-06a3-4cfb-a457-46e40136ec88-83a7c635-76e1-426b-8cd7-650e73617571" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:42:53 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-c5154f62-d553-4e59-a947-9c4c0199fe26 tempest-SnapshotDependencyTests-456084937 None] Creating volume 83a7c635-76e1-426b-8cd7-650e73617571 from snapshot 6048c2a2-06a3-4cfb-a457-46e40136ec88 {{(pid=88719) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Jul 30 20:42:53 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-c5154f62-d553-4e59-a947-9c4c0199fe26 tempest-SnapshotDependencyTests-456084937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:42:53 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-c5154f62-d553-4e59-a947-9c4c0199fe26 tempest-SnapshotDependencyTests-456084937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:42:53 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-c5154f62-d553-4e59-a947-9c4c0199fe26 tempest-SnapshotDependencyTests-456084937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:42:53 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-c5154f62-d553-4e59-a947-9c4c0199fe26 tempest-SnapshotDependencyTests-456084937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:42:53 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-c5154f62-d553-4e59-a947-9c4c0199fe26 tempest-SnapshotDependencyTests-456084937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:42:53 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-c5154f62-d553-4e59-a947-9c4c0199fe26 tempest-SnapshotDependencyTests-456084937 None] Selected osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5 as target Quobyte volume. {{(pid=88719) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Jul 30 20:42:53 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-c5154f62-d553-4e59-a947-9c4c0199fe26 tempest-SnapshotDependencyTests-456084937 None] Acquiring lock "cinder-quobyte-83a7c635-76e1-426b-8cd7-650e73617571" by "_copy_volume_from_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:42:53 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-c5154f62-d553-4e59-a947-9c4c0199fe26 tempest-SnapshotDependencyTests-456084937 None] Lock "cinder-quobyte-83a7c635-76e1-426b-8cd7-650e73617571" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:42:53 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-c5154f62-d553-4e59-a947-9c4c0199fe26 tempest-SnapshotDependencyTests-456084937 None] snapshot: 6048c2a2-06a3-4cfb-a457-46e40136ec88, volume: 83a7c635-76e1-426b-8cd7-650e73617571,  {{(pid=88719) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}}
Jul 30 20:42:53 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-c5154f62-d553-4e59-a947-9c4c0199fe26 tempest-SnapshotDependencyTests-456084937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:42:53 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-c5154f62-d553-4e59-a947-9c4c0199fe26 tempest-SnapshotDependencyTests-456084937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:42:53 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-c5154f62-d553-4e59-a947-9c4c0199fe26 tempest-SnapshotDependencyTests-456084937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:42:53 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-c5154f62-d553-4e59-a947-9c4c0199fe26 tempest-SnapshotDependencyTests-456084937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:42:53 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-c5154f62-d553-4e59-a947-9c4c0199fe26 tempest-SnapshotDependencyTests-456084937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:42:53 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[c63e45b2-a740-49a1-bbde-8208495ea034]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:42:53 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-c5154f62-d553-4e59-a947-9c4c0199fe26 tempest-SnapshotDependencyTests-456084937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3bc67166-1d62-45a4-9a7e-99e9a234fd86.6048c2a2-06a3-4cfb-a457-46e40136ec88 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:42:53 devstack sudo[109002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3bc67166-1d62-45a4-9a7e-99e9a234fd86.6048c2a2-06a3-4cfb-a457-46e40136ec88
Jul 30 20:42:53 devstack sudo[109002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:42:53 devstack sudo[109002]: pam_unix(sudo:session): session closed for user root
Jul 30 20:42:53 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-c5154f62-d553-4e59-a947-9c4c0199fe26 tempest-SnapshotDependencyTests-456084937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3bc67166-1d62-45a4-9a7e-99e9a234fd86.6048c2a2-06a3-4cfb-a457-46e40136ec88" returned: 0 in 0.346s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:42:53 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-c5154f62-d553-4e59-a947-9c4c0199fe26 tempest-SnapshotDependencyTests-456084937 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3bc67166-1d62-45a4-9a7e-99e9a234fd86(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88719) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 30 20:42:53 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0f6f6b5-674f-4200-ba6a-3438c0deda6a]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:42:53 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-c5154f62-d553-4e59-a947-9c4c0199fe26 tempest-SnapshotDependencyTests-456084937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3bc67166-1d62-45a4-9a7e-99e9a234fd86 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:42:53 devstack sudo[109007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3bc67166-1d62-45a4-9a7e-99e9a234fd86
Jul 30 20:42:53 devstack sudo[109007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:42:53 devstack sudo[109007]: pam_unix(sudo:session): session closed for user root
Jul 30 20:42:53 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-c5154f62-d553-4e59-a947-9c4c0199fe26 tempest-SnapshotDependencyTests-456084937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3bc67166-1d62-45a4-9a7e-99e9a234fd86" returned: 0 in 0.338s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:42:53 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-c5154f62-d553-4e59-a947-9c4c0199fe26 tempest-SnapshotDependencyTests-456084937 None] will copy from snapshot at /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3bc67166-1d62-45a4-9a7e-99e9a234fd86 {{(pid=88719) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}}
Jul 30 20:42:53 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-c5154f62-d553-4e59-a947-9c4c0199fe26 tempest-SnapshotDependencyTests-456084937 None] Creating direct copy from snapshot {{(pid=88719) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}}
Jul 30 20:42:53 devstack cinder-volume[88719]: DEBUG cinder.utils [None req-c5154f62-d553-4e59-a947-9c4c0199fe26 tempest-SnapshotDependencyTests-456084937 None] Path /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-83a7c635-76e1-426b-8cd7-650e73617571 not found in is_blk_device check {{(pid=88719) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 30 20:42:53 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-c5154f62-d553-4e59-a947-9c4c0199fe26 tempest-SnapshotDependencyTests-456084937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3bc67166-1d62-45a4-9a7e-99e9a234fd86 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-83a7c635-76e1-426b-8cd7-650e73617571 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:42:53 devstack sudo[109012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3bc67166-1d62-45a4-9a7e-99e9a234fd86 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-83a7c635-76e1-426b-8cd7-650e73617571
Jul 30 20:42:53 devstack sudo[109012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:42:57 devstack sudo[109012]: pam_unix(sudo:session): session closed for user root
Jul 30 20:42:57 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-c5154f62-d553-4e59-a947-9c4c0199fe26 tempest-SnapshotDependencyTests-456084937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3bc67166-1d62-45a4-9a7e-99e9a234fd86 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-83a7c635-76e1-426b-8cd7-650e73617571" returned: 0 in 4.059s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:42:57 devstack cinder-volume[88719]: DEBUG cinder.image.image_utils [None req-c5154f62-d553-4e59-a947-9c4c0199fe26 tempest-SnapshotDependencyTests-456084937 None] Image conversion details: src /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3bc67166-1d62-45a4-9a7e-99e9a234fd86, size 1024.00 MB, duration 4.06 sec, destination /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-83a7c635-76e1-426b-8cd7-650e73617571 {{(pid=88719) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 30 20:42:57 devstack cinder-volume[88719]: INFO cinder.image.image_utils [None req-c5154f62-d553-4e59-a947-9c4c0199fe26 tempest-SnapshotDependencyTests-456084937 None] Converted 1024.00 MB image at 252.22 MB/s
Jul 30 20:42:57 devstack cinder-volume[88719]: WARNING cinder.volume.drivers.remotefs [None req-c5154f62-d553-4e59-a947-9c4c0199fe26 tempest-SnapshotDependencyTests-456084937 None] /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-83a7c635-76e1-426b-8cd7-650e73617571 is being set with open permissions: ugo+rw
Jul 30 20:42:57 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-c5154f62-d553-4e59-a947-9c4c0199fe26 tempest-SnapshotDependencyTests-456084937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-83a7c635-76e1-426b-8cd7-650e73617571 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:42:57 devstack sudo[109026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-83a7c635-76e1-426b-8cd7-650e73617571
Jul 30 20:42:57 devstack sudo[109026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:42:58 devstack sudo[109026]: pam_unix(sudo:session): session closed for user root
Jul 30 20:42:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-c5154f62-d553-4e59-a947-9c4c0199fe26 tempest-SnapshotDependencyTests-456084937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-83a7c635-76e1-426b-8cd7-650e73617571" returned: 0 in 0.237s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:42:58 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-c5154f62-d553-4e59-a947-9c4c0199fe26 tempest-SnapshotDependencyTests-456084937 None] Lock "cinder-quobyte-83a7c635-76e1-426b-8cd7-650e73617571" released by "_copy_volume_from_snapshot" :: held 5.052s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:42:58 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-c5154f62-d553-4e59-a947-9c4c0199fe26 tempest-SnapshotDependencyTests-456084937 None] Lock "cinder-quobyte-6048c2a2-06a3-4cfb-a457-46e40136ec88-83a7c635-76e1-426b-8cd7-650e73617571" released by "_create_volume_from_snapshot" :: held 5.113s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:42:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-c5154f62-d553-4e59-a947-9c4c0199fe26 tempest-SnapshotDependencyTests-456084937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.127s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:42:58 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-c5154f62-d553-4e59-a947-9c4c0199fe26 tempest-SnapshotDependencyTests-456084937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5014db9c-2e6d-4a3b-8fbc-b52607970458) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83a7c635-76e1-426b-8cd7-650e73617571', 'volume_size': 1, 'snapshot_id': '6048c2a2-06a3-4cfb-a457-46e40136ec88'}' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:42:58 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-c5154f62-d553-4e59-a947-9c4c0199fe26 tempest-SnapshotDependencyTests-456084937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (553dad6b-e134-4159-bbed-cf1bbf1afdbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 30 20:42:58 devstack cinder-volume[88719]: INFO cinder.volume.flows.manager.create_volume [None req-c5154f62-d553-4e59-a947-9c4c0199fe26 tempest-SnapshotDependencyTests-456084937 None] Volume volume-83a7c635-76e1-426b-8cd7-650e73617571 (83a7c635-76e1-426b-8cd7-650e73617571): created successfully
Jul 30 20:42:58 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-c5154f62-d553-4e59-a947-9c4c0199fe26 tempest-SnapshotDependencyTests-456084937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (553dad6b-e134-4159-bbed-cf1bbf1afdbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88719) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 30 20:42:58 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-c5154f62-d553-4e59-a947-9c4c0199fe26 tempest-SnapshotDependencyTests-456084937 None] Flow 'volume_create_manager' (079081ed-fcc6-4803-923c-5b1b5375f03e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88719) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 30 20:42:58 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-c5154f62-d553-4e59-a947-9c4c0199fe26 tempest-SnapshotDependencyTests-456084937 None] Created volume successfully.
Jul 30 20:42:58 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-81a563ab-4b86-4896-ad14-5cd369299b2f tempest-SnapshotDependencyTests-456084937 None] Acquiring lock "cinder-6048c2a2-06a3-4cfb-a457-46e40136ec88-delete_snapshot" by "delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:42:58 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-81a563ab-4b86-4896-ad14-5cd369299b2f tempest-SnapshotDependencyTests-456084937 None] Lock "cinder-6048c2a2-06a3-4cfb-a457-46e40136ec88-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:42:58 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-81a563ab-4b86-4896-ad14-5cd369299b2f tempest-SnapshotDependencyTests-456084937 None] Acquiring lock "cinder-quobyte-3bc67166-1d62-45a4-9a7e-99e9a234fd86" by "delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:42:58 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-81a563ab-4b86-4896-ad14-5cd369299b2f tempest-SnapshotDependencyTests-456084937 None] Lock "cinder-quobyte-3bc67166-1d62-45a4-9a7e-99e9a234fd86" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:42:58 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-81a563ab-4b86-4896-ad14-5cd369299b2f tempest-SnapshotDependencyTests-456084937 None] Acquiring lock "cinder-quobyte-6048c2a2-06a3-4cfb-a457-46e40136ec88" by "_delete_snapshot" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:42:58 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-81a563ab-4b86-4896-ad14-5cd369299b2f tempest-SnapshotDependencyTests-456084937 None] Lock "cinder-quobyte-6048c2a2-06a3-4cfb-a457-46e40136ec88" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:42:58 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-81a563ab-4b86-4896-ad14-5cd369299b2f tempest-SnapshotDependencyTests-456084937 None] Deleting offline snapshot 6048c2a2-06a3-4cfb-a457-46e40136ec88 of volume 3bc67166-1d62-45a4-9a7e-99e9a234fd86 {{(pid=88719) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 30 20:42:58 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-81a563ab-4b86-4896-ad14-5cd369299b2f tempest-SnapshotDependencyTests-456084937 None] snapshot_file for this snap is: volume-3bc67166-1d62-45a4-9a7e-99e9a234fd86.6048c2a2-06a3-4cfb-a457-46e40136ec88 {{(pid=88719) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 30 20:42:58 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[df577785-1920-48e3-98c7-11064eee5f8f]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:42:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-81a563ab-4b86-4896-ad14-5cd369299b2f tempest-SnapshotDependencyTests-456084937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3bc67166-1d62-45a4-9a7e-99e9a234fd86.6048c2a2-06a3-4cfb-a457-46e40136ec88 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:42:58 devstack sudo[109029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3bc67166-1d62-45a4-9a7e-99e9a234fd86.6048c2a2-06a3-4cfb-a457-46e40136ec88
Jul 30 20:42:58 devstack sudo[109029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:42:58 devstack sudo[109029]: pam_unix(sudo:session): session closed for user root
Jul 30 20:42:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-81a563ab-4b86-4896-ad14-5cd369299b2f tempest-SnapshotDependencyTests-456084937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3bc67166-1d62-45a4-9a7e-99e9a234fd86.6048c2a2-06a3-4cfb-a457-46e40136ec88" returned: 0 in 0.347s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:42:58 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.remotefs [None req-81a563ab-4b86-4896-ad14-5cd369299b2f tempest-SnapshotDependencyTests-456084937 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3bc67166-1d62-45a4-9a7e-99e9a234fd86(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88719) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 30 20:42:58 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1d380c1-d125-48db-8f16-7b98c2232a7b]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:42:58 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-81a563ab-4b86-4896-ad14-5cd369299b2f tempest-SnapshotDependencyTests-456084937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3bc67166-1d62-45a4-9a7e-99e9a234fd86 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:42:58 devstack sudo[109034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3bc67166-1d62-45a4-9a7e-99e9a234fd86
Jul 30 20:42:58 devstack sudo[109034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:42:59 devstack sudo[109034]: pam_unix(sudo:session): session closed for user root
Jul 30 20:42:59 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-81a563ab-4b86-4896-ad14-5cd369299b2f tempest-SnapshotDependencyTests-456084937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3bc67166-1d62-45a4-9a7e-99e9a234fd86" returned: 0 in 0.527s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:42:59 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-81a563ab-4b86-4896-ad14-5cd369299b2f tempest-SnapshotDependencyTests-456084937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3bc67166-1d62-45a4-9a7e-99e9a234fd86.6048c2a2-06a3-4cfb-a457-46e40136ec88 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:42:59 devstack sudo[109039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3bc67166-1d62-45a4-9a7e-99e9a234fd86.6048c2a2-06a3-4cfb-a457-46e40136ec88
Jul 30 20:42:59 devstack sudo[109039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:42:59 devstack sudo[109039]: pam_unix(sudo:session): session closed for user root
Jul 30 20:42:59 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-81a563ab-4b86-4896-ad14-5cd369299b2f tempest-SnapshotDependencyTests-456084937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3bc67166-1d62-45a4-9a7e-99e9a234fd86.6048c2a2-06a3-4cfb-a457-46e40136ec88" returned: 0 in 0.316s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:42:59 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-81a563ab-4b86-4896-ad14-5cd369299b2f tempest-SnapshotDependencyTests-456084937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3bc67166-1d62-45a4-9a7e-99e9a234fd86.6048c2a2-06a3-4cfb-a457-46e40136ec88 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:42:59 devstack sudo[109044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3bc67166-1d62-45a4-9a7e-99e9a234fd86.6048c2a2-06a3-4cfb-a457-46e40136ec88
Jul 30 20:42:59 devstack sudo[109044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:42:59 devstack sudo[109044]: pam_unix(sudo:session): session closed for user root
Jul 30 20:42:59 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-81a563ab-4b86-4896-ad14-5cd369299b2f tempest-SnapshotDependencyTests-456084937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3bc67166-1d62-45a4-9a7e-99e9a234fd86.6048c2a2-06a3-4cfb-a457-46e40136ec88" returned: 0 in 0.240s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:43:00 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-81a563ab-4b86-4896-ad14-5cd369299b2f tempest-SnapshotDependencyTests-456084937 None] Lock "cinder-quobyte-6048c2a2-06a3-4cfb-a457-46e40136ec88" released by "_delete_snapshot" :: held 1.523s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:43:00 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-81a563ab-4b86-4896-ad14-5cd369299b2f tempest-SnapshotDependencyTests-456084937 None] Lock "cinder-quobyte-3bc67166-1d62-45a4-9a7e-99e9a234fd86" released by "delete_snapshot" :: held 1.544s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:43:00 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-81a563ab-4b86-4896-ad14-5cd369299b2f tempest-SnapshotDependencyTests-456084937 None] Created reservations ['890908f5-a890-4a81-b3c9-f530a3a10f18', '54646b60-cd35-49f1-9c01-6b4a99102fb6', '2206deaf-a246-486c-a9da-42c3c9c788a2', 'd631fcb2-cbb3-4f46-9daa-2dc53f38570d'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:43:00 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-81a563ab-4b86-4896-ad14-5cd369299b2f tempest-SnapshotDependencyTests-456084937 None] Delete snapshot completed successfully.
Jul 30 20:43:00 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-81a563ab-4b86-4896-ad14-5cd369299b2f tempest-SnapshotDependencyTests-456084937 None] Lock "cinder-6048c2a2-06a3-4cfb-a457-46e40136ec88-delete_snapshot" released by "delete_snapshot" :: held 1.674s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:43:00 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-06bb3805-d304-4bbe-aca7-89ce383fc3cc tempest-SnapshotDependencyTests-456084937 None] Acquiring lock "cinder-3bc67166-1d62-45a4-9a7e-99e9a234fd86-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:43:00 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-06bb3805-d304-4bbe-aca7-89ce383fc3cc tempest-SnapshotDependencyTests-456084937 None] Lock "cinder-3bc67166-1d62-45a4-9a7e-99e9a234fd86-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:43:00 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-06bb3805-d304-4bbe-aca7-89ce383fc3cc tempest-SnapshotDependencyTests-456084937 None] Acquiring lock "cinder-quobyte-3bc67166-1d62-45a4-9a7e-99e9a234fd86" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:43:00 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-06bb3805-d304-4bbe-aca7-89ce383fc3cc tempest-SnapshotDependencyTests-456084937 None] Lock "cinder-quobyte-3bc67166-1d62-45a4-9a7e-99e9a234fd86" acquired by "delete_volume" :: waited 0.014s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:43:00 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[5186d9d8-81aa-49b3-b935-c481eeb80004]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:43:00 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-06bb3805-d304-4bbe-aca7-89ce383fc3cc tempest-SnapshotDependencyTests-456084937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3bc67166-1d62-45a4-9a7e-99e9a234fd86 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:43:00 devstack sudo[109047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3bc67166-1d62-45a4-9a7e-99e9a234fd86
Jul 30 20:43:00 devstack sudo[109047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:43:01 devstack sudo[109047]: pam_unix(sudo:session): session closed for user root
Jul 30 20:43:01 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-06bb3805-d304-4bbe-aca7-89ce383fc3cc tempest-SnapshotDependencyTests-456084937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3bc67166-1d62-45a4-9a7e-99e9a234fd86" returned: 0 in 0.357s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:43:01 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-06bb3805-d304-4bbe-aca7-89ce383fc3cc tempest-SnapshotDependencyTests-456084937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3bc67166-1d62-45a4-9a7e-99e9a234fd86 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:43:01 devstack sudo[109052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3bc67166-1d62-45a4-9a7e-99e9a234fd86
Jul 30 20:43:01 devstack sudo[109052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:43:01 devstack sudo[109052]: pam_unix(sudo:session): session closed for user root
Jul 30 20:43:01 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-06bb3805-d304-4bbe-aca7-89ce383fc3cc tempest-SnapshotDependencyTests-456084937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-3bc67166-1d62-45a4-9a7e-99e9a234fd86" returned: 0 in 0.250s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:43:01 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-06bb3805-d304-4bbe-aca7-89ce383fc3cc tempest-SnapshotDependencyTests-456084937 None] Lock "cinder-quobyte-3bc67166-1d62-45a4-9a7e-99e9a234fd86" released by "delete_volume" :: held 0.663s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:43:01 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-06bb3805-d304-4bbe-aca7-89ce383fc3cc tempest-SnapshotDependencyTests-456084937 None] Created reservations ['39d107db-9500-49dc-9c70-568f9d2ecdda', 'c6edf8c1-f36a-4a82-810b-ebbc00376c85', '0bbe86dd-09ed-46f1-bda9-093c9efdc19c', '22ef090f-f736-4e0c-8e6a-dc9199eaa029'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:43:01 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-06bb3805-d304-4bbe-aca7-89ce383fc3cc tempest-SnapshotDependencyTests-456084937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:43:01 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-06bb3805-d304-4bbe-aca7-89ce383fc3cc tempest-SnapshotDependencyTests-456084937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:43:01 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-06bb3805-d304-4bbe-aca7-89ce383fc3cc tempest-SnapshotDependencyTests-456084937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:43:01 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-06bb3805-d304-4bbe-aca7-89ce383fc3cc tempest-SnapshotDependencyTests-456084937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:43:01 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-06bb3805-d304-4bbe-aca7-89ce383fc3cc tempest-SnapshotDependencyTests-456084937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:43:01 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-06bb3805-d304-4bbe-aca7-89ce383fc3cc tempest-SnapshotDependencyTests-456084937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:43:01 devstack sudo[109055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:43:01 devstack sudo[109055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:43:01 devstack sudo[109055]: pam_unix(sudo:session): session closed for user root
Jul 30 20:43:01 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-06bb3805-d304-4bbe-aca7-89ce383fc3cc tempest-SnapshotDependencyTests-456084937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.242s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:43:01 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-06bb3805-d304-4bbe-aca7-89ce383fc3cc tempest-SnapshotDependencyTests-456084937 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:43:01 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-06bb3805-d304-4bbe-aca7-89ce383fc3cc tempest-SnapshotDependencyTests-456084937 None] Deleted volume successfully.
Jul 30 20:43:01 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-06bb3805-d304-4bbe-aca7-89ce383fc3cc tempest-SnapshotDependencyTests-456084937 None] Lock "cinder-3bc67166-1d62-45a4-9a7e-99e9a234fd86-delete_volume" released by "delete_volume" :: held 1.092s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:43:01 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-15fcf5d2-a92c-4ce8-9fcf-5152abda332b tempest-SnapshotDependencyTests-456084937 None] Acquiring lock "cinder-83a7c635-76e1-426b-8cd7-650e73617571-delete_volume" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:43:01 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-15fcf5d2-a92c-4ce8-9fcf-5152abda332b tempest-SnapshotDependencyTests-456084937 None] Lock "cinder-83a7c635-76e1-426b-8cd7-650e73617571-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:43:01 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-15fcf5d2-a92c-4ce8-9fcf-5152abda332b tempest-SnapshotDependencyTests-456084937 None] Acquiring lock "cinder-quobyte-83a7c635-76e1-426b-8cd7-650e73617571" by "delete_volume" {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 30 20:43:01 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-15fcf5d2-a92c-4ce8-9fcf-5152abda332b tempest-SnapshotDependencyTests-456084937 None] Lock "cinder-quobyte-83a7c635-76e1-426b-8cd7-650e73617571" acquired by "delete_volume" :: waited 0.014s {{(pid=88719) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 30 20:43:01 devstack cinder-volume[88719]: DEBUG oslo.privsep.daemon [-] privsep: reply[48058a27-9376-4782-bafb-0939320f4a97]: (4, 'qcow2') {{(pid=89911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 30 20:43:01 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-15fcf5d2-a92c-4ce8-9fcf-5152abda332b tempest-SnapshotDependencyTests-456084937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-83a7c635-76e1-426b-8cd7-650e73617571 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:43:01 devstack sudo[109058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-83a7c635-76e1-426b-8cd7-650e73617571
Jul 30 20:43:01 devstack sudo[109058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:43:02 devstack sudo[109058]: pam_unix(sudo:session): session closed for user root
Jul 30 20:43:02 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-15fcf5d2-a92c-4ce8-9fcf-5152abda332b tempest-SnapshotDependencyTests-456084937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-83a7c635-76e1-426b-8cd7-650e73617571" returned: 0 in 0.363s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:43:02 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-15fcf5d2-a92c-4ce8-9fcf-5152abda332b tempest-SnapshotDependencyTests-456084937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-83a7c635-76e1-426b-8cd7-650e73617571 {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:43:02 devstack sudo[109063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-83a7c635-76e1-426b-8cd7-650e73617571
Jul 30 20:43:02 devstack sudo[109063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:43:02 devstack sudo[109063]: pam_unix(sudo:session): session closed for user root
Jul 30 20:43:02 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-15fcf5d2-a92c-4ce8-9fcf-5152abda332b tempest-SnapshotDependencyTests-456084937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df/volume-83a7c635-76e1-426b-8cd7-650e73617571" returned: 0 in 0.253s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:43:02 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-15fcf5d2-a92c-4ce8-9fcf-5152abda332b tempest-SnapshotDependencyTests-456084937 None] Lock "cinder-quobyte-83a7c635-76e1-426b-8cd7-650e73617571" released by "delete_volume" :: held 0.657s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:43:02 devstack cinder-volume[88719]: DEBUG cinder.quota [None req-15fcf5d2-a92c-4ce8-9fcf-5152abda332b tempest-SnapshotDependencyTests-456084937 None] Created reservations ['c50737e1-eb6d-4dee-b7ac-f4b2a6f54c90', 'e921feea-d0f3-4104-9228-85538f8d1987', 'b3b081a0-051e-4e0f-b9ec-c1084058e648', 'ea88dd16-f088-459e-a015-a8a8469d531d'] {{(pid=88719) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 30 20:43:02 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-15fcf5d2-a92c-4ce8-9fcf-5152abda332b tempest-SnapshotDependencyTests-456084937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:43:02 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-15fcf5d2-a92c-4ce8-9fcf-5152abda332b tempest-SnapshotDependencyTests-456084937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:43:02 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-15fcf5d2-a92c-4ce8-9fcf-5152abda332b tempest-SnapshotDependencyTests-456084937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:43:02 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-15fcf5d2-a92c-4ce8-9fcf-5152abda332b tempest-SnapshotDependencyTests-456084937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:43:02 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-15fcf5d2-a92c-4ce8-9fcf-5152abda332b tempest-SnapshotDependencyTests-456084937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:43:02 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-15fcf5d2-a92c-4ce8-9fcf-5152abda332b tempest-SnapshotDependencyTests-456084937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:43:02 devstack sudo[109066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:43:02 devstack sudo[109066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:43:02 devstack sudo[109066]: pam_unix(sudo:session): session closed for user root
Jul 30 20:43:02 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-15fcf5d2-a92c-4ce8-9fcf-5152abda332b tempest-SnapshotDependencyTests-456084937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.242s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:43:02 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-15fcf5d2-a92c-4ce8-9fcf-5152abda332b tempest-SnapshotDependencyTests-456084937 None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:43:02 devstack cinder-volume[88719]: INFO cinder.volume.manager [None req-15fcf5d2-a92c-4ce8-9fcf-5152abda332b tempest-SnapshotDependencyTests-456084937 None] Deleted volume successfully.
Jul 30 20:43:02 devstack cinder-volume[88719]: DEBUG cinder.coordination [None req-15fcf5d2-a92c-4ce8-9fcf-5152abda332b tempest-SnapshotDependencyTests-456084937 None] Lock "cinder-83a7c635-76e1-426b-8cd7-650e73617571-delete_volume" released by "delete_volume" :: held 1.089s {{(pid=88719) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 30 20:43:12 devstack cinder-volume[88719]: DEBUG dbcounter [-] [88719] Writing DB stats cinder:SELECT=24,cinder:UPDATE=27,cinder:DELETE=3,cinder:INSERT=7 {{(pid=88719) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 30 20:43:12 devstack cinder-volume[88719]: DEBUG dbcounter [-] [88719] Writing DB stats cinder:SELECT=25,cinder:UPDATE=31,cinder:INSERT=8,cinder:DELETE=2 {{(pid=88719) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 30 20:43:16 devstack cinder-volume[88719]: DEBUG oslo_service.periodic_task [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88719) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 30 20:43:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 30 20:43:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 30 20:43:16 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5': None} {{(pid=88719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Jul 30 20:43:16 devstack cinder-volume[88719]: DEBUG cinder.volume.drivers.quobyte [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c4bf0622-523e-493d-9347-530502e554e5'] {{(pid=88719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Jul 30 20:43:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.lockutils [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88719) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 30 20:43:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 30 20:43:16 devstack sudo[109144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df
Jul 30 20:43:16 devstack sudo[109144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 30 20:43:16 devstack sudo[109144]: pam_unix(sudo:session): session closed for user root
Jul 30 20:43:16 devstack cinder-volume[88719]: DEBUG oslo_concurrency.processutils [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67b32a82f2c120c6ceab9a122d01d9df" returned: 0 in 0.233s {{(pid=88719) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 30 20:43:16 devstack cinder-volume[88719]: DEBUG cinder.manager [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Notifying Schedulers of capabilities ... {{(pid=88719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 30 20:43:16 devstack cinder-volume[88719]: DEBUG oslo_service.periodic_task [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] Running periodic task VolumeManager._thread_info {{(pid=88719) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 30 20:43:16 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] thread count: 28 {{(pid=88719) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 30 20:43:16 devstack cinder-volume[88719]: DEBUG cinder.volume.manager [None req-87867bc1-bbda-43d7-8eb2-c39d98a3db64 None None] thread info: [<_MainThread(MainThread, started 132390416908416)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132390306497536)>, <Thread(Thread-3 (stat_writer), started daemon 132390304471680)>, <Thread(Rabbit-heartbeat, started daemon 132390303393408)>, <Thread(Thread-5 (_runner), started daemon 132390303543168)>, <Thread(Thread-7 (_runner), started daemon 132390303563392)>, <Thread(fd_logger, started daemon 132390301344640)>, <Thread(privsep_reader, started daemon 132390301560640)>, <Thread(tpool_thread_0, started daemon 132390291470016)>, <Thread(tpool_thread_1, started daemon 132390283077312)>, <Thread(tpool_thread_2, started daemon 132390274684608)>, <Thread(tpool_thread_3, started daemon 132390266291904)>, <Thread(tpool_thread_4, started daemon 132390257899200)>, <Thread(tpool_thread_5, started daemon 132390249506496)>, <Thread(tpool_thread_6, started daemon 132390241113792)>, <Thread(tpool_thread_7, started daemon 132390232721088)>, <Thread(tpool_thread_8, started daemon 132390224328384)>, <Thread(tpool_thread_9, started daemon 132390215919296)>, <Thread(tpool_thread_10, started daemon 132390207510208)>, <Thread(tpool_thread_11, started daemon 132390199101120)>, <Thread(tpool_thread_12, started daemon 132390190692032)>, <Thread(tpool_thread_13, started daemon 132390182282944)>, <Thread(tpool_thread_14, started daemon 132390173873856)>, <Thread(tpool_thread_15, started daemon 132390165464768)>, <Thread(tpool_thread_16, started daemon 132390157055680)>, <Thread(tpool_thread_17, started daemon 132390148646592)>, <Thread(tpool_thread_18, started daemon 132390140237504)>, <Thread(tpool_thread_19, started daemon 132390131828416)>] {{(pid=88719) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}